-- Logs begin at Thu 2022-07-28 09:43:16 UTC, end at Thu 2022-07-28 11:09:17 UTC. -- Jul 28 10:19:08.377256 n-d-850468-6 systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 10:19:08.387007 n-d-850468-6 devstack@n-api.service[103938]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 10:19:08.389104 n-d-850468-6 devstack@n-api.service[103938]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 10:19:08 2022] *** Jul 28 10:19:08.389104 n-d-850468-6 devstack@n-api.service[103938]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 10:19:08.389104 n-d-850468-6 devstack@n-api.service[103938]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 10:19:08.389104 n-d-850468-6 devstack@n-api.service[103938]: nodename: n-d-850468-6 Jul 28 10:19:08.389104 n-d-850468-6 devstack@n-api.service[103938]: machine: x86_64 Jul 28 10:19:08.389104 n-d-850468-6 devstack@n-api.service[103938]: clock source: unix Jul 28 10:19:08.389104 n-d-850468-6 devstack@n-api.service[103938]: pcre jit disabled Jul 28 10:19:08.389104 n-d-850468-6 devstack@n-api.service[103938]: detected number of CPU cores: 4 Jul 28 10:19:08.389104 n-d-850468-6 devstack@n-api.service[103938]: current working directory: / Jul 28 10:19:08.389104 n-d-850468-6 devstack@n-api.service[103938]: detected binary path: /usr/bin/uwsgi-core Jul 28 10:19:08.389784 n-d-850468-6 devstack@n-api.service[103938]: your processes number limit is 47680 Jul 28 10:19:08.389784 n-d-850468-6 devstack@n-api.service[103938]: your memory page size is 4096 bytes Jul 28 10:19:08.389784 n-d-850468-6 devstack@n-api.service[103938]: detected max file descriptor number: 2048 Jul 28 10:19:08.389784 n-d-850468-6 devstack@n-api.service[103938]: lock engine: pthread robust mutexes Jul 28 10:19:08.389784 n-d-850468-6 devstack@n-api.service[103938]: thunder lock: enabled Jul 28 10:19:08.389784 n-d-850468-6 devstack@n-api.service[103938]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 10:19:08.389784 n-d-850468-6 devstack@n-api.service[103938]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 10:19:08.428992 n-d-850468-6 devstack@n-api.service[103938]: Python main interpreter initialized at 0x5569201249c0 Jul 28 10:19:08.428992 n-d-850468-6 devstack@n-api.service[103938]: python threads support enabled Jul 28 10:19:08.428992 n-d-850468-6 devstack@n-api.service[103938]: your server socket listen backlog is limited to 100 connections Jul 28 10:19:08.428992 n-d-850468-6 devstack@n-api.service[103938]: your mercy for graceful operations on workers is 90 seconds Jul 28 10:19:08.429346 n-d-850468-6 devstack@n-api.service[103938]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 10:19:08.429423 n-d-850468-6 devstack@n-api.service[103938]: *** Operational MODE: preforking *** Jul 28 10:19:08.429664 n-d-850468-6 devstack@n-api.service[103938]: *** uWSGI is running in multiple interpreter mode *** Jul 28 10:19:08.429664 n-d-850468-6 devstack@n-api.service[103938]: spawned uWSGI master process (pid: 103938) Jul 28 10:19:08.429870 n-d-850468-6 systemd[1]: Started Devstack devstack@n-api.service. Jul 28 10:19:08.431235 n-d-850468-6 devstack@n-api.service[103938]: spawned uWSGI worker 1 (pid: 103939, cores: 1) Jul 28 10:19:08.431235 n-d-850468-6 devstack@n-api.service[103938]: spawned uWSGI worker 2 (pid: 103940, cores: 1) Jul 28 10:19:08.431235 n-d-850468-6 devstack@n-api.service[103938]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 10:19:09.094432 n-d-850468-6 devstack@n-api.service[103940]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 10:19:09.095039 n-d-850468-6 devstack@n-api.service[103939]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 10:19:10.185538 n-d-850468-6 devstack@n-api.service[103940]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 10:19:10.185538 n-d-850468-6 devstack@n-api.service[103940]: from cryptography.utils import int_from_bytes Jul 28 10:19:10.186160 n-d-850468-6 devstack@n-api.service[103940]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 10:19:10.186160 n-d-850468-6 devstack@n-api.service[103940]: from cryptography.utils import int_from_bytes Jul 28 10:19:10.188471 n-d-850468-6 devstack@n-api.service[103939]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 10:19:10.188471 n-d-850468-6 devstack@n-api.service[103939]: from cryptography.utils import int_from_bytes Jul 28 10:19:10.188885 n-d-850468-6 devstack@n-api.service[103939]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 10:19:10.188885 n-d-850468-6 devstack@n-api.service[103939]: from cryptography.utils import int_from_bytes Jul 28 10:19:12.661410 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 10:19:12.662009 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 10:19:12.662243 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 10:19:12.662605 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 10:19:12.662861 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 10:19:12.663246 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.663570 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.663892 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.663987 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 10:19:12.664339 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 10:19:12.664424 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.664782 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.664913 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 10:19:12.665100 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.665279 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 10:19:12.665420 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.665534 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 10:19:12.665739 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.665937 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.666089 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.666270 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.666370 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.666593 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.666694 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.666916 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.667020 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850468-6 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.667248 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.667342 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.667554 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.667645 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.667861 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.667946 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.668177 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.668262 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.668479 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.668563 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.668750 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.668841 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.669068 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.669153 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.669395 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850468-6 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.669575 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.669718 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.670050 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.670176 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.670359 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.670456 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.670668 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.670760 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.670972 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.671072 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.671296 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.671403 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.671603 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.671700 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.671920 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.672107 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.672230 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.672419 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.672552 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.672727 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.672860 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.673037 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.673253 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850468-6 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.673374 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.673567 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.673698 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.673898 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.674033 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.674216 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.674357 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.674630 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.674719 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.674944 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.675039 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.675250 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.675338 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.675567 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.675682 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850468-6 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.675895 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.675991 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.676215 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.676306 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.676532 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.676639 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.676851 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.676992 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.677168 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.677267 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.677486 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.678144 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.678345 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.678480 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.678731 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.678819 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.678957 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.679110 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.679273 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.679439 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.679576 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.679760 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.679880 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.680081 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.680166 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.680405 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.680504 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.680709 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.680800 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.681022 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.681171 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.681335 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.681422 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.681584 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.681668 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.681833 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.681990 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.682173 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.682267 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.682493 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.682589 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.682797 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.682961 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.683104 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.683190 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.683408 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.683492 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.683712 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.683804 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.683973 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.684057 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.684233 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.684421 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.684551 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.684727 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.684873 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.685033 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.685183 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.685352 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.685492 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.685668 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.685805 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.686012 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.686143 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.686315 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.686435 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.686634 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.686738 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.687026 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.687125 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.687275 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.687365 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.687583 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.687677 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.687920 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.688007 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.688238 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.688335 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.688549 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.688637 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.688864 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.688960 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.689183 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.689269 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.689489 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.689575 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.689794 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.689929 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.690136 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.690231 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.690454 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.690542 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.690766 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.690862 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.691073 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.691176 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.691324 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.691427 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.691625 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.691722 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.691929 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.692015 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.692244 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.692338 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.692549 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.692645 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.692854 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.692949 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.693159 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.693323 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.694075 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.694174 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.694389 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.694501 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.694699 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.694816 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.695023 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.695111 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.695334 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.695422 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.695642 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.695728 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.695953 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.696041 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.696256 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.696342 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.696563 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.696675 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.696873 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.696971 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.697184 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.697283 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.697491 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.697594 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.697797 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.697917 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.698129 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.698215 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.698433 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.698534 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.698739 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.698826 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.699046 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.699141 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.699350 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.699446 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.699655 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.699742 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.699970 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.700056 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.700282 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.700588 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.700732 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.700898 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.701046 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.701218 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.701428 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.701574 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.701705 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.701836 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.701954 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.702156 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.702243 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.702456 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.702541 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.702761 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.702845 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.703079 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.703176 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.703387 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.703472 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.703691 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.703774 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.703994 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.704080 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.704298 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.704383 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.704603 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.704685 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.704904 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.705002 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.705206 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.705291 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.705511 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.705597 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.705808 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.705932 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.706140 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.706248 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.706444 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.706542 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.706751 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.706859 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.707052 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.707136 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.707355 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.707439 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.707657 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.707753 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.707977 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.708060 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.708300 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.708384 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.708610 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.708695 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.708977 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.709096 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.709282 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.709464 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.709606 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:19:12.709796 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.709965 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.710142 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.710301 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.710457 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.710647 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.710774 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.710965 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.711102 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.711299 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.711433 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.711633 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.711718 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.711951 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.712034 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.712268 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.712360 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.712585 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.712672 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.712913 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.712997 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.713228 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.713326 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.713545 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.713650 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.713876 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.713963 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.714191 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.714287 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.714509 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.714595 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.714839 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.714930 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.715156 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.715254 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.715469 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.715555 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.715789 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.715874 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.716106 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.716218 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.716428 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.716513 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.716750 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.716835 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.717070 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.717161 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.717382 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.717476 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.717693 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.717777 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.718035 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.718139 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.718357 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.718443 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.718687 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.718771 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.719000 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.719094 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.719312 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.719402 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.719620 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.719704 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.719930 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.720014 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.720237 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.720328 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.720545 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.720636 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.720855 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.720942 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.721185 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.721274 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.721497 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.721598 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.721809 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.721937 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.722143 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.722226 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.722453 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.722548 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.722760 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.722844 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.723069 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.723163 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.723379 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.723471 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.723683 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.723767 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.723986 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.724077 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.724289 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.724382 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.725114 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.725202 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.725417 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.725508 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.725736 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.725828 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.726088 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.726175 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.726395 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.726489 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.726706 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.726791 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.727017 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.727097 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.727322 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.727404 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.727628 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.727721 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.727935 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.728031 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.728238 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.728324 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.728548 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.728640 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.728857 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.728942 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.729159 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.729252 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.729468 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.729555 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.729774 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.729879 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.730103 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.730199 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.730415 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.730507 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.730716 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.730808 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.731019 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.731112 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.731329 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.731415 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.731636 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.731717 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.731943 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.732036 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.732249 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.732333 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.732557 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.732655 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.732861 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.732946 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.733173 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.733256 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.733480 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.733580 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.733792 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.733913 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.734131 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.734224 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.734445 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.734530 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.734766 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.734851 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.735076 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.735160 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.735389 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.735472 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.735689 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.735773 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.735996 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.736087 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.736299 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.736394 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.736604 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.736705 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.736903 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.736987 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.737208 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.737301 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.737510 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.737592 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.737812 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.737927 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.738160 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.738253 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.738461 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.738546 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.738763 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.738858 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.739070 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.739163 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.739388 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.739479 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.739677 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.739762 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.739977 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.740069 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.740829 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.740915 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.741176 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.741259 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.741480 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.741566 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.741824 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.741948 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.742125 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.742211 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.742432 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.742525 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.742739 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.742823 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.743073 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.743163 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.743393 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.743484 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.743686 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.743772 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.743998 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.744096 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.744308 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.744392 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.744618 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.744703 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.744937 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.745034 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.745252 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.745336 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.745569 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.745653 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.745893 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.745999 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.746212 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.746295 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.746519 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.746598 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.746837 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.746930 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.747140 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.747225 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.747454 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.747547 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.747766 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.747870 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.748091 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.748177 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.748407 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.748491 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.748724 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.748810 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.749031 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.749114 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.749339 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.749431 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.749648 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.749743 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.749983 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.750087 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.750294 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.750387 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.750603 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.750688 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.750918 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.751010 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.751227 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.751312 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.751542 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.751626 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.751848 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.751931 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.752160 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.752263 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.752463 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.752548 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.752780 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.752874 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.753080 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.753172 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.753390 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.753475 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.753700 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.753798 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.754047 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.754149 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.754357 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.754448 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.754667 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.754753 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.754976 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.755069 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.755290 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.755375 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.755598 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.755682 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.755971 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.756063 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.756284 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.756418 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.756584 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.756712 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.756893 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.756980 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.757209 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.757348 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.757517 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.757628 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.757825 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.757947 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.758153 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.758252 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.758466 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.758554 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.758774 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.758865 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.759078 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.759166 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.759381 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.759469 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.759691 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.759788 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.759998 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.760084 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.760306 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.760402 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.760615 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.760702 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.760923 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.761010 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.761225 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.761321 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.761529 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.761625 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.761850 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.761956 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.762186 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.762302 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.762509 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.762598 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.762827 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.762913 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.763133 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.763295 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.763437 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.763524 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.763761 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.763849 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.764063 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.764151 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.764370 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.764456 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.764678 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.764773 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.764987 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.765075 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.765300 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.765387 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.765607 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.765703 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.765939 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.766071 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.766260 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.766345 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.766570 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.766670 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.766872 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.766971 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.767175 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.767265 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.767483 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.767590 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.767792 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.767878 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.768101 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.768196 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.768418 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.768514 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.768723 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.768809 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.769031 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.769120 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.769339 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.769437 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.769640 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.769728 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.769970 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.770060 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.770290 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.770389 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.770599 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.770854 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.770941 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.771185 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.771286 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.771531 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.771685 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.771838 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.771961 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.772283 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.772399 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.772606 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.772728 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.772936 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.773065 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.773265 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.773386 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.773600 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.773697 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.773931 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.774045 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.774243 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.774368 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.774548 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.774703 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.774852 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.775040 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.775169 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.775384 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.775486 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.775694 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.775783 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.776008 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.776096 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.776318 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.776405 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.776624 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.776713 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.776937 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.777036 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.777238 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.777334 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.777539 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.777626 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.777847 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.777981 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.778179 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.778284 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.778484 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.778571 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.778786 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.778886 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.779092 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.779187 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.779398 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.779485 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.779698 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.779784 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.780001 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.780099 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.780303 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.780390 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.780609 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.780697 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.780934 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.781030 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.781246 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.781334 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.781553 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.781640 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.781890 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.781983 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.782187 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.782292 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.782518 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.782622 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.782826 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.782914 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.783129 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.783225 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.783432 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.783528 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.783734 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.783824 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.784044 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.784139 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.784352 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.784440 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.784655 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.784744 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.784964 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.785052 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.785293 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.785389 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.785598 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.785687 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.785935 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.786027 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.786250 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.786351 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.786556 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.786652 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.786858 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.787471 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.787777 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.787958 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.788108 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.788232 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.788391 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.791308 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.791420 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.791512 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.791584 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.791665 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.791744 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.791812 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.791886 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.791955 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.792021 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.792094 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.792168 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.792243 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.792320 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.792388 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.792453 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.792530 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.792607 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.792689 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.792766 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.792834 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.792900 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.792964 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.793028 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.793093 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.793170 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.793238 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.793311 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.793378 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.793443 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.793516 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.793592 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.793660 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.793725 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.794005 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.794097 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.794184 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.794331 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.794438 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.794658 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.794757 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.794968 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.795072 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.795276 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.795372 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.795590 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.795675 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.795902 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.795997 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.796209 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.796295 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.796515 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.796600 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.796819 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.796904 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.797123 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.797207 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.797431 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.797515 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.797732 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.797831 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.798062 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.798157 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.798366 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.798451 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.798672 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.798827 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.798961 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.799109 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.799255 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.799391 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.799565 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.799706 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.799866 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.800011 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.800171 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.800326 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.800467 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.800598 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.800767 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.800904 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.801092 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.801243 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.801404 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.801541 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.801713 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.801849 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.802048 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.802150 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.802354 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.802441 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.803413 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.803514 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.803797 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.803907 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.804140 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.804236 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.804450 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.804538 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.804770 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.804859 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.805084 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.805170 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.805399 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.805484 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.805708 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.805804 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.806038 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.806129 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.806356 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.806443 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.806664 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.806752 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.806976 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.807063 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.807289 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.807390 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.807601 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.807702 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.807911 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.808003 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.808217 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.808319 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.808526 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.808616 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.808857 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.808951 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.809137 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.809274 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.809469 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.809796 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.810044 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.810152 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.810430 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.810598 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.810742 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.810912 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.811053 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.811236 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.811351 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.811559 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.811676 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.811880 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.812003 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.812628 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.812726 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.812809 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.812877 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.812942 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.813008 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.813089 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.813166 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.813399 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.813477 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.813773 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.813889 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.814067 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.814184 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.814375 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.814468 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.814688 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.814776 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.814996 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.815084 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.815301 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.815387 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.815610 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.815694 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.815915 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.816046 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.816228 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.816360 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.816533 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.816671 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.816965 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.817050 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.817275 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.817368 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.817585 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.817757 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.817913 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.818003 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.818272 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.818416 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.818579 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.818681 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.819043 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.819142 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.819364 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.819450 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.819674 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.819770 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.820020 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.820112 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.820326 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.820410 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.820630 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.820718 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.820940 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.821032 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.821263 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.821349 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.821569 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.821656 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.821889 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.821976 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.822198 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.822295 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.822512 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.822598 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.822813 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.822897 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.823118 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.823201 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.823442 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.823528 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.823750 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.823896 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.824077 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.824172 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.824499 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.824586 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.824815 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.824900 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.825124 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.825217 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.825451 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.825545 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.825774 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.825884 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.826123 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.826223 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.826429 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.826514 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.826743 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.826829 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.827055 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.827151 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.827379 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.827476 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.827701 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.827787 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.828010 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.828095 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.828331 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.828532 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.828624 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.828706 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.828940 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.829030 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.829259 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.829358 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.829566 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.829655 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.829908 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.830000 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.830233 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.830324 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.830551 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.830640 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.830875 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.830971 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.831238 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.831327 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.831561 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.831649 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.831867 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.831965 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.832173 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.832272 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.832483 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.832571 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.832787 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.832885 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.833093 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.833190 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.833413 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.833500 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.833715 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.833824 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.834177 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.834298 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.834494 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.834734 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.834824 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.835047 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.835146 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.835365 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.835453 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.835680 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.835767 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.835996 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.836092 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.836304 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.836399 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.836610 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.836708 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.836929 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.837024 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.837234 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.837321 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.837539 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.837642 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.837894 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.837987 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.838197 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.838435 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.838521 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.838612 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.838796 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.838885 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.839099 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.839186 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.839466 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.839625 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.839714 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.839802 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.840017 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.840106 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.840322 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.840412 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.840666 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.840755 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.840975 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.841062 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.841298 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.841387 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.841623 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.841711 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.841984 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.842083 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.842285 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.842386 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.842604 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.842692 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.842926 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.843024 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.843229 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.843325 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.843540 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.843636 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.843838 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.843935 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.844143 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.844240 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.844445 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.844535 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.844748 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.844851 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.845055 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.845146 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.845362 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.845448 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.845662 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.845759 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.845989 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.846082 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.846301 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.846390 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.846602 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.846699 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.846905 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.846991 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.847210 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.847298 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.847513 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.847601 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.847818 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.847906 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.848122 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.848210 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.848436 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.848537 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.848742 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.848834 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.849051 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.849140 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.849356 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.849957 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.850254 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.850383 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.850587 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.850889 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.850996 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.851210 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.851298 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.851527 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.851625 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.851846 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.851936 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.852163 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.852259 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.852479 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.852575 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.852798 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.852902 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.853119 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.853245 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.853434 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.853532 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.853743 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.853846 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.854101 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.854193 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.854397 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.854492 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.854717 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.854812 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.855036 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.855255 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.855341 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.855586 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.855681 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.855905 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.855991 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.856220 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.856304 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.856532 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.856803 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.856890 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.857137 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.857225 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.857447 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.857542 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.857759 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.857844 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.858096 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.858193 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.858407 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.858510 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.858724 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.858828 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.859038 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.859132 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.859367 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.859502 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.859666 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.859752 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.859977 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.860063 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.860290 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.860376 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.860605 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.860690 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.860919 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.861012 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.861252 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.861337 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.861571 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.861664 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.861893 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.861995 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.862213 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.862307 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.862527 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.862616 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.862842 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.862928 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.863154 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.863276 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.863466 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.863554 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.863779 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.863866 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.864091 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.864176 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.864401 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.864490 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.864713 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.864800 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.865024 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.865204 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.865997 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.866131 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.866328 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.866453 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.866667 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.866763 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.866991 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.867085 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.867307 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.867395 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.867623 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.867710 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.867941 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.868039 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.868318 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.868460 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.868641 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.868781 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.868964 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.869113 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.869279 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.869439 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.869601 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.869767 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.870110 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.870203 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.870431 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.870519 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.870759 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.870860 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.871070 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.871170 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.871374 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.871470 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.871686 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.871775 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.871997 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.872087 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.872304 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.872405 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.872625 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.872721 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.872934 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.873022 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.873238 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.873386 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.873551 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.873648 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.873884 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.873989 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.874201 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.874415 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.874516 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.874764 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.874854 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.875085 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.875173 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.875412 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.875501 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.875742 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.875941 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.876062 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.876293 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.876381 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.876621 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.876711 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.876951 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.877038 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.877270 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.877356 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.877585 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.877674 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.877912 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.878003 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.878240 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.878327 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.878550 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.878646 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.878859 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.878994 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.879179 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.879279 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.879493 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.879609 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.879805 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.879906 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.880107 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.880208 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.880419 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.880508 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.880769 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.880863 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.881082 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.881195 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.881385 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.881488 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.881696 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.881784 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.882027 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.882129 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.882334 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.882424 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.882641 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.882736 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.882945 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.883044 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.883259 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.883347 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.883563 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.883655 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.883873 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.883963 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.884178 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.884273 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.884491 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.884611 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.884793 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.884896 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.885105 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.885243 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.885415 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.885555 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.885711 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.885844 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.886048 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.886177 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.886357 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.886485 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.886725 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.886867 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.887032 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.887169 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.887359 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.887524 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.887657 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.887801 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.887963 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.888118 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.888282 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.888496 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.888627 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.888767 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.888900 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.889133 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.889271 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.889476 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.889612 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.889802 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.889960 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.890164 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.890259 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.890499 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.890702 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.890809 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.891043 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.891130 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.891371 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.891459 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.891709 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.891796 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.892022 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.892106 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.892334 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.892421 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.892641 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.892725 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.892949 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.893042 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.893261 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.893348 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.893574 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.893670 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.893899 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.894001 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.894212 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.894297 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.894519 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.894651 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.894829 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.894930 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.895136 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.895223 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.895443 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.895528 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.895752 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.895850 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.896058 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.896142 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.896402 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.896490 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.896721 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.896807 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.897035 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.897120 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.897345 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.897431 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.897656 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.897751 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.897994 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.898083 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.898307 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.898403 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.898617 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.898710 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.898925 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.899010 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.899235 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.899339 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.899548 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.899634 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.899863 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.899946 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.900175 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.900278 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.900481 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.900566 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.900790 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.901002 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.901091 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.901182 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.901427 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.901513 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.901742 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.901828 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.902076 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.902164 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.902430 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.902514 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.902749 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.902835 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.903061 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.903149 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.903383 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.903469 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.903694 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.903801 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.904017 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.904104 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.904338 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.904425 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.904651 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.904736 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.904975 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.905062 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.905276 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.905360 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.905585 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.905680 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.905906 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.905995 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.906217 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.906303 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.906533 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.906632 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.906840 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.906934 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.907142 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.907234 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.907440 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.907540 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.907747 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.907841 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.908049 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.908142 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.908352 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.908446 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.908652 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.908737 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.908954 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.909038 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.909265 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.909384 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.909565 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.909679 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.909878 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.909978 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.910190 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.910288 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.910490 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.910586 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.910790 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.910888 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.911090 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.911189 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.911394 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.911534 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.911696 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.911811 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.912541 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.912641 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.912828 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.913013 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.913126 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.913221 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.913427 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.913514 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.913744 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.913851 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.914077 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.914196 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.914382 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.914481 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.914940 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.915037 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.915248 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.915346 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.915570 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.915657 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.915878 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.915980 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.916203 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.916292 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.916522 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.916612 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.916836 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.916923 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.917162 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.917260 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.917458 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.917544 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.917778 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.917975 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.918137 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.918221 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.918420 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.918514 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.918730 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.918814 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.919040 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.919128 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.919357 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.919507 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.919651 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.919799 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.919968 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.920113 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.920284 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.920376 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.920596 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.920695 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.920911 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.921001 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.921229 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.921316 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.921548 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.921646 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.921875 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.921966 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.922203 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.922292 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.922515 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.922605 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.922829 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.922926 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.923141 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.923230 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.923452 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.923541 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.923760 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.923844 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.924079 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.924176 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.924389 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.924478 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.924699 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.924794 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.925013 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.925111 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.925328 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.925416 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.925646 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.925734 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.925998 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.926103 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.926311 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.926402 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.926635 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.926724 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.926962 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.927059 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.927293 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.927379 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.928186 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.928327 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.928504 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.928596 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.928834 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.928931 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.929160 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.929258 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.929478 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.929569 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.929785 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.929893 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.930057 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 10:19:12.930173 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.930509 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.930828 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.931145 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.931456 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:19:12.931704 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 10:19:13.085596 n-d-850468-6 devstack@n-api.service[103940]: INFO dbcounter [None req-ca85f45e-4fc5-49ca-9f34-965822e7c582 None None] Registered counter for database nova_api Jul 28 10:19:13.086960 n-d-850468-6 devstack@n-api.service[103939]: INFO dbcounter [None req-dfda21d5-b2eb-445e-b2d7-ba4007fc95e2 None None] Registered counter for database nova_api Jul 28 10:19:13.107262 n-d-850468-6 devstack@n-api.service[103940]: DEBUG oslo_db.sqlalchemy.engines [None req-ca85f45e-4fc5-49ca-9f34-965822e7c582 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:19:13.109096 n-d-850468-6 devstack@n-api.service[103939]: DEBUG oslo_db.sqlalchemy.engines [None req-dfda21d5-b2eb-445e-b2d7-ba4007fc95e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:19:13.113843 n-d-850468-6 devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writer thread running {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:19:13.116181 n-d-850468-6 devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writer thread running {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:19:13.171565 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.context [None req-ca85f45e-4fc5-49ca-9f34-965822e7c582 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a9e94609-c9be-4409-8579-80fe73a29a93(cell1) {{(pid=103940) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 10:19:13.173620 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.context [None req-dfda21d5-b2eb-445e-b2d7-ba4007fc95e2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a9e94609-c9be-4409-8579-80fe73a29a93(cell1) {{(pid=103939) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 10:19:13.175441 n-d-850468-6 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-ca85f45e-4fc5-49ca-9f34-965822e7c582 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:19:13.176989 n-d-850468-6 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-ca85f45e-4fc5-49ca-9f34-965822e7c582 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:19:13.178146 n-d-850468-6 devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-dfda21d5-b2eb-445e-b2d7-ba4007fc95e2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:19:13.178537 n-d-850468-6 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-ca85f45e-4fc5-49ca-9f34-965822e7c582 None None] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:19:13.179907 n-d-850468-6 devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-dfda21d5-b2eb-445e-b2d7-ba4007fc95e2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:19:13.180533 n-d-850468-6 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-ca85f45e-4fc5-49ca-9f34-965822e7c582 None None] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:19:13.180725 n-d-850468-6 devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-dfda21d5-b2eb-445e-b2d7-ba4007fc95e2 None None] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:19:13.182539 n-d-850468-6 devstack@n-api.service[103940]: INFO dbcounter [None req-ca85f45e-4fc5-49ca-9f34-965822e7c582 None None] Registered counter for database nova_cell0 Jul 28 10:19:13.182731 n-d-850468-6 devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-dfda21d5-b2eb-445e-b2d7-ba4007fc95e2 None None] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:19:13.184706 n-d-850468-6 devstack@n-api.service[103939]: INFO dbcounter [None req-dfda21d5-b2eb-445e-b2d7-ba4007fc95e2 None None] Registered counter for database nova_cell0 Jul 28 10:19:13.186634 n-d-850468-6 devstack@n-api.service[103940]: INFO dbcounter [None req-ca85f45e-4fc5-49ca-9f34-965822e7c582 None None] Registered counter for database nova_cell1 Jul 28 10:19:13.188700 n-d-850468-6 devstack@n-api.service[103939]: INFO dbcounter [None req-dfda21d5-b2eb-445e-b2d7-ba4007fc95e2 None None] Registered counter for database nova_cell1 Jul 28 10:19:13.195960 n-d-850468-6 devstack@n-api.service[103940]: DEBUG oslo_db.sqlalchemy.engines [None req-ca85f45e-4fc5-49ca-9f34-965822e7c582 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:19:13.196770 n-d-850468-6 devstack@n-api.service[103940]: DEBUG oslo_db.sqlalchemy.engines [None req-ca85f45e-4fc5-49ca-9f34-965822e7c582 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:19:13.198395 n-d-850468-6 devstack@n-api.service[103939]: DEBUG oslo_db.sqlalchemy.engines [None req-dfda21d5-b2eb-445e-b2d7-ba4007fc95e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:19:13.202085 n-d-850468-6 devstack@n-api.service[103939]: DEBUG oslo_db.sqlalchemy.engines [None req-dfda21d5-b2eb-445e-b2d7-ba4007fc95e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:19:13.203652 n-d-850468-6 devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writer thread running {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:19:13.203863 n-d-850468-6 devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writer thread running {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:19:13.206095 n-d-850468-6 devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writer thread running {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:19:13.344387 n-d-850468-6 devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writer thread running {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:19:13.348956 n-d-850468-6 devstack@n-api.service[103940]: INFO dbcounter [None req-ca85f45e-4fc5-49ca-9f34-965822e7c582 None None] Registered counter for database nova_cell0 Jul 28 10:19:13.353226 n-d-850468-6 devstack@n-api.service[103939]: INFO dbcounter [None req-dfda21d5-b2eb-445e-b2d7-ba4007fc95e2 None None] Registered counter for database nova_cell0 Jul 28 10:19:13.358063 n-d-850468-6 devstack@n-api.service[103940]: DEBUG oslo_db.sqlalchemy.engines [None req-ca85f45e-4fc5-49ca-9f34-965822e7c582 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:19:13.361771 n-d-850468-6 devstack@n-api.service[103939]: DEBUG oslo_db.sqlalchemy.engines [None req-dfda21d5-b2eb-445e-b2d7-ba4007fc95e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:19:13.362371 n-d-850468-6 devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writer thread running {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:19:13.366634 n-d-850468-6 devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writer thread running {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:19:13.698495 n-d-850468-6 devstack@n-api.service[103940]: WARNING keystonemiddleware.auth_token [None req-ca85f45e-4fc5-49ca-9f34-965822e7c582 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 10:19:13.704299 n-d-850468-6 devstack@n-api.service[103939]: WARNING keystonemiddleware.auth_token [None req-dfda21d5-b2eb-445e-b2d7-ba4007fc95e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 10:19:13.705715 n-d-850468-6 devstack@n-api.service[103940]: WARNING keystonemiddleware.auth_token [None req-ca85f45e-4fc5-49ca-9f34-965822e7c582 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 10:19:13.712137 n-d-850468-6 devstack@n-api.service[103939]: WARNING keystonemiddleware.auth_token [None req-dfda21d5-b2eb-445e-b2d7-ba4007fc95e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 10:19:14.047155 n-d-850468-6 devstack@n-api.service[103940]: WARNING keystonemiddleware.auth_token [None req-ca85f45e-4fc5-49ca-9f34-965822e7c582 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 10:19:14.053678 n-d-850468-6 devstack@n-api.service[103940]: WARNING keystonemiddleware.auth_token [None req-ca85f45e-4fc5-49ca-9f34-965822e7c582 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 10:19:14.055769 n-d-850468-6 devstack@n-api.service[103939]: WARNING keystonemiddleware.auth_token [None req-dfda21d5-b2eb-445e-b2d7-ba4007fc95e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 10:19:14.058940 n-d-850468-6 devstack@n-api.service[103940]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5569201249c0 pid: 103940 (default app) Jul 28 10:19:14.061000 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-ca85f45e-4fc5-49ca-9f34-965822e7c582 None None] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:19:14.061701 n-d-850468-6 devstack@n-api.service[103939]: WARNING keystonemiddleware.auth_token [None req-dfda21d5-b2eb-445e-b2d7-ba4007fc95e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 10:19:14.062193 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-ca85f45e-4fc5-49ca-9f34-965822e7c582 None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001712 Jul 28 10:19:14.062602 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Thu Jul 28 10:19:14 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:19:14.067016 n-d-850468-6 devstack@n-api.service[103939]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5569201249c0 pid: 103939 (default app) Jul 28 10:20:29.434538 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-ca85f45e-4fc5-49ca-9f34-965822e7c582 None None] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:20:29.435543 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-ca85f45e-4fc5-49ca-9f34-965822e7c582 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jul 28 10:20:29.435942 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 10:20:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:20:29.447871 n-d-850468-6 devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_api:SELECT=3 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:20:29.448840 n-d-850468-6 devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_cell0:SELECT=3 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:20:29.449848 n-d-850468-6 devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_cell1:SELECT=3 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:20:29.450901 n-d-850468-6 devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:20:30.294623 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-d41f59b2-cd68-4f4b-ae94-ebd8ba14f97d admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:20:30.326009 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-d41f59b2-cd68-4f4b-ae94-ebd8ba14f97d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.883177 Jul 28 10:20:30.326908 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1291 bytes} [Thu Jul 28 10:20:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:20:32.514916 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-ca85f45e-4fc5-49ca-9f34-965822e7c582 None None] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:20:32.516483 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-ca85f45e-4fc5-49ca-9f34-965822e7c582 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001994 Jul 28 10:20:32.521363 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 3/4] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 10:20:32 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:20:33.018919 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-e2b12cc1-81e8-449e-b6f0-c33fff286bee admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "id": "c1", "swap": 0, "disk": 1}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:20:33.039186 n-d-850468-6 devstack@n-api.service[103939]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:20:33.039186 n-d-850468-6 devstack@n-api.service[103939]: warnings.warn(msg) Jul 28 10:20:33.066950 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-e2b12cc1-81e8-449e-b6f0-c33fff286bee admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.543620 Jul 28 10:20:33.067707 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 2/5] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jul 28 10:20:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:20:33.285115 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-f1f2f794-bd86-436e-8023-bac7f1ebde51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:20:33.289733 n-d-850468-6 devstack@n-api.service[103940]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:20:33.289733 n-d-850468-6 devstack@n-api.service[103940]: warnings.warn(msg) Jul 28 10:20:33.292420 n-d-850468-6 devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writing DB stats nova_api:SELECT=3 {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:20:33.293288 n-d-850468-6 devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writing DB stats nova_cell1:SELECT=3 {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:20:33.294156 n-d-850468-6 devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writing DB stats nova_cell0:SELECT=3 {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:20:33.294850 n-d-850468-6 devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:20:33.359671 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-f1f2f794-bd86-436e-8023-bac7f1ebde51 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284043 Jul 28 10:20:33.360264 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 4/6] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Jul 28 10:20:33 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:20:35.594565 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-e2b12cc1-81e8-449e-b6f0-c33fff286bee admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:20:35.596197 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-e2b12cc1-81e8-449e-b6f0-c33fff286bee admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jul 28 10:20:35.597082 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 3/7] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 10:20:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:20:36.354280 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-b7df98a8-c736-4341-934f-4a5f96d974f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "os-flavor-access:is_public": true, "ram": 512, "name": "ds512M", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:20:36.373252 n-d-850468-6 devstack@n-api.service[103940]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:20:36.373252 n-d-850468-6 devstack@n-api.service[103940]: warnings.warn(msg) Jul 28 10:20:36.393778 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-b7df98a8-c736-4341-934f-4a5f96d974f6 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.790127 Jul 28 10:20:36.401578 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 5/8] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jul 28 10:20:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:20:36.407246 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-343fd523-114b-4a38-b79d-127889878172 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:20:36.410997 n-d-850468-6 devstack@n-api.service[103939]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:20:36.410997 n-d-850468-6 devstack@n-api.service[103939]: warnings.warn(msg) Jul 28 10:20:36.458022 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-343fd523-114b-4a38-b79d-127889878172 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054966 Jul 28 10:20:36.458614 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 4/9] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Jul 28 10:20:36 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:20:38.774446 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-b7df98a8-c736-4341-934f-4a5f96d974f6 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:20:38.775636 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-b7df98a8-c736-4341-934f-4a5f96d974f6 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001656 Jul 28 10:20:38.788415 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 10:20:38 2022] GET /compute/v2.1 => generated 388 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:20:39.365197 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-f35707ea-05b7-431a-8360-1cb5730af74a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1, "id": "d2", "ram": 1024, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:20:39.390874 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-f35707ea-05b7-431a-8360-1cb5730af74a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.606783 Jul 28 10:20:39.399026 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 5/11] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jul 28 10:20:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:20:39.408854 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-956ba60d-7212-4e1f-bc12-94cae019eaff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:20:39.439028 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-956ba60d-7212-4e1f-bc12-94cae019eaff admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035240 Jul 28 10:20:39.447065 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 7/12] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Jul 28 10:20:39 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:20:41.916422 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-f35707ea-05b7-431a-8360-1cb5730af74a admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:20:41.918026 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-f35707ea-05b7-431a-8360-1cb5730af74a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002007 Jul 28 10:20:41.918423 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 6/13] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 10:20:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:20:42.314120 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-66d41ca0-7055-4774-b14f-27a0feccbd80 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "swap": 0, "vcpus": 2, "id": "d3", "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:20:42.334097 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-66d41ca0-7055-4774-b14f-27a0feccbd80 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.409142 Jul 28 10:20:42.334555 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 8/14] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jul 28 10:20:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:20:42.346776 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-6e91d88a-3da4-4ad3-b2b5-4a7b6476bceb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:20:42.374470 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-6e91d88a-3da4-4ad3-b2b5-4a7b6476bceb admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031724 Jul 28 10:20:42.375048 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 7/15] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Jul 28 10:20:42 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:20:44.754200 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-66d41ca0-7055-4774-b14f-27a0feccbd80 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:20:44.755206 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-66d41ca0-7055-4774-b14f-27a0feccbd80 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Jul 28 10:20:44.755604 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 9/16] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 10:20:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:20:45.257395 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-69677495-f9ef-4b27-92ad-fe6e0aba3749 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:20:45.287955 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-69677495-f9ef-4b27-92ad-fe6e0aba3749 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.526096 Jul 28 10:20:45.289031 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 8/17] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jul 28 10:20:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:20:45.302182 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-992fcaf4-78c2-4ad5-952e-a29ef503070e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:20:45.347096 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-992fcaf4-78c2-4ad5-952e-a29ef503070e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049004 Jul 28 10:20:45.348155 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 10/18] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Jul 28 10:20:45 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:20:47.679073 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-69677495-f9ef-4b27-92ad-fe6e0aba3749 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:20:47.680790 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-69677495-f9ef-4b27-92ad-fe6e0aba3749 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005980 Jul 28 10:20:47.681964 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 9/19] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 10:20:47 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:20:48.237574 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-3582f6d9-dc3d-4a58-ae2a-2812f236be0c admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:20:48.263824 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-3582f6d9-dc3d-4a58-ae2a-2812f236be0c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.575346 Jul 28 10:20:48.264990 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1291 bytes} [Thu Jul 28 10:20:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:20:50.542391 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-69677495-f9ef-4b27-92ad-fe6e0aba3749 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:20:50.543622 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-69677495-f9ef-4b27-92ad-fe6e0aba3749 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001935 Jul 28 10:20:50.544157 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 10/21] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 10:20:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:20:50.984190 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-8ac5503c-aaa1-4f65-9a65-785a00527414 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:20:51.005013 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-8ac5503c-aaa1-4f65-9a65-785a00527414 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.452578 Jul 28 10:20:51.005606 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 12/22] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jul 28 10:20:50 2022] POST /compute/v2.1/flavors => generated 402 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:20:51.018097 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-e6e410e4-b3a4-46d3-9a72-debbd2d613f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:20:51.044143 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-e6e410e4-b3a4-46d3-9a72-debbd2d613f7 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030175 Jul 28 10:20:51.044730 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 11/23] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Jul 28 10:20:51 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:20:53.726757 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-8ac5503c-aaa1-4f65-9a65-785a00527414 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:20:53.727774 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-8ac5503c-aaa1-4f65-9a65-785a00527414 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Jul 28 10:20:53.728343 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 10:20:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:20:54.178314 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-7731dd4a-7bf6-4bff-a29c-ebfac245a5eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "os-flavor-access:is_public": true, "disk": 20, "ram": 2048, "swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:20:54.201582 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-7731dd4a-7bf6-4bff-a29c-ebfac245a5eb admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.467551 Jul 28 10:20:54.202630 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 12/25] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jul 28 10:20:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:20:54.216539 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-534a22b7-5a90-4057-8ed8-68b0a25d543d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:20:54.247638 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-534a22b7-5a90-4057-8ed8-68b0a25d543d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034555 Jul 28 10:20:54.248829 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 14/26] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Jul 28 10:20:54 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:20:56.478325 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-7731dd4a-7bf6-4bff-a29c-ebfac245a5eb admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:20:56.479331 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-7731dd4a-7bf6-4bff-a29c-ebfac245a5eb admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 28 10:20:56.479726 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 10:20:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:20:56.897349 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-d4acd65e-2596-4a0e-a7ab-f783ac5f65d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "disk": 40, "swap": 0, "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3"}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:20:56.915560 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-d4acd65e-2596-4a0e-a7ab-f783ac5f65d8 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.430028 Jul 28 10:20:56.916109 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 15/28] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jul 28 10:20:56 2022] POST /compute/v2.1/flavors => generated 406 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:20:56.928429 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-97a535b1-74fa-43e2-983d-4847e8d6bf73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:20:56.952824 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-97a535b1-74fa-43e2-983d-4847e8d6bf73 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027999 Jul 28 10:20:56.953432 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 14/29] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Jul 28 10:20:56 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:20:59.144528 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-d4acd65e-2596-4a0e-a7ab-f783ac5f65d8 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:20:59.146053 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-d4acd65e-2596-4a0e-a7ab-f783ac5f65d8 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001907 Jul 28 10:20:59.146683 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 16/30] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 10:20:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:20:59.517441 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-c7814109-91e5-4060-8db1-64f5541d9c61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "name": "m1.large", "vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "id": "4", "rxtx_factor": 1.0}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:20:59.523672 n-d-850468-6 devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:20:59.538970 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-c7814109-91e5-4060-8db1-64f5541d9c61 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.386487 Jul 28 10:20:59.539601 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 15/31] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jul 28 10:20:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:20:59.552576 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-437aa7e5-4f01-4fd1-83a2-528cb147e780 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:20:59.576923 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-437aa7e5-4f01-4fd1-83a2-528cb147e780 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028215 Jul 28 10:20:59.577677 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 17/32] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Jul 28 10:20:59 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:21:01.875787 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-c7814109-91e5-4060-8db1-64f5541d9c61 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:01.876813 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-c7814109-91e5-4060-8db1-64f5541d9c61 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002122 Jul 28 10:21:01.877218 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 16/33] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 10:21:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:21:02.320587 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-57f9cba7-3cdf-4642-bd89-033d9fea1253 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "id": "5", "swap": 0, "rxtx_factor": 1.0, "vcpus": 8, "name": "m1.xlarge", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:21:02.341103 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-57f9cba7-3cdf-4642-bd89-033d9fea1253 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.457913 Jul 28 10:21:02.341968 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 18/34] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jul 28 10:21:01 2022] POST /compute/v2.1/flavors => generated 408 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:21:02.354246 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-592d3271-7f54-4930-8e66-32722dc712bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:21:02.380151 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-592d3271-7f54-4930-8e66-32722dc712bd admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029477 Jul 28 10:21:02.383199 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 17/35] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Jul 28 10:21:02 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:21:25.720731 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-57f9cba7-3cdf-4642-bd89-033d9fea1253 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:25.721732 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-57f9cba7-3cdf-4642-bd89-033d9fea1253 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002111 Jul 28 10:21:25.722188 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 19/36] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 10:21:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:21:25.732565 n-d-850468-6 devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:21:26.111375 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-164f70c8-e986-406a-bd50-a43c08505379 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:26.130987 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-164f70c8-e986-406a-bd50-a43c08505379 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402848 Jul 28 10:21:26.131528 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 18/37] 10.222.0.46 () {60 vars in 1291 bytes} [Thu Jul 28 10:21:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:21:27.181034 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-57f9cba7-3cdf-4642-bd89-033d9fea1253 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:27.182072 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-57f9cba7-3cdf-4642-bd89-033d9fea1253 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 28 10:21:27.182474 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 20/38] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jul 28 10:21:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:21:27.723442 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-8f582171-da16-4c67-ae49-3497d38c5224 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:27.729090 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.wsgi [None req-8f582171-da16-4c67-ae49-3497d38c5224 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 10:21:27.732340 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-8f582171-da16-4c67-ae49-3497d38c5224 admin admin] Request method failure captured: Jul 28 10:21:27.732340 n-d-850468-6 devstack@n-api.service[103939]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 10:21:27.732340 n-d-850468-6 devstack@n-api.service[103939]: Accept: application/json Jul 28 10:21:27.732340 n-d-850468-6 devstack@n-api.service[103939]: Accept-Encoding: gzip, deflate Jul 28 10:21:27.732340 n-d-850468-6 devstack@n-api.service[103939]: Connection: keep-alive Jul 28 10:21:27.732340 n-d-850468-6 devstack@n-api.service[103939]: Content-Length: 0 Jul 28 10:21:27.732340 n-d-850468-6 devstack@n-api.service[103939]: Host: 10.222.0.46 Jul 28 10:21:27.732340 n-d-850468-6 devstack@n-api.service[103939]: Openstack-Api-Version: compute 2.90 Jul 28 10:21:27.732340 n-d-850468-6 devstack@n-api.service[103939]: Openstack-System-Scope: None Jul 28 10:21:27.732340 n-d-850468-6 devstack@n-api.service[103939]: User-Agent: python-novaclient Jul 28 10:21:27.732340 n-d-850468-6 devstack@n-api.service[103939]: X-Auth-Token: gAAAAABi4mMn5lrVJ9Dob7Qk9nRsN7Ba8WDfeKFPnzeptBiL8flRrA8oJkPs7xeJY9YloTkXwmLVZprChpOChBfmxMTGs8o_uVpAhB_gYJoYQDSrI5ySgdu_DY8Ta-lmnkSKUypXIFEnGsA_6Q7_tPW80sVCgZnTy18vkQhCacA421TnbY8aEpI Jul 28 10:21:27.732340 n-d-850468-6 devstack@n-api.service[103939]: X-Domain-Id: None Jul 28 10:21:27.732340 n-d-850468-6 devstack@n-api.service[103939]: X-Domain-Name: None Jul 28 10:21:27.732340 n-d-850468-6 devstack@n-api.service[103939]: X-Identity-Status: Confirmed Jul 28 10:21:27.732340 n-d-850468-6 devstack@n-api.service[103939]: X-Is-Admin-Project: True Jul 28 10:21:27.732340 n-d-850468-6 devstack@n-api.service[103939]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 10:21:27.732340 n-d-850468-6 devstack@n-api.service[103939]: X-Project-Domain-Id: default Jul 28 10:21:27.732340 n-d-850468-6 devstack@n-api.service[103939]: X-Project-Domain-Name: Default Jul 28 10:21:27.732340 n-d-850468-6 devstack@n-api.service[103939]: X-Project-Id: 10082210418849b1827f8de2bb4559d2 Jul 28 10:21:27.732340 n-d-850468-6 devstack@n-api.service[103939]: X-Project-Name: admin Jul 28 10:21:27.732340 n-d-850468-6 devstack@n-api.service[103939]: X-Role: reader,member,admin Jul 28 10:21:27.732340 n-d-850468-6 devstack@n-api.service[103939]: X-Roles: reader,member,admin Jul 28 10:21:27.734173 n-d-850468-6 devstack@n-api.service[103939]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/10082210418849b1827f8de2bb4559d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/10082210418849b1827f8de2bb4559d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/10082210418849b1827f8de2bb4559d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_10082210418849b1827f8de2bb4559d2", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:21:27.734173 n-d-850468-6 devstack@n-api.service[103939]: X-Tenant: admin Jul 28 10:21:27.734173 n-d-850468-6 devstack@n-api.service[103939]: X-Tenant-Id: 10082210418849b1827f8de2bb4559d2 Jul 28 10:21:27.734173 n-d-850468-6 devstack@n-api.service[103939]: X-Tenant-Name: admin Jul 28 10:21:27.734173 n-d-850468-6 devstack@n-api.service[103939]: X-User: admin Jul 28 10:21:27.734173 n-d-850468-6 devstack@n-api.service[103939]: X-User-Domain-Id: default Jul 28 10:21:27.734173 n-d-850468-6 devstack@n-api.service[103939]: X-User-Domain-Name: Default Jul 28 10:21:27.734173 n-d-850468-6 devstack@n-api.service[103939]: X-User-Id: 94b06c9fa4854229ba35827e7d62ebfc Jul 28 10:21:27.734173 n-d-850468-6 devstack@n-api.service[103939]: X-User-Name: admin Jul 28 10:21:27.734173 n-d-850468-6 devstack@n-api.service[103939]: method: > Jul 28 10:21:27.734173 n-d-850468-6 devstack@n-api.service[103939]: exception: Flavor 42 could not be found. Jul 28 10:21:27.734173 n-d-850468-6 devstack@n-api.service[103939]: action_args: {'id': '42'} Jul 28 10:21:27.734173 n-d-850468-6 devstack@n-api.service[103939]: {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:21:27.734173 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:21:27.735210 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 10:21:27.735210 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 10:21:27.735210 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 10:21:27.735210 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 10:21:27.735210 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:21:27.735210 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:21:27.735210 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 10:21:27.735210 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 10:21:27.735210 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 10:21:27.735210 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:21:27.735210 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 10:21:27.735210 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 10:21:27.735210 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 10:21:27.735210 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 28 10:21:27.735210 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:21:27.735210 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 28 10:21:27.735210 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:21:27.735210 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:21:27.735210 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:21:27.737481 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:21:27.737481 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:21:27.737481 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:21:27.737481 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:21:27.737481 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 10:21:27.737481 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:21:27.737481 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 10:21:27.737481 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 28 10:21:27.737481 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:21:27.737481 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 28 10:21:27.737481 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:21:27.737481 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:21:27.737481 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:21:27.737481 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:21:27.737481 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:21:27.737481 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 10:21:27.737481 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 28 10:21:27.737481 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-8f582171-da16-4c67-ae49-3497d38c5224 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:21:27.738901 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-8f582171-da16-4c67-ae49-3497d38c5224 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.392292 Jul 28 10:21:27.738901 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 19/39] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Jul 28 10:21:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 10:21:27.744058 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-652b1b38-13c2-46b7-b5a7-c6fd17ece2ec admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:27.748079 n-d-850468-6 devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:21:27.767548 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-652b1b38-13c2-46b7-b5a7-c6fd17ece2ec admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026815 Jul 28 10:21:27.768091 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jul 28 10:21:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:21:27.780177 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-7985d13e-cfb5-45b7-be38-f26f7bca1546 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:27.804279 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-7985d13e-cfb5-45b7-be38-f26f7bca1546 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027612 Jul 28 10:21:27.804856 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 20/41] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jul 28 10:21:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:21:27.814885 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-53cb8b74-8171-4f4f-a1b7-7c1efe5e999f admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:27.821658 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.wsgi [None req-53cb8b74-8171-4f4f-a1b7-7c1efe5e999f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 10:21:27.824903 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-53cb8b74-8171-4f4f-a1b7-7c1efe5e999f admin admin] Request method failure captured: Jul 28 10:21:27.824903 n-d-850468-6 devstack@n-api.service[103940]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 10:21:27.824903 n-d-850468-6 devstack@n-api.service[103940]: Accept: application/json Jul 28 10:21:27.824903 n-d-850468-6 devstack@n-api.service[103940]: Accept-Encoding: gzip, deflate Jul 28 10:21:27.824903 n-d-850468-6 devstack@n-api.service[103940]: Connection: keep-alive Jul 28 10:21:27.824903 n-d-850468-6 devstack@n-api.service[103940]: Content-Length: 0 Jul 28 10:21:27.824903 n-d-850468-6 devstack@n-api.service[103940]: Host: 10.222.0.46 Jul 28 10:21:27.824903 n-d-850468-6 devstack@n-api.service[103940]: Openstack-Api-Version: compute 2.90 Jul 28 10:21:27.824903 n-d-850468-6 devstack@n-api.service[103940]: Openstack-System-Scope: None Jul 28 10:21:27.824903 n-d-850468-6 devstack@n-api.service[103940]: User-Agent: python-novaclient Jul 28 10:21:27.824903 n-d-850468-6 devstack@n-api.service[103940]: X-Auth-Token: gAAAAABi4mMn5lrVJ9Dob7Qk9nRsN7Ba8WDfeKFPnzeptBiL8flRrA8oJkPs7xeJY9YloTkXwmLVZprChpOChBfmxMTGs8o_uVpAhB_gYJoYQDSrI5ySgdu_DY8Ta-lmnkSKUypXIFEnGsA_6Q7_tPW80sVCgZnTy18vkQhCacA421TnbY8aEpI Jul 28 10:21:27.824903 n-d-850468-6 devstack@n-api.service[103940]: X-Domain-Id: None Jul 28 10:21:27.824903 n-d-850468-6 devstack@n-api.service[103940]: X-Domain-Name: None Jul 28 10:21:27.824903 n-d-850468-6 devstack@n-api.service[103940]: X-Identity-Status: Confirmed Jul 28 10:21:27.824903 n-d-850468-6 devstack@n-api.service[103940]: X-Is-Admin-Project: True Jul 28 10:21:27.824903 n-d-850468-6 devstack@n-api.service[103940]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 10:21:27.824903 n-d-850468-6 devstack@n-api.service[103940]: X-Project-Domain-Id: default Jul 28 10:21:27.824903 n-d-850468-6 devstack@n-api.service[103940]: X-Project-Domain-Name: Default Jul 28 10:21:27.824903 n-d-850468-6 devstack@n-api.service[103940]: X-Project-Id: 10082210418849b1827f8de2bb4559d2 Jul 28 10:21:27.824903 n-d-850468-6 devstack@n-api.service[103940]: X-Project-Name: admin Jul 28 10:21:27.824903 n-d-850468-6 devstack@n-api.service[103940]: X-Role: reader,member,admin Jul 28 10:21:27.824903 n-d-850468-6 devstack@n-api.service[103940]: X-Roles: reader,member,admin Jul 28 10:21:27.826295 n-d-850468-6 devstack@n-api.service[103940]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/10082210418849b1827f8de2bb4559d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/10082210418849b1827f8de2bb4559d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/10082210418849b1827f8de2bb4559d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_10082210418849b1827f8de2bb4559d2", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:21:27.826295 n-d-850468-6 devstack@n-api.service[103940]: X-Tenant: admin Jul 28 10:21:27.826295 n-d-850468-6 devstack@n-api.service[103940]: X-Tenant-Id: 10082210418849b1827f8de2bb4559d2 Jul 28 10:21:27.826295 n-d-850468-6 devstack@n-api.service[103940]: X-Tenant-Name: admin Jul 28 10:21:27.826295 n-d-850468-6 devstack@n-api.service[103940]: X-User: admin Jul 28 10:21:27.826295 n-d-850468-6 devstack@n-api.service[103940]: X-User-Domain-Id: default Jul 28 10:21:27.826295 n-d-850468-6 devstack@n-api.service[103940]: X-User-Domain-Name: Default Jul 28 10:21:27.826295 n-d-850468-6 devstack@n-api.service[103940]: X-User-Id: 94b06c9fa4854229ba35827e7d62ebfc Jul 28 10:21:27.826295 n-d-850468-6 devstack@n-api.service[103940]: X-User-Name: admin Jul 28 10:21:27.826295 n-d-850468-6 devstack@n-api.service[103940]: method: > Jul 28 10:21:27.826295 n-d-850468-6 devstack@n-api.service[103940]: exception: Flavor 42 could not be found. Jul 28 10:21:27.826295 n-d-850468-6 devstack@n-api.service[103940]: action_args: {'id': '42'} Jul 28 10:21:27.826295 n-d-850468-6 devstack@n-api.service[103940]: {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:21:27.826295 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:21:27.827100 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 10:21:27.827100 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 10:21:27.827100 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 10:21:27.827100 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 10:21:27.827100 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:21:27.827100 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:21:27.827100 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 10:21:27.827100 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 10:21:27.827100 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 10:21:27.827100 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:21:27.827100 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 10:21:27.827100 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 10:21:27.827100 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 10:21:27.827100 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 28 10:21:27.827100 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:21:27.827100 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 28 10:21:27.827100 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:21:27.827100 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:21:27.827100 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:21:27.828375 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:21:27.828375 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:21:27.828375 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:21:27.828375 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:21:27.828375 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 10:21:27.828375 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:21:27.828375 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 10:21:27.828375 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 28 10:21:27.828375 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:21:27.828375 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 28 10:21:27.828375 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:21:27.828375 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:21:27.828375 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:21:27.828375 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:21:27.828375 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:21:27.828375 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 10:21:27.828375 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 28 10:21:27.828375 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-53cb8b74-8171-4f4f-a1b7-7c1efe5e999f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:21:27.829631 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-53cb8b74-8171-4f4f-a1b7-7c1efe5e999f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015579 Jul 28 10:21:27.829631 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 22/42] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Jul 28 10:21:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 10:21:28.784705 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-7985d13e-cfb5-45b7-be38-f26f7bca1546 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:28.785793 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-7985d13e-cfb5-45b7-be38-f26f7bca1546 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jul 28 10:21:28.786299 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 21/43] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jul 28 10:21:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:21:29.432340 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-ee7477b7-c401-4d7a-a62c-dc0f825f9eeb admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:29.437571 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.wsgi [None req-ee7477b7-c401-4d7a-a62c-dc0f825f9eeb admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 10:21:29.439837 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-ee7477b7-c401-4d7a-a62c-dc0f825f9eeb admin admin] Request method failure captured: Jul 28 10:21:29.439837 n-d-850468-6 devstack@n-api.service[103940]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 10:21:29.439837 n-d-850468-6 devstack@n-api.service[103940]: Accept: application/json Jul 28 10:21:29.439837 n-d-850468-6 devstack@n-api.service[103940]: Accept-Encoding: gzip, deflate Jul 28 10:21:29.439837 n-d-850468-6 devstack@n-api.service[103940]: Connection: keep-alive Jul 28 10:21:29.439837 n-d-850468-6 devstack@n-api.service[103940]: Content-Length: 0 Jul 28 10:21:29.439837 n-d-850468-6 devstack@n-api.service[103940]: Host: 10.222.0.46 Jul 28 10:21:29.439837 n-d-850468-6 devstack@n-api.service[103940]: Openstack-Api-Version: compute 2.90 Jul 28 10:21:29.439837 n-d-850468-6 devstack@n-api.service[103940]: Openstack-System-Scope: None Jul 28 10:21:29.439837 n-d-850468-6 devstack@n-api.service[103940]: User-Agent: python-novaclient Jul 28 10:21:29.439837 n-d-850468-6 devstack@n-api.service[103940]: X-Auth-Token: gAAAAABi4mMoStAY4AlMy3-c3UJwAqNhpVBuQBqSNBtBkN_2EcSVRq1z9WDYQR6KPQ-IZyjlVWj9j7mO-t5VuwSBiPrRviHV81TcsaD6rdYD7R7_44X3nJ8BO73Rft6aPxx18WPclzZtCsmTA7G2BRTnlMHBxB1Q4k-pFVP8YNNd-zqKDsQtdRM Jul 28 10:21:29.439837 n-d-850468-6 devstack@n-api.service[103940]: X-Domain-Id: None Jul 28 10:21:29.439837 n-d-850468-6 devstack@n-api.service[103940]: X-Domain-Name: None Jul 28 10:21:29.439837 n-d-850468-6 devstack@n-api.service[103940]: X-Identity-Status: Confirmed Jul 28 10:21:29.439837 n-d-850468-6 devstack@n-api.service[103940]: X-Is-Admin-Project: True Jul 28 10:21:29.439837 n-d-850468-6 devstack@n-api.service[103940]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 10:21:29.439837 n-d-850468-6 devstack@n-api.service[103940]: X-Project-Domain-Id: default Jul 28 10:21:29.439837 n-d-850468-6 devstack@n-api.service[103940]: X-Project-Domain-Name: Default Jul 28 10:21:29.439837 n-d-850468-6 devstack@n-api.service[103940]: X-Project-Id: 10082210418849b1827f8de2bb4559d2 Jul 28 10:21:29.439837 n-d-850468-6 devstack@n-api.service[103940]: X-Project-Name: admin Jul 28 10:21:29.439837 n-d-850468-6 devstack@n-api.service[103940]: X-Role: reader,member,admin Jul 28 10:21:29.439837 n-d-850468-6 devstack@n-api.service[103940]: X-Roles: reader,member,admin Jul 28 10:21:29.441420 n-d-850468-6 devstack@n-api.service[103940]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/10082210418849b1827f8de2bb4559d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/10082210418849b1827f8de2bb4559d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/10082210418849b1827f8de2bb4559d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_10082210418849b1827f8de2bb4559d2", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:21:29.441420 n-d-850468-6 devstack@n-api.service[103940]: X-Tenant: admin Jul 28 10:21:29.441420 n-d-850468-6 devstack@n-api.service[103940]: X-Tenant-Id: 10082210418849b1827f8de2bb4559d2 Jul 28 10:21:29.441420 n-d-850468-6 devstack@n-api.service[103940]: X-Tenant-Name: admin Jul 28 10:21:29.441420 n-d-850468-6 devstack@n-api.service[103940]: X-User: admin Jul 28 10:21:29.441420 n-d-850468-6 devstack@n-api.service[103940]: X-User-Domain-Id: default Jul 28 10:21:29.441420 n-d-850468-6 devstack@n-api.service[103940]: X-User-Domain-Name: Default Jul 28 10:21:29.441420 n-d-850468-6 devstack@n-api.service[103940]: X-User-Id: 94b06c9fa4854229ba35827e7d62ebfc Jul 28 10:21:29.441420 n-d-850468-6 devstack@n-api.service[103940]: X-User-Name: admin Jul 28 10:21:29.441420 n-d-850468-6 devstack@n-api.service[103940]: method: > Jul 28 10:21:29.441420 n-d-850468-6 devstack@n-api.service[103940]: exception: Flavor 84 could not be found. Jul 28 10:21:29.441420 n-d-850468-6 devstack@n-api.service[103940]: action_args: {'id': '84'} Jul 28 10:21:29.441420 n-d-850468-6 devstack@n-api.service[103940]: {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:21:29.441420 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:21:29.442482 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 10:21:29.442482 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 10:21:29.442482 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 10:21:29.442482 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 10:21:29.442482 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:21:29.442482 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:21:29.442482 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 10:21:29.442482 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 10:21:29.442482 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 10:21:29.442482 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:21:29.442482 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 10:21:29.442482 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 10:21:29.442482 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 10:21:29.442482 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 28 10:21:29.442482 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:21:29.442482 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 28 10:21:29.442482 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:21:29.442482 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:21:29.442482 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:21:29.443901 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:21:29.443901 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:21:29.443901 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:21:29.443901 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:21:29.443901 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 10:21:29.443901 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:21:29.443901 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 10:21:29.443901 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 28 10:21:29.443901 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:21:29.443901 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 28 10:21:29.443901 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:21:29.443901 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:21:29.443901 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:21:29.443901 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:21:29.443901 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:21:29.443901 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 10:21:29.443901 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 28 10:21:29.443901 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-ee7477b7-c401-4d7a-a62c-dc0f825f9eeb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:21:29.445144 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-ee7477b7-c401-4d7a-a62c-dc0f825f9eeb admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.516744 Jul 28 10:21:29.445144 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Jul 28 10:21:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 518 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 28 10:21:29.450758 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-c91a7c21-59bd-4a37-bd35-52443f479392 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:29.466322 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-c91a7c21-59bd-4a37-bd35-52443f479392 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019024 Jul 28 10:21:29.466839 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jul 28 10:21:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:21:29.476054 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-7c214f5b-40d5-4a48-a4a1-d62c1e5f137f admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:29.490758 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-7c214f5b-40d5-4a48-a4a1-d62c1e5f137f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018212 Jul 28 10:21:29.491269 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jul 28 10:21:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:21:29.500272 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-ac21d73d-2006-4f25-9201-7889bee80c63 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:29.506276 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.wsgi [None req-ac21d73d-2006-4f25-9201-7889bee80c63 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 10:21:29.507770 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-ac21d73d-2006-4f25-9201-7889bee80c63 admin admin] Request method failure captured: Jul 28 10:21:29.507770 n-d-850468-6 devstack@n-api.service[103939]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 10:21:29.507770 n-d-850468-6 devstack@n-api.service[103939]: Accept: application/json Jul 28 10:21:29.507770 n-d-850468-6 devstack@n-api.service[103939]: Accept-Encoding: gzip, deflate Jul 28 10:21:29.507770 n-d-850468-6 devstack@n-api.service[103939]: Connection: keep-alive Jul 28 10:21:29.507770 n-d-850468-6 devstack@n-api.service[103939]: Content-Length: 0 Jul 28 10:21:29.507770 n-d-850468-6 devstack@n-api.service[103939]: Host: 10.222.0.46 Jul 28 10:21:29.507770 n-d-850468-6 devstack@n-api.service[103939]: Openstack-Api-Version: compute 2.90 Jul 28 10:21:29.507770 n-d-850468-6 devstack@n-api.service[103939]: Openstack-System-Scope: None Jul 28 10:21:29.507770 n-d-850468-6 devstack@n-api.service[103939]: User-Agent: python-novaclient Jul 28 10:21:29.507770 n-d-850468-6 devstack@n-api.service[103939]: X-Auth-Token: gAAAAABi4mMoStAY4AlMy3-c3UJwAqNhpVBuQBqSNBtBkN_2EcSVRq1z9WDYQR6KPQ-IZyjlVWj9j7mO-t5VuwSBiPrRviHV81TcsaD6rdYD7R7_44X3nJ8BO73Rft6aPxx18WPclzZtCsmTA7G2BRTnlMHBxB1Q4k-pFVP8YNNd-zqKDsQtdRM Jul 28 10:21:29.507770 n-d-850468-6 devstack@n-api.service[103939]: X-Domain-Id: None Jul 28 10:21:29.507770 n-d-850468-6 devstack@n-api.service[103939]: X-Domain-Name: None Jul 28 10:21:29.507770 n-d-850468-6 devstack@n-api.service[103939]: X-Identity-Status: Confirmed Jul 28 10:21:29.507770 n-d-850468-6 devstack@n-api.service[103939]: X-Is-Admin-Project: True Jul 28 10:21:29.507770 n-d-850468-6 devstack@n-api.service[103939]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 10:21:29.507770 n-d-850468-6 devstack@n-api.service[103939]: X-Project-Domain-Id: default Jul 28 10:21:29.507770 n-d-850468-6 devstack@n-api.service[103939]: X-Project-Domain-Name: Default Jul 28 10:21:29.507770 n-d-850468-6 devstack@n-api.service[103939]: X-Project-Id: 10082210418849b1827f8de2bb4559d2 Jul 28 10:21:29.507770 n-d-850468-6 devstack@n-api.service[103939]: X-Project-Name: admin Jul 28 10:21:29.507770 n-d-850468-6 devstack@n-api.service[103939]: X-Role: reader,member,admin Jul 28 10:21:29.507770 n-d-850468-6 devstack@n-api.service[103939]: X-Roles: reader,member,admin Jul 28 10:21:29.509313 n-d-850468-6 devstack@n-api.service[103939]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/10082210418849b1827f8de2bb4559d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/10082210418849b1827f8de2bb4559d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/10082210418849b1827f8de2bb4559d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_10082210418849b1827f8de2bb4559d2", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:21:29.509313 n-d-850468-6 devstack@n-api.service[103939]: X-Tenant: admin Jul 28 10:21:29.509313 n-d-850468-6 devstack@n-api.service[103939]: X-Tenant-Id: 10082210418849b1827f8de2bb4559d2 Jul 28 10:21:29.509313 n-d-850468-6 devstack@n-api.service[103939]: X-Tenant-Name: admin Jul 28 10:21:29.509313 n-d-850468-6 devstack@n-api.service[103939]: X-User: admin Jul 28 10:21:29.509313 n-d-850468-6 devstack@n-api.service[103939]: X-User-Domain-Id: default Jul 28 10:21:29.509313 n-d-850468-6 devstack@n-api.service[103939]: X-User-Domain-Name: Default Jul 28 10:21:29.509313 n-d-850468-6 devstack@n-api.service[103939]: X-User-Id: 94b06c9fa4854229ba35827e7d62ebfc Jul 28 10:21:29.509313 n-d-850468-6 devstack@n-api.service[103939]: X-User-Name: admin Jul 28 10:21:29.509313 n-d-850468-6 devstack@n-api.service[103939]: method: > Jul 28 10:21:29.509313 n-d-850468-6 devstack@n-api.service[103939]: exception: Flavor 84 could not be found. Jul 28 10:21:29.509313 n-d-850468-6 devstack@n-api.service[103939]: action_args: {'id': '84'} Jul 28 10:21:29.509313 n-d-850468-6 devstack@n-api.service[103939]: {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:21:29.509313 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:21:29.510291 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 10:21:29.510291 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 10:21:29.510291 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 10:21:29.510291 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 10:21:29.510291 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:21:29.510291 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:21:29.510291 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 10:21:29.510291 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 10:21:29.510291 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 10:21:29.510291 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:21:29.510291 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 10:21:29.510291 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 10:21:29.510291 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 10:21:29.510291 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 28 10:21:29.510291 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:21:29.510291 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 28 10:21:29.510291 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:21:29.510291 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:21:29.510291 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:21:29.511614 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:21:29.511614 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:21:29.511614 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:21:29.511614 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:21:29.511614 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 10:21:29.511614 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:21:29.511614 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 10:21:29.511614 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 28 10:21:29.511614 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:21:29.511614 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 28 10:21:29.511614 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:21:29.511614 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:21:29.511614 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:21:29.511614 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:21:29.511614 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:21:29.511614 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 10:21:29.511614 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 28 10:21:29.511614 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-ac21d73d-2006-4f25-9201-7889bee80c63 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:21:29.512826 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-ac21d73d-2006-4f25-9201-7889bee80c63 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012354 Jul 28 10:21:29.512826 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 23/47] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Jul 28 10:21:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 10:21:30.463455 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-7c214f5b-40d5-4a48-a4a1-d62c1e5f137f admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:30.464486 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-7c214f5b-40d5-4a48-a4a1-d62c1e5f137f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jul 28 10:21:30.464882 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 25/48] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jul 28 10:21:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:21:30.982005 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-f486cd21-5c9d-4651-8fd8-8b84bd852cbf admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:30.988257 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.wsgi [None req-f486cd21-5c9d-4651-8fd8-8b84bd852cbf admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 10:21:30.989730 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-f486cd21-5c9d-4651-8fd8-8b84bd852cbf admin admin] Request method failure captured: Jul 28 10:21:30.989730 n-d-850468-6 devstack@n-api.service[103939]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 10:21:30.989730 n-d-850468-6 devstack@n-api.service[103939]: Accept: application/json Jul 28 10:21:30.989730 n-d-850468-6 devstack@n-api.service[103939]: Accept-Encoding: gzip, deflate Jul 28 10:21:30.989730 n-d-850468-6 devstack@n-api.service[103939]: Connection: keep-alive Jul 28 10:21:30.989730 n-d-850468-6 devstack@n-api.service[103939]: Content-Length: 0 Jul 28 10:21:30.989730 n-d-850468-6 devstack@n-api.service[103939]: Host: 10.222.0.46 Jul 28 10:21:30.989730 n-d-850468-6 devstack@n-api.service[103939]: Openstack-Api-Version: compute 2.90 Jul 28 10:21:30.989730 n-d-850468-6 devstack@n-api.service[103939]: Openstack-System-Scope: None Jul 28 10:21:30.989730 n-d-850468-6 devstack@n-api.service[103939]: User-Agent: python-novaclient Jul 28 10:21:30.989730 n-d-850468-6 devstack@n-api.service[103939]: X-Auth-Token: gAAAAABi4mMq5sRD85Y_Dy4wXjoYTi6gkG90KIzKG8XqagVq_w3MUCFmHWth7XM6ghuWMN96W2-46CYKonZGsMX1G_ZZ890b6uefOCZvVu5PUzmpjoozP310MJDsBE4Jv9ozNmn7snXNdtTiPWWX2Bs-l9MngPaJuYgkk_MwZopsGacToHb_ylE Jul 28 10:21:30.989730 n-d-850468-6 devstack@n-api.service[103939]: X-Domain-Id: None Jul 28 10:21:30.989730 n-d-850468-6 devstack@n-api.service[103939]: X-Domain-Name: None Jul 28 10:21:30.989730 n-d-850468-6 devstack@n-api.service[103939]: X-Identity-Status: Confirmed Jul 28 10:21:30.989730 n-d-850468-6 devstack@n-api.service[103939]: X-Is-Admin-Project: True Jul 28 10:21:30.989730 n-d-850468-6 devstack@n-api.service[103939]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 10:21:30.989730 n-d-850468-6 devstack@n-api.service[103939]: X-Project-Domain-Id: default Jul 28 10:21:30.989730 n-d-850468-6 devstack@n-api.service[103939]: X-Project-Domain-Name: Default Jul 28 10:21:30.989730 n-d-850468-6 devstack@n-api.service[103939]: X-Project-Id: 10082210418849b1827f8de2bb4559d2 Jul 28 10:21:30.989730 n-d-850468-6 devstack@n-api.service[103939]: X-Project-Name: admin Jul 28 10:21:30.989730 n-d-850468-6 devstack@n-api.service[103939]: X-Role: reader,member,admin Jul 28 10:21:30.989730 n-d-850468-6 devstack@n-api.service[103939]: X-Roles: reader,member,admin Jul 28 10:21:30.991375 n-d-850468-6 devstack@n-api.service[103939]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/10082210418849b1827f8de2bb4559d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/10082210418849b1827f8de2bb4559d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/10082210418849b1827f8de2bb4559d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_10082210418849b1827f8de2bb4559d2", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:21:30.991375 n-d-850468-6 devstack@n-api.service[103939]: X-Tenant: admin Jul 28 10:21:30.991375 n-d-850468-6 devstack@n-api.service[103939]: X-Tenant-Id: 10082210418849b1827f8de2bb4559d2 Jul 28 10:21:30.991375 n-d-850468-6 devstack@n-api.service[103939]: X-Tenant-Name: admin Jul 28 10:21:30.991375 n-d-850468-6 devstack@n-api.service[103939]: X-User: admin Jul 28 10:21:30.991375 n-d-850468-6 devstack@n-api.service[103939]: X-User-Domain-Id: default Jul 28 10:21:30.991375 n-d-850468-6 devstack@n-api.service[103939]: X-User-Domain-Name: Default Jul 28 10:21:30.991375 n-d-850468-6 devstack@n-api.service[103939]: X-User-Id: 94b06c9fa4854229ba35827e7d62ebfc Jul 28 10:21:30.991375 n-d-850468-6 devstack@n-api.service[103939]: X-User-Name: admin Jul 28 10:21:30.991375 n-d-850468-6 devstack@n-api.service[103939]: method: > Jul 28 10:21:30.991375 n-d-850468-6 devstack@n-api.service[103939]: exception: Flavor 451 could not be found. Jul 28 10:21:30.991375 n-d-850468-6 devstack@n-api.service[103939]: action_args: {'id': '451'} Jul 28 10:21:30.991375 n-d-850468-6 devstack@n-api.service[103939]: {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:21:30.991375 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:21:30.992308 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 10:21:30.992308 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 10:21:30.992308 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 10:21:30.992308 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 10:21:30.992308 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:21:30.992308 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:21:30.992308 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 10:21:30.992308 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 10:21:30.992308 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 10:21:30.992308 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:21:30.992308 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 10:21:30.992308 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 10:21:30.992308 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 10:21:30.992308 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 28 10:21:30.992308 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:21:30.992308 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 28 10:21:30.992308 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:21:30.992308 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:21:30.992308 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:21:30.993593 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:21:30.993593 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:21:30.993593 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:21:30.993593 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:21:30.993593 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 10:21:30.993593 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:21:30.993593 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 10:21:30.993593 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 28 10:21:30.993593 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:21:30.993593 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 28 10:21:30.993593 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:21:30.993593 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:21:30.993593 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:21:30.993593 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:21:30.993593 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:21:30.993593 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 10:21:30.993593 n-d-850468-6 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 28 10:21:30.993593 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-f486cd21-5c9d-4651-8fd8-8b84bd852cbf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:21:30.994825 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-f486cd21-5c9d-4651-8fd8-8b84bd852cbf admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.387527 Jul 28 10:21:30.994825 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 24/49] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jul 28 10:21:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 10:21:31.000575 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-b5abafb8-290c-4b20-9cbe-d8e47a773b32 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:31.015295 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-b5abafb8-290c-4b20-9cbe-d8e47a773b32 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018219 Jul 28 10:21:31.015816 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jul 28 10:21:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:21:31.025141 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-be110167-0324-4cd8-a222-b4f224407abd admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:31.041098 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-be110167-0324-4cd8-a222-b4f224407abd admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019496 Jul 28 10:21:31.041646 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jul 28 10:21:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:21:31.051995 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-1f8dd357-779f-4a74-bbfe-578d24d42f20 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:31.057358 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.wsgi [None req-1f8dd357-779f-4a74-bbfe-578d24d42f20 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 10:21:31.058874 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-1f8dd357-779f-4a74-bbfe-578d24d42f20 admin admin] Request method failure captured: Jul 28 10:21:31.058874 n-d-850468-6 devstack@n-api.service[103940]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 10:21:31.058874 n-d-850468-6 devstack@n-api.service[103940]: Accept: application/json Jul 28 10:21:31.058874 n-d-850468-6 devstack@n-api.service[103940]: Accept-Encoding: gzip, deflate Jul 28 10:21:31.058874 n-d-850468-6 devstack@n-api.service[103940]: Connection: keep-alive Jul 28 10:21:31.058874 n-d-850468-6 devstack@n-api.service[103940]: Content-Length: 0 Jul 28 10:21:31.058874 n-d-850468-6 devstack@n-api.service[103940]: Host: 10.222.0.46 Jul 28 10:21:31.058874 n-d-850468-6 devstack@n-api.service[103940]: Openstack-Api-Version: compute 2.90 Jul 28 10:21:31.058874 n-d-850468-6 devstack@n-api.service[103940]: Openstack-System-Scope: None Jul 28 10:21:31.058874 n-d-850468-6 devstack@n-api.service[103940]: User-Agent: python-novaclient Jul 28 10:21:31.058874 n-d-850468-6 devstack@n-api.service[103940]: X-Auth-Token: gAAAAABi4mMq5sRD85Y_Dy4wXjoYTi6gkG90KIzKG8XqagVq_w3MUCFmHWth7XM6ghuWMN96W2-46CYKonZGsMX1G_ZZ890b6uefOCZvVu5PUzmpjoozP310MJDsBE4Jv9ozNmn7snXNdtTiPWWX2Bs-l9MngPaJuYgkk_MwZopsGacToHb_ylE Jul 28 10:21:31.058874 n-d-850468-6 devstack@n-api.service[103940]: X-Domain-Id: None Jul 28 10:21:31.058874 n-d-850468-6 devstack@n-api.service[103940]: X-Domain-Name: None Jul 28 10:21:31.058874 n-d-850468-6 devstack@n-api.service[103940]: X-Identity-Status: Confirmed Jul 28 10:21:31.058874 n-d-850468-6 devstack@n-api.service[103940]: X-Is-Admin-Project: True Jul 28 10:21:31.058874 n-d-850468-6 devstack@n-api.service[103940]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 10:21:31.058874 n-d-850468-6 devstack@n-api.service[103940]: X-Project-Domain-Id: default Jul 28 10:21:31.058874 n-d-850468-6 devstack@n-api.service[103940]: X-Project-Domain-Name: Default Jul 28 10:21:31.058874 n-d-850468-6 devstack@n-api.service[103940]: X-Project-Id: 10082210418849b1827f8de2bb4559d2 Jul 28 10:21:31.058874 n-d-850468-6 devstack@n-api.service[103940]: X-Project-Name: admin Jul 28 10:21:31.058874 n-d-850468-6 devstack@n-api.service[103940]: X-Role: reader,member,admin Jul 28 10:21:31.058874 n-d-850468-6 devstack@n-api.service[103940]: X-Roles: reader,member,admin Jul 28 10:21:31.060512 n-d-850468-6 devstack@n-api.service[103940]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/10082210418849b1827f8de2bb4559d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/10082210418849b1827f8de2bb4559d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/10082210418849b1827f8de2bb4559d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_10082210418849b1827f8de2bb4559d2", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:21:31.060512 n-d-850468-6 devstack@n-api.service[103940]: X-Tenant: admin Jul 28 10:21:31.060512 n-d-850468-6 devstack@n-api.service[103940]: X-Tenant-Id: 10082210418849b1827f8de2bb4559d2 Jul 28 10:21:31.060512 n-d-850468-6 devstack@n-api.service[103940]: X-Tenant-Name: admin Jul 28 10:21:31.060512 n-d-850468-6 devstack@n-api.service[103940]: X-User: admin Jul 28 10:21:31.060512 n-d-850468-6 devstack@n-api.service[103940]: X-User-Domain-Id: default Jul 28 10:21:31.060512 n-d-850468-6 devstack@n-api.service[103940]: X-User-Domain-Name: Default Jul 28 10:21:31.060512 n-d-850468-6 devstack@n-api.service[103940]: X-User-Id: 94b06c9fa4854229ba35827e7d62ebfc Jul 28 10:21:31.060512 n-d-850468-6 devstack@n-api.service[103940]: X-User-Name: admin Jul 28 10:21:31.060512 n-d-850468-6 devstack@n-api.service[103940]: method: > Jul 28 10:21:31.060512 n-d-850468-6 devstack@n-api.service[103940]: exception: Flavor 451 could not be found. Jul 28 10:21:31.060512 n-d-850468-6 devstack@n-api.service[103940]: action_args: {'id': '451'} Jul 28 10:21:31.060512 n-d-850468-6 devstack@n-api.service[103940]: {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:21:31.060512 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:21:31.061342 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 10:21:31.061342 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 10:21:31.061342 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 10:21:31.061342 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 10:21:31.061342 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:21:31.061342 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:21:31.061342 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 10:21:31.061342 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 10:21:31.061342 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 10:21:31.061342 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:21:31.061342 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 10:21:31.061342 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 10:21:31.061342 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 10:21:31.061342 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 28 10:21:31.061342 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:21:31.061342 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 28 10:21:31.061342 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:21:31.061342 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:21:31.061342 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:21:31.062508 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:21:31.062508 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:21:31.062508 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:21:31.062508 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:21:31.062508 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 10:21:31.062508 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:21:31.062508 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 10:21:31.062508 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 28 10:21:31.062508 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:21:31.062508 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 28 10:21:31.062508 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:21:31.062508 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:21:31.062508 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:21:31.062508 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:21:31.062508 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:21:31.062508 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 10:21:31.062508 n-d-850468-6 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 28 10:21:31.062508 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-1f8dd357-779f-4a74-bbfe-578d24d42f20 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:21:31.063581 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-1f8dd357-779f-4a74-bbfe-578d24d42f20 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012647 Jul 28 10:21:31.063581 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jul 28 10:21:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 10:21:32.017684 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-be110167-0324-4cd8-a222-b4f224407abd admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:32.018720 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-be110167-0324-4cd8-a222-b4f224407abd admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Jul 28 10:21:32.019114 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jul 28 10:21:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:21:32.541197 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-6b59d8a4-f20c-47ea-a95b-d68960926e4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:21:32.561660 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-6b59d8a4-f20c-47ea-a95b-d68960926e4b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.404378 Jul 28 10:21:32.562241 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Jul 28 10:21:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:21:33.523645 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-be110167-0324-4cd8-a222-b4f224407abd admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:33.524915 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-be110167-0324-4cd8-a222-b4f224407abd admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001682 Jul 28 10:21:33.525310 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jul 28 10:21:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:21:34.041403 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-a92164fe-d58f-4ada-b067-6f843c02d593 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:21:34.059960 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-a92164fe-d58f-4ada-b067-6f843c02d593 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.397893 Jul 28 10:21:34.060496 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 29/56] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Jul 28 10:21:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:21:35.040322 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-be110167-0324-4cd8-a222-b4f224407abd admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:35.041354 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-be110167-0324-4cd8-a222-b4f224407abd admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 28 10:21:35.041748 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 28/57] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jul 28 10:21:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:21:35.562544 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-4ce2352d-5742-4400-aaee-bc1e32ab9b4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:21:35.581287 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-4ce2352d-5742-4400-aaee-bc1e32ab9b4a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.402779 Jul 28 10:21:35.581840 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 30/58] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Jul 28 10:21:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:21:36.543132 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-be110167-0324-4cd8-a222-b4f224407abd admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:36.544161 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-be110167-0324-4cd8-a222-b4f224407abd admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jul 28 10:21:36.544556 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jul 28 10:21:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:21:37.064854 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-3bab9ae1-1a8f-4f8d-8d96-3ee1c3674322 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:21:37.084285 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-3bab9ae1-1a8f-4f8d-8d96-3ee1c3674322 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.403115 Jul 28 10:21:37.084818 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 31/60] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Jul 28 10:21:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:21:38.047806 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-be110167-0324-4cd8-a222-b4f224407abd admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:38.049027 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-be110167-0324-4cd8-a222-b4f224407abd admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001670 Jul 28 10:21:38.049430 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 30/61] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jul 28 10:21:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:21:38.568129 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-c242b9e2-b784-44f2-a06e-d50ab62e37b5 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:21:38.588394 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-c242b9e2-b784-44f2-a06e-d50ab62e37b5 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.402344 Jul 28 10:21:38.588938 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 32/62] 10.222.0.46 () {60 vars in 1202 bytes} [Thu Jul 28 10:21:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:22:29.891606 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-be110167-0324-4cd8-a222-b4f224407abd admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:22:29.892659 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-be110167-0324-4cd8-a222-b4f224407abd admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 28 10:22:29.893060 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 10:22:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:22:29.903414 n-d-850468-6 devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:22:30.294917 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-04c2f3d0-829c-425e-8e0f-bc8bd950f6f6 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:22:30.314953 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-04c2f3d0-829c-425e-8e0f-bc8bd950f6f6 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.415877 Jul 28 10:22:30.315428 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 33/64] 10.222.0.46 () {60 vars in 1291 bytes} [Thu Jul 28 10:22:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:22:30.339536 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-33a7e3a8-9099-488b-aa08-ab36b9d92bba admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:22:30.344252 n-d-850468-6 devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_api:SELECT=14 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:22:30.350385 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-33a7e3a8-9099-488b-aa08-ab36b9d92bba admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014569 Jul 28 10:22:30.351005 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 32/65] 10.222.0.46 () {60 vars in 1282 bytes} [Thu Jul 28 10:22:30 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:22:30.363883 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-9e6413dc-d1d6-44d8-a677-59ef08268a67 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:22:30.371865 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-9e6413dc-d1d6-44d8-a677-59ef08268a67 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011570 Jul 28 10:22:30.372437 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 34/66] 10.222.0.46 () {60 vars in 1285 bytes} [Thu Jul 28 10:22:30 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:22:30.385315 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-f230d2ef-d8ac-411b-b639-3f1035daea61 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:22:30.393004 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-f230d2ef-d8ac-411b-b639-3f1035daea61 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011350 Jul 28 10:22:30.393528 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 33/67] 10.222.0.46 () {60 vars in 1285 bytes} [Thu Jul 28 10:22:30 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:22:30.404933 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-562a4cc5-62da-4b71-8ece-1455f290ddbc admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:22:30.412629 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-562a4cc5-62da-4b71-8ece-1455f290ddbc admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011243 Jul 28 10:22:30.413399 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 35/68] 10.222.0.46 () {60 vars in 1282 bytes} [Thu Jul 28 10:22:30 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:28:14.315451 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-f230d2ef-d8ac-411b-b639-3f1035daea61 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:28:14.316497 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-f230d2ef-d8ac-411b-b639-3f1035daea61 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 28 10:28:14.316896 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 34/69] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jul 28 10:28:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:28:14.456339 n-d-850468-6 devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writing DB stats nova_api:SELECT=6 {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:28:14.596700 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-040bbc11-e43a-466c-9bfb-75dc1944d752 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:28:14.599109 n-d-850468-6 devstack@n-api.service[103940]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:28:14.599109 n-d-850468-6 devstack@n-api.service[103940]: warnings.warn(msg) Jul 28 10:28:14.600342 n-d-850468-6 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-040bbc11-e43a-466c-9bfb-75dc1944d752 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:28:14.600782 n-d-850468-6 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-040bbc11-e43a-466c-9bfb-75dc1944d752 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:28:14.601579 n-d-850468-6 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-040bbc11-e43a-466c-9bfb-75dc1944d752 admin admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:28:14.602035 n-d-850468-6 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-040bbc11-e43a-466c-9bfb-75dc1944d752 admin admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:28:14.642413 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-040bbc11-e43a-466c-9bfb-75dc1944d752 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.187523 Jul 28 10:28:14.642976 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 36/70] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jul 28 10:28:14 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:28:15.477735 n-d-850468-6 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-f230d2ef-d8ac-411b-b639-3f1035daea61 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:28:15.479392 n-d-850468-6 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-f230d2ef-d8ac-411b-b639-3f1035daea61 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001991 Jul 28 10:28:15.479777 n-d-850468-6 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 35/71] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jul 28 10:28:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:28:15.671791 n-d-850468-6 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-c57a4b95-87b6-4968-902a-2c29d1cd1053 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:28:15.674349 n-d-850468-6 devstack@n-api.service[103940]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:28:15.674349 n-d-850468-6 devstack@n-api.service[103940]: warnings.warn(msg) Jul 28 10:28:15.675572 n-d-850468-6 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-c57a4b95-87b6-4968-902a-2c29d1cd1053 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:28:15.676006 n-d-850468-6 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-c57a4b95-87b6-4968-902a-2c29d1cd1053 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:28:15.677329 n-d-850468-6 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-c57a4b95-87b6-4968-902a-2c29d1cd1053 admin admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:28:15.677764 n-d-850468-6 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-c57a4b95-87b6-4968-902a-2c29d1cd1053 admin admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:28:15.700568 n-d-850468-6 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-c57a4b95-87b6-4968-902a-2c29d1cd1053 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.081745 Jul 28 10:28:15.701055 n-d-850468-6 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 37/72] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jul 28 10:28:15 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:29:06.492158 n-d-850468-6 devstack@n-api.service[103938]: Thu Jul 28 10:29:06 2022 - graceful shutdown triggered... Jul 28 10:29:06.492733 n-d-850468-6 devstack@n-api.service[103939]: Gracefully killing worker 1 (pid: 103939)... Jul 28 10:29:06.492287 n-d-850468-6 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 28 10:29:06.493562 n-d-850468-6 devstack@n-api.service[103940]: Gracefully killing worker 2 (pid: 103940)... Jul 28 10:29:07.493310 n-d-850468-6 devstack@n-api.service[103938]: worker 1 buried after 1 seconds Jul 28 10:29:07.493310 n-d-850468-6 devstack@n-api.service[103938]: worker 2 buried after 1 seconds Jul 28 10:29:07.493310 n-d-850468-6 devstack@n-api.service[103938]: goodbye to uWSGI. Jul 28 10:29:07.494963 n-d-850468-6 systemd[1]: devstack@n-api.service: Succeeded. Jul 28 10:29:07.495534 n-d-850468-6 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 28 10:29:07.498337 n-d-850468-6 systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 10:29:07.512645 n-d-850468-6 devstack@n-api.service[119453]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 10:29:07.525145 n-d-850468-6 devstack@n-api.service[119453]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 10:29:07 2022] *** Jul 28 10:29:07.525145 n-d-850468-6 devstack@n-api.service[119453]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 10:29:07.525145 n-d-850468-6 devstack@n-api.service[119453]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 10:29:07.525145 n-d-850468-6 devstack@n-api.service[119453]: nodename: n-d-850468-6 Jul 28 10:29:07.525145 n-d-850468-6 devstack@n-api.service[119453]: machine: x86_64 Jul 28 10:29:07.525145 n-d-850468-6 devstack@n-api.service[119453]: clock source: unix Jul 28 10:29:07.525145 n-d-850468-6 devstack@n-api.service[119453]: pcre jit disabled Jul 28 10:29:07.525145 n-d-850468-6 devstack@n-api.service[119453]: detected number of CPU cores: 4 Jul 28 10:29:07.525145 n-d-850468-6 devstack@n-api.service[119453]: current working directory: / Jul 28 10:29:07.525145 n-d-850468-6 devstack@n-api.service[119453]: detected binary path: /usr/bin/uwsgi-core Jul 28 10:29:07.525145 n-d-850468-6 devstack@n-api.service[119453]: your processes number limit is 47680 Jul 28 10:29:07.526143 n-d-850468-6 devstack@n-api.service[119453]: your memory page size is 4096 bytes Jul 28 10:29:07.526143 n-d-850468-6 devstack@n-api.service[119453]: detected max file descriptor number: 2048 Jul 28 10:29:07.526143 n-d-850468-6 devstack@n-api.service[119453]: lock engine: pthread robust mutexes Jul 28 10:29:07.526143 n-d-850468-6 devstack@n-api.service[119453]: thunder lock: enabled Jul 28 10:29:07.526143 n-d-850468-6 devstack@n-api.service[119453]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 10:29:07.526143 n-d-850468-6 devstack@n-api.service[119453]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 10:29:07.569201 n-d-850468-6 devstack@n-api.service[119453]: Python main interpreter initialized at 0x562f7eb619c0 Jul 28 10:29:07.569201 n-d-850468-6 devstack@n-api.service[119453]: python threads support enabled Jul 28 10:29:07.569201 n-d-850468-6 devstack@n-api.service[119453]: your server socket listen backlog is limited to 100 connections Jul 28 10:29:07.569201 n-d-850468-6 devstack@n-api.service[119453]: your mercy for graceful operations on workers is 90 seconds Jul 28 10:29:07.569703 n-d-850468-6 devstack@n-api.service[119453]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 10:29:07.569703 n-d-850468-6 devstack@n-api.service[119453]: *** Operational MODE: preforking *** Jul 28 10:29:07.569975 n-d-850468-6 devstack@n-api.service[119453]: *** uWSGI is running in multiple interpreter mode *** Jul 28 10:29:07.569975 n-d-850468-6 devstack@n-api.service[119453]: spawned uWSGI master process (pid: 119453) Jul 28 10:29:07.570188 n-d-850468-6 systemd[1]: Started Devstack devstack@n-api.service. Jul 28 10:29:07.571065 n-d-850468-6 devstack@n-api.service[119453]: spawned uWSGI worker 1 (pid: 119463, cores: 1) Jul 28 10:29:07.571300 n-d-850468-6 devstack@n-api.service[119453]: spawned uWSGI worker 2 (pid: 119464, cores: 1) Jul 28 10:29:07.571463 n-d-850468-6 devstack@n-api.service[119453]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 10:29:08.262329 n-d-850468-6 devstack@n-api.service[119463]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 10:29:08.268051 n-d-850468-6 devstack@n-api.service[119464]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 10:29:09.469214 n-d-850468-6 devstack@n-api.service[119463]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 10:29:09.469214 n-d-850468-6 devstack@n-api.service[119463]: from cryptography.utils import int_from_bytes Jul 28 10:29:09.469900 n-d-850468-6 devstack@n-api.service[119463]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 10:29:09.469900 n-d-850468-6 devstack@n-api.service[119463]: from cryptography.utils import int_from_bytes Jul 28 10:29:09.470062 n-d-850468-6 devstack@n-api.service[119464]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 10:29:09.470062 n-d-850468-6 devstack@n-api.service[119464]: from cryptography.utils import int_from_bytes Jul 28 10:29:09.470062 n-d-850468-6 devstack@n-api.service[119464]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 10:29:09.470062 n-d-850468-6 devstack@n-api.service[119464]: from cryptography.utils import int_from_bytes Jul 28 10:29:11.967850 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 10:29:11.968473 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 10:29:11.968569 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 10:29:11.968909 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 10:29:11.969167 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 10:29:11.969575 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.969936 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.970271 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.970605 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.970929 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.971249 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.971573 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.971897 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.972229 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.972489 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.972806 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.973142 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850468-6 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.973463 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.973990 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.974311 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.974638 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.974946 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.975273 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.975582 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.976099 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.977539 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.977539 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.977539 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.977539 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.978039 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.978297 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.978619 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.978936 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.979257 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.979580 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.979988 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850468-6 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.980943 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.981218 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.981522 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.982006 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.982307 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.982610 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.982939 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.983404 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.983729 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.984073 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.984404 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.984731 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.985065 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.985355 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.985672 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.986021 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.986351 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.986667 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.986975 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.987227 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.987546 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.988373 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.988373 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.988705 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.988852 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.989002 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.989292 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.989612 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.990215 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.990532 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.991086 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.991516 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.991837 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.992149 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.992458 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.992765 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.993098 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.993423 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.993757 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.994097 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.994417 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.994834 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.995090 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.995399 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.995862 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.996187 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.996497 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.996822 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.997150 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.997629 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.997931 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.998247 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.998576 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.998925 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.999240 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.999529 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:11.999802 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.000104 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.000437 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.000745 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.001056 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.001362 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.001669 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.002008 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.002299 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.002790 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.002967 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.003198 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.003506 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.003809 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.004130 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.004655 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.005162 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.005395 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.005667 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.006003 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.006315 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.006625 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.006952 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.007262 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.007569 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.007896 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.008205 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.008517 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.008839 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.009147 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.009452 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.009774 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.010107 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.010417 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.010738 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.011046 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.011376 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.011685 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.011994 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.012301 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.012609 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.012918 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.013220 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.013528 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.013878 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.014290 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.014530 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.014840 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.015152 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.015473 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.015818 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.016153 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.016499 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.016819 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.017156 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.017489 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.017811 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.018158 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.018474 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.018804 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.019120 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.019693 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.019827 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.020238 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.020562 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.020897 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.021217 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.021535 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.021885 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.022195 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.022519 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.022850 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.023181 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.023496 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.023843 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.024209 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.024525 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.024854 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.025190 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.025507 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.026022 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.026470 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.026877 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.027836 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.028156 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.028739 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.029059 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.029380 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.029701 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.030050 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.030368 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.030719 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.031042 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.031365 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.032937 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.032937 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.032937 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.032937 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.032937 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.033354 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.033552 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.033822 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.034441 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.034732 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.035064 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.035540 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.035704 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.036071 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.036580 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.036903 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.037220 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.037535 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.037847 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.038191 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.038507 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.038819 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.039148 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.039461 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.039769 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.040097 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.040409 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.040717 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.041040 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.041355 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.041670 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.042011 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.042327 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.043496 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.043733 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.043977 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.044316 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.044650 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.044961 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.045299 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.045628 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.045977 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.046304 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.046602 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.046912 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.047234 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.047540 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.047848 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.048151 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.048460 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.048769 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.049260 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.049576 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.049936 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.050222 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 10:29:12.050751 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.050863 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 10:29:12.050965 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.050965 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.051153 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 10:29:12.051257 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.051378 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 10:29:12.051474 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.051636 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 10:29:12.051766 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.052033 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.052142 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.052364 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.052468 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.052689 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.052790 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.053012 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.053116 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.053351 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.053466 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.053668 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.053761 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.054039 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.054147 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.054347 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.054457 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.054735 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.055027 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.055142 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.055229 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.055314 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.055523 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.055625 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850468-6 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.055840 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.055950 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.056167 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.056377 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.056581 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.056729 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.056885 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.057028 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.057175 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.057314 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.057459 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.057611 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.057833 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.058032 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.058238 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.058446 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.058582 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.058785 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.059017 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.059118 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.059417 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.059514 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.059734 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.059841 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.060052 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.060142 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.060423 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.060580 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.060741 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.060854 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.061067 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.061160 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.061381 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.061475 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.061713 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.061826 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.062074 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.062230 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.062443 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.062551 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850468-6 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.062760 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.062873 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.063093 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.063195 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.063620 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.063811 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.063811 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.063997 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.066426 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.066576 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.066709 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.066803 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.066884 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.066988 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.067076 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.067163 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.067260 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.067348 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.067451 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.067540 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.067628 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.067733 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.067829 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.067926 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.068022 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.068022 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.068186 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.068280 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.068367 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.068445 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.068445 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.068630 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.068718 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.068718 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.068868 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.069194 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.069194 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.069517 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.069622 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.069717 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.069804 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.070046 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.070145 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.070304 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.070558 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.070665 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.070881 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.071107 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.071204 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.071510 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.071603 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.071823 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.072027 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.072129 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.072432 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.072540 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.072743 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.072932 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.073037 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.073357 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.073458 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.073668 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.073928 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.074062 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.074409 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.074542 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.074900 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.075046 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.075344 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.075438 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.075681 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.075774 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.076095 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.076189 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.076462 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.076676 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.076890 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.077060 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.077224 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.077423 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.077632 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.077799 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.077997 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.078296 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.078392 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.078631 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.078725 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.078947 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.079179 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.079292 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.079572 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.079893 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.080002 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.080215 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.080361 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.080463 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.080773 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.080984 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.081165 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.081360 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.081479 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.081682 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.081950 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.082050 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.082315 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.082462 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.082622 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.082934 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.083036 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.083243 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.083390 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.083555 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.083838 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.083933 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.084161 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.084305 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.084466 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.084777 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.084869 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.085087 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.085246 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.085396 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.085686 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.085780 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.086057 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.086151 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.086372 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.086617 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.086739 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.086986 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.087092 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.087296 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.087518 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.087636 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.087923 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.088026 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.088233 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.088378 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.088559 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.088802 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.088895 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.089165 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.089266 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.090058 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.090281 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.090629 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.090978 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.091190 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.091493 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.091670 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.091873 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.092045 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.092221 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.092427 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.092584 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.092777 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.093024 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.093182 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.093340 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.093635 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.093780 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.093980 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.094218 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.094406 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.094579 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.094791 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.094959 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.095178 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.095377 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.095504 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.095822 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.095918 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.096133 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.096307 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.096444 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.096757 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.096872 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.097082 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:29:12.097250 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.097423 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.097699 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.097814 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.098120 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.098215 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.098442 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.098672 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.098775 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.099091 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.099193 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.099414 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.099632 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.099745 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.100038 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.100141 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.100368 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.100523 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.100685 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.100949 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.101044 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.101302 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.101408 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.101624 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.101824 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.101977 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.102285 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.102379 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.102620 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.102722 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.102943 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.103169 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.103272 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.103570 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.103741 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.103927 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.104219 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.104388 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.104551 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.104811 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.105001 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.105916 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.106113 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.106530 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.106715 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.106893 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.107182 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.107365 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.107537 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.107733 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.107908 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.108129 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.108301 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.108471 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.108769 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.108941 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.109108 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.109389 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.109568 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.109774 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.109977 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.110136 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.110369 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.110527 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.110699 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.110994 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.111157 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.111323 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.111528 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.111690 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.111949 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.112202 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.112376 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.112577 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.112745 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.112936 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.113207 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.113395 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.113580 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.113785 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.114098 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.114266 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.114387 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.114496 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.114745 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.114848 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.115060 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.115198 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.115370 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.115656 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.115749 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.116013 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.116119 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.116322 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.116528 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.116664 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.116969 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.117085 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.117290 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.117519 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.117707 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.117926 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.118103 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.118274 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.118538 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.118726 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.118884 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.119088 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.119255 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.119464 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.119624 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.119803 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.120076 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.120239 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.120394 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.120640 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.120866 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.121321 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.121630 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.121852 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.122057 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.122318 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.122502 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.122835 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.123014 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.123325 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.123575 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.123821 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.124176 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.124356 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.124784 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.124967 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.125286 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.125450 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.125810 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.126012 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.126351 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.126599 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.126863 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.127026 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.127277 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.127436 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.127623 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.127895 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.128068 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.128290 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.128459 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.128627 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.128919 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.129083 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.129238 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.129455 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.129619 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.129837 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.130054 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.130221 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.130484 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.130656 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.130813 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.131072 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.131236 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.131391 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.131609 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.131785 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.132007 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.132166 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.132319 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.132625 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.132798 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.132971 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.133161 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.133334 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.133571 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.133728 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.133932 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.134445 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.134611 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.134772 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.134911 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.135078 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.135246 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.135378 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.135517 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.135838 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.135986 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.136135 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.136935 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.137100 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.137421 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.137593 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.137947 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.138104 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.138279 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.138494 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.138694 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.138903 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.139058 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.139224 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.139523 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.139699 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.139866 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.140062 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.140225 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.140464 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.140661 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.140823 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.141126 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.141294 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.141448 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.141728 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.141934 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.142115 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.142300 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.142460 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.142745 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.142931 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.143086 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.143346 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.143512 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.143666 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.143897 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.144070 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.144282 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.144440 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.144610 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.144911 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.145092 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.145259 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.145468 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.145630 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.145841 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.146082 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.146251 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.146487 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.146658 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.146824 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.147093 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.147258 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.147434 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.147634 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.147803 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.148058 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.148211 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.148398 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.148677 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.148840 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.148997 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.149221 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.149398 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.149595 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.149762 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.149945 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.150236 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.150405 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.150559 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.150861 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.151023 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.151190 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.151425 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.151589 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.151780 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.152025 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.152708 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.153016 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.153246 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.153540 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.153729 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.153929 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.154119 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.154299 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.154568 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.154731 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.154899 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.155160 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.155338 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.155521 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.155718 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.155894 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.156155 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.156315 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.156462 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.156747 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.156912 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.157071 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.157305 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.157475 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.157695 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.157847 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.158049 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.158338 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.158575 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.158729 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.158922 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.159332 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.159529 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.159737 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.159900 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.160153 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.160367 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.160523 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.160782 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.160964 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.161118 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.161328 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.161492 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.161701 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.161896 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.162081 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.162344 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.162517 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.162684 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.162917 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.163080 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.163258 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.163468 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.163632 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.163874 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.164043 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.164207 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.164493 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.164690 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.164845 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.165182 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.165388 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.165693 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.165887 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.166046 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.166261 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.166442 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.166693 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.166865 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.167034 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.167298 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.167464 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.167818 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.168105 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.168451 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.168715 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.168894 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.169065 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.169267 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.169432 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.169695 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.170002 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.170169 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.170337 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.170642 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.170817 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.170971 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.171228 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.171404 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.171572 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.171783 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.171948 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.172144 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.172337 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.172512 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.172765 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.172937 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.173091 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.173368 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.173532 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.173711 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.173971 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.174157 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.174504 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.174674 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.174989 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.175167 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.175514 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.175693 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.176058 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.176225 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.176540 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.176854 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.177097 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.177376 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.177729 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.177943 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.178125 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.178316 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.178477 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.178755 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.178915 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.179068 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.179398 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.179559 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.179714 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.180017 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.180189 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.180359 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.180575 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.180797 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.180954 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.181154 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.181327 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.181546 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.181718 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.181906 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.182198 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.182377 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.182532 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.182780 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.182957 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.183162 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.183534 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.183770 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.184063 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.184511 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.184679 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.185047 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.185242 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.185571 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.185751 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.185979 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.186149 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.186317 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.186618 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.186785 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.186939 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.187180 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.187345 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.187561 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.187744 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.187906 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.188180 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.188396 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.188565 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.188800 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.188972 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.189152 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.189379 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.189542 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.189736 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.190082 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.190265 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.190420 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.190650 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.190874 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.191031 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.191192 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.191358 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.191595 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.191763 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.191924 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.192229 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.192402 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.192558 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.192783 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.192958 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.193152 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.193319 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.193474 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.193765 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.193996 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.194153 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.194393 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.194557 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.194713 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.194938 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.195115 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.195299 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.195513 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.195700 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.195910 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.196091 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.196247 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.196543 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.196715 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.196930 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.197097 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.197281 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.197435 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.197632 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.197832 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.198100 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.198250 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.198468 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.198761 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.199487 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.199941 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.200297 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.200453 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.200588 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.200705 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.200826 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.200962 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.201082 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.201288 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.201423 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.201605 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.201726 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.201953 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.202077 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.202276 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.202405 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.202601 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.202720 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.202915 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.203013 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.203229 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.203338 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.203560 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.203651 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.203878 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.203970 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.204194 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.204298 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.204525 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.204626 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.204863 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.204962 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.205193 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.205325 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.205505 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.205600 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.205821 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.205975 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.206161 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.206261 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.206479 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.206608 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.206798 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.206908 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.207116 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.207213 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.207435 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.207542 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.207744 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.207835 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.208054 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.208153 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.208371 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.208477 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.208684 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.208802 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.208999 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.209103 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.209307 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.209410 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.209625 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.209724 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.209955 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.210051 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.210266 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.210375 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.210574 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.210668 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.210894 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.210991 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.211204 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.211295 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.211513 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.211605 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.211831 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.211923 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.212138 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.212230 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.212450 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.212582 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.212759 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.212902 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.213109 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.213224 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.213420 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.213541 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.213758 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.213850 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.214120 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.214331 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.214510 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.215333 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.215484 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.215793 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.215892 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.216134 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.216233 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.216461 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.216624 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.216774 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.216948 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.217095 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.217271 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.217416 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.217592 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.217737 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.217991 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.218135 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.218255 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.218449 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.218563 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.218716 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.218900 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.219011 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.219215 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.219318 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.219530 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.219632 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.219845 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.220178 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.220278 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.220488 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.220592 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.220819 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.220919 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.221136 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.221249 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.221456 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.221558 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.221774 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.221895 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.222120 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.222301 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.222437 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.222621 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.222754 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.222941 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.223069 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.223274 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.223379 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.223606 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.223706 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.223939 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.224040 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.224249 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.224351 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.224570 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.224669 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.224885 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.224991 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.225226 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.225469 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.225595 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.225689 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.225883 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.225979 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.226208 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.226303 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.226523 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.226615 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.226856 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.226963 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.227174 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.227267 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.227496 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.227587 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.227814 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.227919 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.228129 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.228277 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.228444 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.228561 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.228764 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.228883 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.229078 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.229169 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.229395 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.229510 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.229712 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.229826 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.230080 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.230225 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.230406 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.230736 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.230836 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.231077 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.231180 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.231402 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.231502 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.231722 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.231829 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.232041 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.232132 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.232360 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.232458 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.232677 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.232886 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.232979 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.233208 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.233296 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.233549 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.233640 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.233897 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.233994 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.234225 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.234315 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.234543 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.234635 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.234862 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.234962 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.235189 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.235287 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.235498 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.235644 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.235909 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.236010 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.236104 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.236195 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.236413 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.236520 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.236723 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.236816 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.237034 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.237129 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.237343 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.237445 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.237649 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.237748 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.237995 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.238136 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.238309 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.238410 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.238663 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.238887 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.239002 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.239189 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.239296 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.239507 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.239629 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.239838 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.239961 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.240167 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.240274 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.240487 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.240586 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.240798 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.240891 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.241122 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.241229 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.241432 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.241534 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.241739 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.241893 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.242082 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.242191 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.242395 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.242488 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.242702 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.242795 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.243010 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.243107 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.243322 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.243457 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.243630 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.243730 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.243933 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.244025 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.244239 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.244331 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.244542 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.244633 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.244867 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.244966 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.245172 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.245263 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.245480 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.245607 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.245834 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.246029 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.246174 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.246435 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.246664 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.246765 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.246978 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.247099 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.247286 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.247414 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.247595 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.247757 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.247909 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.248083 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.248217 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.248416 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.248531 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.248752 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.248845 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.249073 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.249188 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.249403 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.249505 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.249727 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.249821 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.250077 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.250170 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.250401 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.250580 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.250714 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.250805 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.251025 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.251127 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.251343 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.251446 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.251665 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.251765 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.251983 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.252082 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.252306 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.252407 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.252630 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.252730 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.252954 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.253046 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.253291 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.253503 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.253827 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.253970 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.254173 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.254273 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.254495 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.254588 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.254815 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.254908 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.255142 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.255234 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.255451 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.255543 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.255767 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.255870 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.256076 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.256178 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.256390 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.256482 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.256703 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.256795 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.257015 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.257158 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.257330 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.257422 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.257641 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.257733 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.257987 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.258138 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.258356 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.258462 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.258598 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.258693 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.258905 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.259013 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.259218 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.259330 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.259528 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.259622 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.259840 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.259944 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.260153 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.260246 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.260465 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.260565 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.260776 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.260876 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.261092 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.261185 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.261991 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.262134 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.262376 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.284723 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.285027 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.285182 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.285312 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.285413 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.285550 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.285664 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.285785 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.285914 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.286025 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.286168 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.286168 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.286429 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.286790 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.286996 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.287221 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.287422 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.287580 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.287700 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.287820 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.287820 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.288051 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.288179 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.288295 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.288412 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.288535 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.288715 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.288849 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.288849 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.289114 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.289234 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.289376 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.289502 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.289621 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.289750 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.289868 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.289968 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.290076 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.290214 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.290375 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.290495 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.290628 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.290754 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.290873 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.290991 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.291103 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.291103 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.291319 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.291447 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.291566 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.291690 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.291821 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.291945 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.291945 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.291945 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.292310 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.292433 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.293179 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.293179 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.293678 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.293919 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.294074 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.294224 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.294348 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.294467 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.294601 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.294725 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.294845 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.294962 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.295086 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.295203 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.295332 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.295448 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.295547 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.295640 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.295763 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.295899 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.296020 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.296135 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.296252 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.296376 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.296376 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.296607 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.296746 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.296963 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.297106 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.297237 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.297366 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.297493 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.297626 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.297849 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.298069 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.298270 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.298410 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.298528 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.298644 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.298783 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.298903 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.299003 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.299193 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.299292 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.299385 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.299508 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.299634 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.299790 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.299913 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.300012 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.300103 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.300201 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.300295 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.300411 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.300528 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.300645 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.300773 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.300926 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.301080 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.301234 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.301414 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.301550 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.301703 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.301825 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.301936 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.302008 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.302008 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.302119 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.302186 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.302186 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.302324 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.302393 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.302393 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.302393 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.302393 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.302393 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.302393 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.302705 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.302772 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.302772 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.302772 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.302772 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.302977 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.302977 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.303088 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.303088 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.303088 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.303088 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.303088 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.303360 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.303426 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.303426 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.303426 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.303426 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.303794 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.303929 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.304003 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.304061 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.304061 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.304061 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.304061 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.304061 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.304061 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.304354 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.304412 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.304467 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.304521 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.304521 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.304689 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.304761 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.304761 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.304872 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.304973 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.305066 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.305157 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.305261 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.305334 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.305392 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.305447 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.305447 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.305447 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.305610 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.305667 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.305721 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.305829 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.305959 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.306046 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.306107 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.306220 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.306293 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.306394 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.306468 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.306611 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.306684 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.306741 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.306796 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.306850 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.306924 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.307052 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.307166 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.307239 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.307239 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.307338 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.307338 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.307469 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.307536 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.307603 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.307669 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.307735 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.307892 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.307969 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.308286 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.308919 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.309113 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.309308 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.309447 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.309793 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.309919 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.310141 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.310217 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.310474 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.310573 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.310801 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.310877 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.311126 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.311200 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.311446 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.311523 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.311759 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.311834 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.312008 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 10:29:12.312138 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.312457 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.312774 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.313090 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.313411 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.313740 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.314084 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.314402 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.314718 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.315037 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.315352 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.315667 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.315980 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.316294 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.316612 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.316923 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.317242 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.317556 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.317913 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.318201 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.318513 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.318830 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.319140 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.319453 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.319761 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.320076 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.320390 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.320730 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.321072 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.321395 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.321726 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.322066 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.322402 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.322722 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.323053 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.323386 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.323710 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.324138 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.324710 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.325037 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.325361 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.325685 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.326035 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.326358 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.326686 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.327026 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.327363 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.327679 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.328016 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.328341 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.328670 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.328995 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.329313 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.329654 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.329996 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.330313 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.330633 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.330947 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.331265 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.331586 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.331901 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.332218 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.332538 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.332858 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.333190 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.333523 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.333839 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.334194 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.334527 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.334882 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.335200 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.335551 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.335887 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.336212 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.336531 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.336842 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:29:12.337088 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 10:29:12.374073 n-d-850468-6 devstack@n-api.service[119463]: INFO dbcounter [None req-b3292593-87f3-41d5-818a-82d3bd347fdb None None] Registered counter for database nova_api Jul 28 10:29:12.394062 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_db.sqlalchemy.engines [None req-b3292593-87f3-41d5-818a-82d3bd347fdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:29:12.400151 n-d-850468-6 devstack@n-api.service[119464]: INFO dbcounter [None req-05f84cc6-78ca-44cc-b063-79c130ce98fe None None] Registered counter for database nova_api Jul 28 10:29:12.400883 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writer thread running {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:29:12.421201 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_db.sqlalchemy.engines [None req-05f84cc6-78ca-44cc-b063-79c130ce98fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119464) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:29:12.427795 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writer thread running {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:29:12.457557 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.context [None req-b3292593-87f3-41d5-818a-82d3bd347fdb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a9e94609-c9be-4409-8579-80fe73a29a93(cell1) {{(pid=119463) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 10:29:12.461669 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b3292593-87f3-41d5-818a-82d3bd347fdb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:29:12.463307 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b3292593-87f3-41d5-818a-82d3bd347fdb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:29:12.464108 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b3292593-87f3-41d5-818a-82d3bd347fdb None None] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:29:12.466200 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b3292593-87f3-41d5-818a-82d3bd347fdb None None] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:29:12.468212 n-d-850468-6 devstack@n-api.service[119463]: INFO dbcounter [None req-b3292593-87f3-41d5-818a-82d3bd347fdb None None] Registered counter for database nova_cell0 Jul 28 10:29:12.472398 n-d-850468-6 devstack@n-api.service[119463]: INFO dbcounter [None req-b3292593-87f3-41d5-818a-82d3bd347fdb None None] Registered counter for database nova_cell1 Jul 28 10:29:12.482898 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_db.sqlalchemy.engines [None req-b3292593-87f3-41d5-818a-82d3bd347fdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:29:12.484616 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_db.sqlalchemy.engines [None req-b3292593-87f3-41d5-818a-82d3bd347fdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:29:12.485525 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.context [None req-05f84cc6-78ca-44cc-b063-79c130ce98fe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a9e94609-c9be-4409-8579-80fe73a29a93(cell1) {{(pid=119464) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 10:29:12.489706 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-05f84cc6-78ca-44cc-b063-79c130ce98fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:29:12.490904 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writer thread running {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:29:12.491350 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-05f84cc6-78ca-44cc-b063-79c130ce98fe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:29:12.492150 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-05f84cc6-78ca-44cc-b063-79c130ce98fe None None] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:29:12.492241 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writer thread running {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:29:12.494178 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-05f84cc6-78ca-44cc-b063-79c130ce98fe None None] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:29:12.496957 n-d-850468-6 devstack@n-api.service[119464]: INFO dbcounter [None req-05f84cc6-78ca-44cc-b063-79c130ce98fe None None] Registered counter for database nova_cell0 Jul 28 10:29:12.501049 n-d-850468-6 devstack@n-api.service[119464]: INFO dbcounter [None req-05f84cc6-78ca-44cc-b063-79c130ce98fe None None] Registered counter for database nova_cell1 Jul 28 10:29:12.509768 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_db.sqlalchemy.engines [None req-05f84cc6-78ca-44cc-b063-79c130ce98fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119464) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:29:12.511035 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_db.sqlalchemy.engines [None req-05f84cc6-78ca-44cc-b063-79c130ce98fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119464) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:29:12.517832 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writer thread running {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:29:12.519934 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writer thread running {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:29:12.641145 n-d-850468-6 devstack@n-api.service[119463]: INFO dbcounter [None req-b3292593-87f3-41d5-818a-82d3bd347fdb None None] Registered counter for database nova_cell0 Jul 28 10:29:12.649985 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_db.sqlalchemy.engines [None req-b3292593-87f3-41d5-818a-82d3bd347fdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:29:12.655219 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writer thread running {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:29:12.673961 n-d-850468-6 devstack@n-api.service[119464]: INFO dbcounter [None req-05f84cc6-78ca-44cc-b063-79c130ce98fe None None] Registered counter for database nova_cell0 Jul 28 10:29:12.682693 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_db.sqlalchemy.engines [None req-05f84cc6-78ca-44cc-b063-79c130ce98fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119464) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:29:12.687829 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writer thread running {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 10:29:12.991135 n-d-850468-6 devstack@n-api.service[119463]: WARNING keystonemiddleware.auth_token [None req-b3292593-87f3-41d5-818a-82d3bd347fdb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 10:29:12.999567 n-d-850468-6 devstack@n-api.service[119463]: WARNING keystonemiddleware.auth_token [None req-b3292593-87f3-41d5-818a-82d3bd347fdb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 10:29:13.026078 n-d-850468-6 devstack@n-api.service[119464]: WARNING keystonemiddleware.auth_token [None req-05f84cc6-78ca-44cc-b063-79c130ce98fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 10:29:13.034742 n-d-850468-6 devstack@n-api.service[119464]: WARNING keystonemiddleware.auth_token [None req-05f84cc6-78ca-44cc-b063-79c130ce98fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 10:29:13.354704 n-d-850468-6 devstack@n-api.service[119463]: WARNING keystonemiddleware.auth_token [None req-b3292593-87f3-41d5-818a-82d3bd347fdb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 10:29:13.361708 n-d-850468-6 devstack@n-api.service[119463]: WARNING keystonemiddleware.auth_token [None req-b3292593-87f3-41d5-818a-82d3bd347fdb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 10:29:13.367095 n-d-850468-6 devstack@n-api.service[119463]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562f7eb619c0 pid: 119463 (default app) Jul 28 10:29:13.392174 n-d-850468-6 devstack@n-api.service[119464]: WARNING keystonemiddleware.auth_token [None req-05f84cc6-78ca-44cc-b063-79c130ce98fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 10:29:13.398230 n-d-850468-6 devstack@n-api.service[119464]: WARNING keystonemiddleware.auth_token [None req-05f84cc6-78ca-44cc-b063-79c130ce98fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 10:29:13.404051 n-d-850468-6 devstack@n-api.service[119464]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562f7eb619c0 pid: 119464 (default app) Jul 28 10:30:03.636816 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=3 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:03.642385 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=3 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:03.644415 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=3 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:03.653160 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=3 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:03.784967 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=3 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:03.796763 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=3 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:03.797567 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=3 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:03.798329 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=3 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:05.087971 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-23df1df6-4b88-4ebe-9368-9bc57e57a32e tempest-AZAdminNegativeTestJSON-1864584797 tempest-AZAdminNegativeTestJSON-1864584797-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:05.089397 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:05.089397 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:05.090360 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-23df1df6-4b88-4ebe-9368-9bc57e57a32e tempest-AZAdminNegativeTestJSON-1864584797 tempest-AZAdminNegativeTestJSON-1864584797-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'a2a3bae1caf64b47b0d19a16b5002b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5cb364c6e44bedbf436c8d1dac4ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:05.093112 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-23df1df6-4b88-4ebe-9368-9bc57e57a32e tempest-AZAdminNegativeTestJSON-1864584797 tempest-AZAdminNegativeTestJSON-1864584797-project] Request method failure captured: Jul 28 10:30:05.093112 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 28 10:30:05.093112 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:30:05.093112 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:30:05.093112 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:30:05.093112 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:30:05.093112 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:30:05.093112 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:30:05.093112 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:30:05.093112 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:05.093112 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mUnGkebU_FMtnz7Jf7OGm9AlsotsmJLkzVe31Gkn3p2TwuULp9rIqM-BphC8GT5ydyVydheym-tCchb3Pe4g30JtShtiE-WEfoljhyaGbKLR64eoQqAY78NDB6k3sXNpRmRqMtxMisQg3-B4GuYThPDFO67xEsfRK5siLwr0oDnv1I Jul 28 10:30:05.093112 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:30:05.093112 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:30:05.093112 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:30:05.093112 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:30:05.093112 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:30:05.093112 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:30:05.093112 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: ef5cb364c6e44bedbf436c8d1dac4ac8 Jul 28 10:30:05.093112 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1864584797 Jul 28 10:30:05.093112 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:30:05.093112 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:30:05.094198 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ef5cb364c6e44bedbf436c8d1dac4ac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ef5cb364c6e44bedbf436c8d1dac4ac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ef5cb364c6e44bedbf436c8d1dac4ac8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ef5cb364c6e44bedbf436c8d1dac4ac8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:05.094198 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-AZAdminNegativeTestJSON-1864584797 Jul 28 10:30:05.094198 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: ef5cb364c6e44bedbf436c8d1dac4ac8 Jul 28 10:30:05.094198 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1864584797 Jul 28 10:30:05.094198 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-AZAdminNegativeTestJSON-1864584797-project Jul 28 10:30:05.094198 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:30:05.094198 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:30:05.094198 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: a2a3bae1caf64b47b0d19a16b5002b72 Jul 28 10:30:05.094198 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-AZAdminNegativeTestJSON-1864584797-project Jul 28 10:30:05.094198 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:30:05.094198 n-d-850468-6 devstack@n-api.service[119463]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 28 10:30:05.094198 n-d-850468-6 devstack@n-api.service[119463]: action_args: {} Jul 28 10:30:05.094888 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:05.094888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:05.094888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:05.094888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:05.094888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:05.094888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:05.094888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:05.094888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:05.094888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 28 10:30:05.094888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 28 10:30:05.094888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:30:05.094888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:30:05.094888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:30:05.094888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:30:05.094888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:05.094888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:05.094888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:05.094888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:05.094888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:30:05.095801 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:30:05.095801 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:30:05.095801 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:30:05.095801 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:30:05.095801 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:30:05.095801 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 28 10:30:05.095801 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:05.095801 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:05.095801 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:05.095801 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:05.095801 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:05.095801 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:05.095801 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:30:05.095801 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:30:05.095801 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 28 10:30:05.095801 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:05.095801 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-23df1df6-4b88-4ebe-9368-9bc57e57a32e tempest-AZAdminNegativeTestJSON-1864584797 tempest-AZAdminNegativeTestJSON-1864584797-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:05.097331 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-23df1df6-4b88-4ebe-9368-9bc57e57a32e tempest-AZAdminNegativeTestJSON-1864584797 tempest-AZAdminNegativeTestJSON-1864584797-project] 10.222.0.46 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.465375 Jul 28 10:30:05.097331 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 1/1] 10.222.0.46 () {58 vars in 1185 bytes} [Thu Jul 28 10:30:03 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1469 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:05.240298 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f0a66e83-7325-4f16-9056-c9cec264fd9e tempest-FlavorsAccessTestJSON-1520887096 tempest-FlavorsAccessTestJSON-1520887096-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-650955455", "id": 1628830299, "os-flavor-access:is_public": "False"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:05.263028 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:05.263028 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:05.309805 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f0a66e83-7325-4f16-9056-c9cec264fd9e tempest-FlavorsAccessTestJSON-1520887096 tempest-FlavorsAccessTestJSON-1520887096-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 1.536410 Jul 28 10:30:05.310819 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 1/2] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:03 2022] POST /compute/v2.1/flavors => generated 430 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:05.501017 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e71da3b5-46ae-4fe5-bfa9-e3a08e8e9a94 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:05.510623 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:05.510623 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:05.513216 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e71da3b5-46ae-4fe5-bfa9-e3a08e8e9a94 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:05.514019 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e71da3b5-46ae-4fe5-bfa9-e3a08e8e9a94 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:05.515412 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e71da3b5-46ae-4fe5-bfa9-e3a08e8e9a94 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:05.516175 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e71da3b5-46ae-4fe5-bfa9-e3a08e8e9a94 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:05.566761 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e71da3b5-46ae-4fe5-bfa9-e3a08e8e9a94 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.469956 Jul 28 10:30:05.578909 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1176 bytes} [Thu Jul 28 10:30:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:05.839555 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-bf3949ce-96f4-453c-991b-42a8e48a3f55 tempest-FlavorsV255TestJSON-1677519663 tempest-FlavorsV255TestJSON-1677519663-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1392702344", "id": 1939838491, "os-flavor-access:is_public": "True"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:05.867280 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-bf3949ce-96f4-453c-991b-42a8e48a3f55 tempest-FlavorsV255TestJSON-1677519663 tempest-FlavorsV255TestJSON-1677519663-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.554492 Jul 28 10:30:05.881471 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 2/4] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Jul 28 10:30:05 2022] POST /compute/v2.1/flavors => generated 449 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:30:05.890087 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-02e436dd-4d14-4ba1-976b-6ccaade748c1 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1963334880", "ram": 512, "vcpus": 1, "disk": 10, "id": 1833035826, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:05.912099 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:05.912099 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:05.964410 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-02e436dd-4d14-4ba1-976b-6ccaade748c1 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.389125 Jul 28 10:30:05.966464 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 3/5] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:05 2022] POST /compute/v2.1/flavors => generated 416 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:05.980245 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-92a973d9-25dc-449c-9676-2412bc212548 tempest-FlavorsAccessTestJSON-1520887096 tempest-FlavorsAccessTestJSON-1520887096-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "adbb89fe29654cf4b0f0921c79a17c93"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:05.980245 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:05.980245 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:06.284281 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2b5db8cf-29ad-4aab-bd27-e8f94d0b37dd tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Calling method '.version_select at 0x7fa959f60ee0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:06.285109 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:06.285109 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:06.324608 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-2b5db8cf-29ad-4aab-bd27-e8f94d0b37dd tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a9e94609-c9be-4409-8579-80fe73a29a93(cell1) {{(pid=119464) load_cells /opt/stack/nova/nova/compute/api.py:307}} Jul 28 10:30:06.327901 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2b5db8cf-29ad-4aab-bd27-e8f94d0b37dd tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:06.328940 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2b5db8cf-29ad-4aab-bd27-e8f94d0b37dd tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:06.374947 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2b5db8cf-29ad-4aab-bd27-e8f94d0b37dd tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:06.375775 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2b5db8cf-29ad-4aab-bd27-e8f94d0b37dd tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:06.399327 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2b5db8cf-29ad-4aab-bd27-e8f94d0b37dd tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:06.401367 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2b5db8cf-29ad-4aab-bd27-e8f94d0b37dd tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:06.412221 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-2b5db8cf-29ad-4aab-bd27-e8f94d0b37dd tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.531944 Jul 28 10:30:06.426664 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 3/6] 10.222.0.46 () {58 vars in 1167 bytes} [Thu Jul 28 10:30:05 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:06.433840 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c13859e6-fb20-432f-913c-901967dc867a tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1785666387"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:06.437707 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:06.437707 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:06.439228 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.aggregate [None req-c13859e6-fb20-432f-913c-901967dc867a tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Generated uuid a2f3597b-6f02-4425-8422-037d174f80bd for aggregate {{(pid=119464) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 10:30:06.596953 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c13859e6-fb20-432f-913c-901967dc867a tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.166991 Jul 28 10:30:06.598121 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 4/7] 10.222.0.46 () {60 vars in 1164 bytes} [Thu Jul 28 10:30:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:06.875543 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-92a973d9-25dc-449c-9676-2412bc212548 tempest-FlavorsAccessTestJSON-1520887096 tempest-FlavorsAccessTestJSON-1520887096-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1628830299/action" status: 200 len: 97 microversion: 2.1 time: 0.906455 Jul 28 10:30:06.886970 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 4/8] 10.222.0.46 () {60 vars in 1200 bytes} [Thu Jul 28 10:30:05 2022] POST /compute/v2.1/flavors/1628830299/action => generated 97 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:30:07.312242 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-89420475-43d4-416d-8236-8ed7c283be9f tempest-FlavorsV255TestJSON-235853489 tempest-FlavorsV255TestJSON-235853489-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:07.356386 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-89420475-43d4-416d-8236-8ed7c283be9f tempest-FlavorsV255TestJSON-235853489 tempest-FlavorsV255TestJSON-235853489-project] 10.222.0.46 "GET /compute/v2.1/flavors/1939838491" status: 200 len: 449 microversion: 2.55 time: 0.756225 Jul 28 10:30:07.356804 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 5/9] 10.222.0.46 () {60 vars in 1199 bytes} [Thu Jul 28 10:30:06 2022] GET /compute/v2.1/flavors/1939838491 => generated 449 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:30:07.362735 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9bdc735f-b049-4ecc-8547-4b10286fd6b2 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850468-6"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:07.370251 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:07.370251 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:07.385388 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-40adf44a-bebe-4643-8e75-9fb30d790354 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:07.401525 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9bdc735f-b049-4ecc-8547-4b10286fd6b2 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:07.405627 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9bdc735f-b049-4ecc-8547-4b10286fd6b2 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:07.452031 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-40adf44a-bebe-4643-8e75-9fb30d790354 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project] HTTP exception thrown: Flavor 1833035826 has no extra specs with key hw:cpu_thread_policy. Jul 28 10:30:07.454046 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-40adf44a-bebe-4643-8e75-9fb30d790354 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project] Request method failure captured: Jul 28 10:30:07.454046 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/flavors/1833035826/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 28 10:30:07.454046 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:30:07.454046 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:30:07.454046 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:30:07.454046 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:30:07.454046 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:30:07.454046 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:30:07.454046 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:30:07.454046 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:07.454046 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mUn1Qyu_FNcJwS0KgZtJ5Mz3r8M45GcKEISRI7L8Q7YabyCMBOo3hrq_ydEtKWBsg3dhLmIo0AcYlwHgfeNQkXLP6mbk7GgP8qHMqoSasWS96T5R5hJLrUBKpT8YPup3_Hhq9VRU-cRNmAUiDDi6o3izbAT0HPqu6T8omc0Zhec2CU Jul 28 10:30:07.454046 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:30:07.454046 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:30:07.454046 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:30:07.454046 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:30:07.454046 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:30:07.454046 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:30:07.454046 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 0c0b046329714255b518f6df2cd8e1bf Jul 28 10:30:07.454046 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 Jul 28 10:30:07.454046 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:30:07.454046 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:30:07.455150 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c0b046329714255b518f6df2cd8e1bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c0b046329714255b518f6df2cd8e1bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c0b046329714255b518f6df2cd8e1bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c0b046329714255b518f6df2cd8e1bf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:07.455150 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 Jul 28 10:30:07.455150 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 0c0b046329714255b518f6df2cd8e1bf Jul 28 10:30:07.455150 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 Jul 28 10:30:07.455150 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project Jul 28 10:30:07.455150 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:30:07.455150 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:30:07.455150 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: e10809b2c48a4af0863ca9fbf29d1099 Jul 28 10:30:07.455150 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project Jul 28 10:30:07.455150 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:30:07.455150 n-d-850468-6 devstack@n-api.service[119463]: exception: Flavor 1833035826 has no extra specs with key hw:cpu_thread_policy. Jul 28 10:30:07.455886 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'flavor_id': '1833035826', 'id': 'hw:cpu_thread_policy'} Jul 28 10:30:07.455886 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:07.455886 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:07.455886 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 28 10:30:07.455886 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 28 10:30:07.455886 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 28 10:30:07.455886 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:07.455886 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:07.455886 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:07.455886 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:07.455886 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:07.455886 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:07.455886 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:07.455886 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:07.455886 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:07.455886 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:07.455886 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 28 10:30:07.455886 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 10:30:07.455886 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1833035826 has no extra specs with key hw:cpu_thread_policy. Jul 28 10:30:07.455886 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:07.455886 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:07.455886 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:07.456961 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:07.456961 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:07.456961 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:07.456961 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:07.456961 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:07.456961 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1833035826 has no extra specs with key hw:cpu_thread_policy. Jul 28 10:30:07.456961 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:07.456961 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-40adf44a-bebe-4643-8e75-9fb30d790354 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project] Returning 404 to user: Flavor 1833035826 has no extra specs with key hw:cpu_thread_policy. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:07.456961 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-40adf44a-bebe-4643-8e75-9fb30d790354 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project] 10.222.0.46 "GET /compute/v2.1/flavors/1833035826/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.565906 Jul 28 10:30:07.465116 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 5/10] 10.222.0.46 () {58 vars in 1266 bytes} [Thu Jul 28 10:30:06 2022] GET /compute/v2.1/flavors/1833035826/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 577 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:07.824196 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-829420a9-841f-4efe-92d6-833627244f65 tempest-FlavorsAccessTestJSON-1533813784 tempest-FlavorsAccessTestJSON-1533813784-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:07.881129 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-829420a9-841f-4efe-92d6-833627244f65 tempest-FlavorsAccessTestJSON-1533813784 tempest-FlavorsAccessTestJSON-1533813784-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 6235 microversion: 2.1 time: 0.414377 Jul 28 10:30:07.882907 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 6/11] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:07 2022] GET /compute/v2.1/flavors/detail => generated 6235 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:07.888501 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ee6dcadf-d2bf-4600-8ff1-ace6fe5ee5dc tempest-FlavorsV255TestJSON-1677519663 tempest-FlavorsV255TestJSON-1677519663-project-admin] Action: 'update', calling method: .version_select at 0x7fa95a4c7430>, body: {"flavor": {"description": "new"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:07.912509 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:07.912509 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:07.945464 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ee6dcadf-d2bf-4600-8ff1-ace6fe5ee5dc tempest-FlavorsV255TestJSON-1677519663 tempest-FlavorsV255TestJSON-1677519663-project-admin] 10.222.0.46 "PUT /compute/v2.1/flavors/1939838491" status: 200 len: 450 microversion: 2.55 time: 0.061124 Jul 28 10:30:07.955071 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 7/12] 10.222.0.46 () {62 vars in 1219 bytes} [Thu Jul 28 10:30:07 2022] PUT /compute/v2.1/flavors/1939838491 => generated 450 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:30:07.980339 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b5666de8-ba6e-4502-8d61-a1c3ff4cacdb tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:07.984163 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:07.984163 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:07.986016 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-b5666de8-ba6e-4502-8d61-a1c3ff4cacdb tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'e10809b2c48a4af0863ca9fbf29d1099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0b046329714255b518f6df2cd8e1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:07.989411 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b5666de8-ba6e-4502-8d61-a1c3ff4cacdb tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project] Request method failure captured: Jul 28 10:30:07.989411 n-d-850468-6 devstack@n-api.service[119463]: request: POST /compute/v2.1/flavors/1833035826/os-extra_specs HTTP/1.1 Jul 28 10:30:07.989411 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:30:07.989411 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:30:07.989411 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:30:07.989411 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 66 Jul 28 10:30:07.989411 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:30:07.989411 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:30:07.989411 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:30:07.989411 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:07.989411 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mUn1Qyu_FNcJwS0KgZtJ5Mz3r8M45GcKEISRI7L8Q7YabyCMBOo3hrq_ydEtKWBsg3dhLmIo0AcYlwHgfeNQkXLP6mbk7GgP8qHMqoSasWS96T5R5hJLrUBKpT8YPup3_Hhq9VRU-cRNmAUiDDi6o3izbAT0HPqu6T8omc0Zhec2CU Jul 28 10:30:07.989411 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:30:07.989411 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:30:07.989411 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:30:07.989411 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:30:07.989411 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:30:07.989411 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:30:07.989411 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 0c0b046329714255b518f6df2cd8e1bf Jul 28 10:30:07.989411 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 Jul 28 10:30:07.989411 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:30:07.989411 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:30:07.991556 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c0b046329714255b518f6df2cd8e1bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c0b046329714255b518f6df2cd8e1bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c0b046329714255b518f6df2cd8e1bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c0b046329714255b518f6df2cd8e1bf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:07.991556 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 Jul 28 10:30:07.991556 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 0c0b046329714255b518f6df2cd8e1bf Jul 28 10:30:07.991556 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 Jul 28 10:30:07.991556 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project Jul 28 10:30:07.991556 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:30:07.991556 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:30:07.991556 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: e10809b2c48a4af0863ca9fbf29d1099 Jul 28 10:30:07.991556 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project Jul 28 10:30:07.991556 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:30:07.991556 n-d-850468-6 devstack@n-api.service[119463]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 28 10:30:07.991556 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:30:07.992567 n-d-850468-6 devstack@n-api.service[119463]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 28 10:30:07.992567 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'flavor_id': '1833035826', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 28 10:30:07.992567 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:07.992567 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:07.992567 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:07.992567 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:07.992567 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:07.992567 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:07.992567 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:07.992567 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:07.992567 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:07.992567 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:07.992567 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 28 10:30:07.992567 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 28 10:30:07.992567 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:30:07.992567 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:30:07.992567 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:30:07.992567 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:30:07.992567 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:07.995708 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:07.995708 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:07.995708 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:07.995708 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:30:07.995708 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:30:07.995708 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:30:07.995708 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:30:07.995708 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:30:07.995708 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:30:07.995708 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 28 10:30:07.995708 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:07.995708 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:07.995708 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:07.995708 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:07.995708 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:07.995708 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:07.995708 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:30:07.995708 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:30:07.995708 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 28 10:30:07.995708 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:08.001534 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b5666de8-ba6e-4502-8d61-a1c3ff4cacdb tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:08.006038 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b5666de8-ba6e-4502-8d61-a1c3ff4cacdb tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project] 10.222.0.46 "POST /compute/v2.1/flavors/1833035826/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.042563 Jul 28 10:30:08.007116 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 8/13] 10.222.0.46 () {60 vars in 1224 bytes} [Thu Jul 28 10:30:07 2022] POST /compute/v2.1/flavors/1833035826/os-extra_specs => generated 124 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:08.016555 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f8429d10-9a00-4fce-b77d-862eedba9a46 tempest-FlavorsAccessTestJSON-1520887096 tempest-FlavorsAccessTestJSON-1520887096-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "adbb89fe29654cf4b0f0921c79a17c93"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:08.020848 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:08.020848 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:08.671681 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f8429d10-9a00-4fce-b77d-862eedba9a46 tempest-FlavorsAccessTestJSON-1520887096 tempest-FlavorsAccessTestJSON-1520887096-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1628830299/action" status: 200 len: 21 microversion: 2.1 time: 0.661483 Jul 28 10:30:08.674323 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 9/14] 10.222.0.46 () {60 vars in 1200 bytes} [Thu Jul 28 10:30:08 2022] POST /compute/v2.1/flavors/1628830299/action => generated 21 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:30:08.689488 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a8cd0178-3a84-4aa0-a6de-9fa1b02ffaa7 tempest-FlavorsV255TestJSON-235853489 tempest-FlavorsV255TestJSON-235853489-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:08.728571 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a8cd0178-3a84-4aa0-a6de-9fa1b02ffaa7 tempest-FlavorsV255TestJSON-235853489 tempest-FlavorsV255TestJSON-235853489-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 6152 microversion: 2.55 time: 0.051471 Jul 28 10:30:08.760060 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 10/15] 10.222.0.46 () {60 vars in 1187 bytes} [Thu Jul 28 10:30:08 2022] GET /compute/v2.1/flavors/detail => generated 6152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:30:08.778991 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b0f16a74-42f1-4dc7-9853-1b12b355cb1a tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:08.888124 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b0f16a74-42f1-4dc7-9853-1b12b355cb1a tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1833035826/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.126517 Jul 28 10:30:08.891261 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 11/16] 10.222.0.46 () {60 vars in 1224 bytes} [Thu Jul 28 10:30:08 2022] POST /compute/v2.1/flavors/1833035826/os-extra_specs => generated 66 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:30:08.905082 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-49dce522-48fd-441b-929f-5c2489ed889d tempest-FlavorsAccessTestJSON-1533813784 tempest-FlavorsAccessTestJSON-1533813784-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:08.975477 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-49dce522-48fd-441b-929f-5c2489ed889d tempest-FlavorsAccessTestJSON-1533813784 tempest-FlavorsAccessTestJSON-1533813784-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.082438 Jul 28 10:30:08.978645 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 12/17] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:08 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:08.984813 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7df2fa44-d73d-49cb-b0b5-0ca4d5481ada tempest-FlavorsV255TestJSON-235853489 tempest-FlavorsV255TestJSON-235853489-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:08.991670 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9bdc735f-b049-4ecc-8547-4b10286fd6b2 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 1.632713 Jul 28 10:30:08.996704 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 6/18] 10.222.0.46 () {60 vars in 1191 bytes} [Thu Jul 28 10:30:07 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:09.005154 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5c330af3-8d91-49fa-9c33-c49558c1f5e1 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:09.008766 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:09.008766 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:09.016440 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-5c330af3-8d91-49fa-9c33-c49558c1f5e1 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'e10809b2c48a4af0863ca9fbf29d1099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0b046329714255b518f6df2cd8e1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:09.016936 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-7df2fa44-d73d-49cb-b0b5-0ca4d5481ada tempest-FlavorsV255TestJSON-235853489 tempest-FlavorsV255TestJSON-235853489-project] 10.222.0.46 "GET /compute/v2.1/flavors" status: 200 len: 3410 microversion: 2.55 time: 0.036783 Jul 28 10:30:09.017617 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 13/19] 10.222.0.46 () {60 vars in 1166 bytes} [Thu Jul 28 10:30:08 2022] GET /compute/v2.1/flavors => generated 3410 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:30:09.019813 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5c330af3-8d91-49fa-9c33-c49558c1f5e1 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project] Request method failure captured: Jul 28 10:30:09.019813 n-d-850468-6 devstack@n-api.service[119464]: request: DELETE /compute/v2.1/flavors/1833035826/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 28 10:30:09.019813 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:09.019813 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:09.019813 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:09.019813 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:30:09.019813 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:09.019813 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:09.019813 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:09.019813 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:09.019813 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mUn1Qyu_FNcJwS0KgZtJ5Mz3r8M45GcKEISRI7L8Q7YabyCMBOo3hrq_ydEtKWBsg3dhLmIo0AcYlwHgfeNQkXLP6mbk7GgP8qHMqoSasWS96T5R5hJLrUBKpT8YPup3_Hhq9VRU-cRNmAUiDDi6o3izbAT0HPqu6T8omc0Zhec2CU Jul 28 10:30:09.019813 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:09.019813 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:09.019813 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:09.019813 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:09.019813 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:09.019813 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:09.019813 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 0c0b046329714255b518f6df2cd8e1bf Jul 28 10:30:09.019813 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 Jul 28 10:30:09.019813 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:30:09.019813 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:30:09.020881 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c0b046329714255b518f6df2cd8e1bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c0b046329714255b518f6df2cd8e1bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c0b046329714255b518f6df2cd8e1bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c0b046329714255b518f6df2cd8e1bf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:09.020881 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 Jul 28 10:30:09.020881 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 0c0b046329714255b518f6df2cd8e1bf Jul 28 10:30:09.020881 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 Jul 28 10:30:09.020881 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project Jul 28 10:30:09.020881 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:09.020881 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:09.020881 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: e10809b2c48a4af0863ca9fbf29d1099 Jul 28 10:30:09.020881 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project Jul 28 10:30:09.020881 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:09.020881 n-d-850468-6 devstack@n-api.service[119464]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 28 10:30:09.021410 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'flavor_id': '1833035826', 'id': 'hw:numa_nodes'} Jul 28 10:30:09.021410 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:09.021410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:09.021410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:09.021410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:09.021410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:09.021410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:09.021410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:09.021410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:09.021410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 28 10:30:09.021410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 28 10:30:09.021410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:30:09.021410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:30:09.021410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:30:09.021410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:30:09.021410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:09.021410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:09.021410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:09.021410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:09.021410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:30:09.022565 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:30:09.022565 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:30:09.022565 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:30:09.022565 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:30:09.022565 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:30:09.022565 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 28 10:30:09.022565 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.022565 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:09.022565 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.022565 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:09.022565 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:09.022565 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:09.022565 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:30:09.022565 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:30:09.022565 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 28 10:30:09.022565 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.024731 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5c330af3-8d91-49fa-9c33-c49558c1f5e1 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:09.034366 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-5c330af3-8d91-49fa-9c33-c49558c1f5e1 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project] 10.222.0.46 "DELETE /compute/v2.1/flavors/1833035826/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.035486 Jul 28 10:30:09.035142 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 7/20] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Jul 28 10:30:08 2022] DELETE /compute/v2.1/flavors/1833035826/os-extra_specs/hw:numa_nodes => generated 124 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:09.039431 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-25201fe4-b623-4da8-a3d6-f750f53c3626 tempest-FlavorsAccessTestJSON-1520887096 tempest-FlavorsAccessTestJSON-1520887096-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:09.039431 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:09.039431 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:09.045260 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fbafa148-1df0-4dbf-b2e4-b28a987603f0 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850468-6"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:09.049628 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:09.049628 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:09.084799 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fbafa148-1df0-4dbf-b2e4-b28a987603f0 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:09.085517 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fbafa148-1df0-4dbf-b2e4-b28a987603f0 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:09.088122 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-25201fe4-b623-4da8-a3d6-f750f53c3626 tempest-FlavorsAccessTestJSON-1520887096 tempest-FlavorsAccessTestJSON-1520887096-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1628830299" status: 202 len: 0 microversion: 2.1 time: 0.055070 Jul 28 10:30:09.090277 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 14/21] 10.222.0.46 () {58 vars in 1161 bytes} [Thu Jul 28 10:30:09 2022] DELETE /compute/v2.1/flavors/1628830299 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:30:09.120150 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-44732fd6-fb7a-42b0-89ca-25a7e661e5ca tempest-FlavorsV255TestJSON-1677519663 tempest-FlavorsV255TestJSON-1677519663-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:09.146244 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-fbafa148-1df0-4dbf-b2e4-b28a987603f0 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-850468-6. Jul 28 10:30:09.172360 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-44732fd6-fb7a-42b0-89ca-25a7e661e5ca tempest-FlavorsV255TestJSON-1677519663 tempest-FlavorsV255TestJSON-1677519663-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1939838491" status: 202 len: 0 microversion: 2.55 time: 0.078844 Jul 28 10:30:09.179387 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 15/22] 10.222.0.46 () {60 vars in 1202 bytes} [Thu Jul 28 10:30:09 2022] DELETE /compute/v2.1/flavors/1939838491 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:30:09.186217 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-bba93434-0ab5-4a57-9509-45d5ae23e284 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:09.188073 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fbafa148-1df0-4dbf-b2e4-b28a987603f0 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Request method failure captured: Jul 28 10:30:09.188073 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Jul 28 10:30:09.188073 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:09.188073 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:09.188073 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:09.188073 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 39 Jul 28 10:30:09.188073 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:09.188073 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:09.188073 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:09.188073 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:09.188073 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mUrvnOKR7s2erMDEF-eWgoTtWeskMcU69AoBqvQ_ggKW-ftZgGFq0vfovDXBWVUghxdR3AJNICypBkFp2gZ25pv8tI_HqVAIgT-bk3pLUGrKlaztDyIl6elwzgiOj9t7pS2mwD6DbypP9_TCjoLU0VdJME_2bI8gUmZmVtSdtD3Uiw Jul 28 10:30:09.188073 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:09.188073 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:09.188073 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:09.188073 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:09.188073 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:09.188073 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:09.188073 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 5b3cdc506169435795c2c4ff25801a89 Jul 28 10:30:09.188073 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:09.188073 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:30:09.188073 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:30:09.189293 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5b3cdc506169435795c2c4ff25801a89", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:09.189293 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:09.189293 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 5b3cdc506169435795c2c4ff25801a89 Jul 28 10:30:09.189293 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:09.189293 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin Jul 28 10:30:09.189293 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:09.189293 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:09.189293 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 7eb41802201e494bb70118c7ba700376 Jul 28 10:30:09.189293 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin Jul 28 10:30:09.189293 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:30:09.189293 n-d-850468-6 devstack@n-api.service[119464]: {"add_host": {"host": "n-h2-850468-6"}} Jul 28 10:30:09.189293 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:09.189293 n-d-850468-6 devstack@n-api.service[119464]: exception: Aggregate 1 already has host n-h2-850468-6. Jul 28 10:30:09.190074 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-850468-6'}}} Jul 28 10:30:09.190074 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:09.190074 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:09.190074 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 10:30:09.190074 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 28 10:30:09.190074 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 10:30:09.190074 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 28 10:30:09.190074 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 10:30:09.190074 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 28 10:30:09.190074 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 10:30:09.190074 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 28 10:30:09.190074 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 10:30:09.190074 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 10:30:09.190074 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 10:30:09.190074 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result.read() Jul 28 10:30:09.190074 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 10:30:09.190074 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 28 10:30:09.190074 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 10:30:09.190074 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 28 10:30:09.191005 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 10:30:09.191005 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 28 10:30:09.191005 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 10:30:09.191005 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 28 10:30:09.191005 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-850468-6-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 28 10:30:09.191005 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.191005 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 28 10:30:09.191005 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.191005 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:09.191005 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 28 10:30:09.191005 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 28 10:30:09.191005 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 28 10:30:09.191005 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi session.flush() Jul 28 10:30:09.191005 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 10:30:09.191005 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 28 10:30:09.191005 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 10:30:09.191005 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 28 10:30:09.191005 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 10:30:09.191005 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 28 10:30:09.192110 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 10:30:09.192110 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception Jul 28 10:30:09.192110 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 10:30:09.192110 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 28 10:30:09.192110 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 10:30:09.192110 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 28 10:30:09.192110 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 10:30:09.192110 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 28 10:30:09.192110 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 10:30:09.192110 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 28 10:30:09.192110 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 10:30:09.192110 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 28 10:30:09.192110 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 10:30:09.192110 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 10:30:09.192110 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 10:30:09.192110 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 28 10:30:09.192110 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 10:30:09.192110 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 28 10:30:09.193291 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 10:30:09.193291 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 28 10:30:09.193291 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 10:30:09.193291 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 10:30:09.193291 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 10:30:09.193291 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception Jul 28 10:30:09.193291 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 10:30:09.193291 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 28 10:30:09.193291 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 10:30:09.193291 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 28 10:30:09.193291 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 10:30:09.193291 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 28 10:30:09.193291 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 10:30:09.193291 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 28 10:30:09.193291 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 10:30:09.193291 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 10:30:09.193291 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 10:30:09.193291 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result.read() Jul 28 10:30:09.195251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 10:30:09.195251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 28 10:30:09.195251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 10:30:09.195251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 28 10:30:09.195251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 10:30:09.195251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 28 10:30:09.195251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 10:30:09.195251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 28 10:30:09.195251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-850468-6-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 28 10:30:09.195251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 28 10:30:09.195251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 28, 10, 30, 9, 121929), 'updated_at': None, 'host': 'n-h2-850468-6', 'aggregate_id': 1}] Jul 28 10:30:09.195251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 10:30:09.195251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.195251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:09.195251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.195251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:09.195251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 28 10:30:09.197831 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 28 10:30:09.197831 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 10:30:09.197831 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 10:30:09.197831 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:09.197831 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:09.197831 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:09.197831 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:09.197831 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 10:30:09.197831 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 10:30:09.197831 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6595, in add_host_to_aggregate Jul 28 10:30:09.197831 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 28 10:30:09.197831 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 28 10:30:09.197831 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 28 10:30:09.197831 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 28 10:30:09.197831 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 28 10:30:09.197831 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 28 10:30:09.197831 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 28 10:30:09.197831 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-850468-6. Jul 28 10:30:09.197831 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.197831 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:09.201938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.201938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:09.201938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:09.201938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:09.201938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:09.201938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:09.201938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:09.201938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:09.201938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:09.201938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:09.201938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 28 10:30:09.201938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 28 10:30:09.201938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-850468-6. Jul 28 10:30:09.201938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.201938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:09.201938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.201938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:09.201938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:09.201938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:09.201938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:09.201938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:09.204558 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-850468-6. Jul 28 10:30:09.204558 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.204558 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fbafa148-1df0-4dbf-b2e4-b28a987603f0 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-850468-6. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:09.204558 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-fbafa148-1df0-4dbf-b2e4-b28a987603f0 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.148179 Jul 28 10:30:09.204558 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 8/23] 10.222.0.46 () {60 vars in 1191 bytes} [Thu Jul 28 10:30:09 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 162 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 28 10:30:09.224595 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ce0ffff8-5879-44a4-ba2c-caa47d9e8327 tempest-FlavorsAccessTestJSON-1520887096 tempest-FlavorsAccessTestJSON-1520887096-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:09.266325 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-bba93434-0ab5-4a57-9509-45d5ae23e284 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1833035826/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.085154 Jul 28 10:30:09.268548 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 16/24] 10.222.0.46 () {60 vars in 1224 bytes} [Thu Jul 28 10:30:09 2022] POST /compute/v2.1/flavors/1833035826/os-extra_specs => generated 66 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:30:09.288050 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-31b2f213-46bf-4c48-bf0e-f82e928fe03d tempest-FlavorsV255TestJSON-1677519663 tempest-FlavorsV255TestJSON-1677519663-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:09.386282 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-31b2f213-46bf-4c48-bf0e-f82e928fe03d tempest-FlavorsV255TestJSON-1677519663 tempest-FlavorsV255TestJSON-1677519663-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5712 microversion: 2.55 time: 0.114529 Jul 28 10:30:09.402054 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ce0ffff8-5879-44a4-ba2c-caa47d9e8327 tempest-FlavorsAccessTestJSON-1520887096 tempest-FlavorsAccessTestJSON-1520887096-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.184336 Jul 28 10:30:09.403964 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 9/25] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:09 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:09.406505 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 17/26] 10.222.0.46 () {60 vars in 1187 bytes} [Thu Jul 28 10:30:09 2022] GET /compute/v2.1/flavors/detail => generated 5712 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:30:09.412847 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-aa7fbd22-e668-4b16-9fb5-961417686f61 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:09.417569 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:09.417569 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:09.419181 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-aa7fbd22-e668-4b16-9fb5-961417686f61 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'e10809b2c48a4af0863ca9fbf29d1099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0b046329714255b518f6df2cd8e1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:09.421705 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-aa7fbd22-e668-4b16-9fb5-961417686f61 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project] Request method failure captured: Jul 28 10:30:09.421705 n-d-850468-6 devstack@n-api.service[119463]: request: PUT /compute/v2.1/flavors/1833035826/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 28 10:30:09.421705 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:30:09.421705 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:30:09.421705 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:30:09.421705 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 22 Jul 28 10:30:09.421705 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:30:09.421705 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:30:09.421705 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:30:09.421705 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:09.421705 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mUn1Qyu_FNcJwS0KgZtJ5Mz3r8M45GcKEISRI7L8Q7YabyCMBOo3hrq_ydEtKWBsg3dhLmIo0AcYlwHgfeNQkXLP6mbk7GgP8qHMqoSasWS96T5R5hJLrUBKpT8YPup3_Hhq9VRU-cRNmAUiDDi6o3izbAT0HPqu6T8omc0Zhec2CU Jul 28 10:30:09.421705 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:30:09.421705 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:30:09.421705 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:30:09.421705 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:30:09.421705 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:30:09.421705 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:30:09.421705 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 0c0b046329714255b518f6df2cd8e1bf Jul 28 10:30:09.421705 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 Jul 28 10:30:09.421705 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:30:09.421705 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:30:09.423015 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c0b046329714255b518f6df2cd8e1bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c0b046329714255b518f6df2cd8e1bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c0b046329714255b518f6df2cd8e1bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c0b046329714255b518f6df2cd8e1bf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:09.423015 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 Jul 28 10:30:09.423015 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 0c0b046329714255b518f6df2cd8e1bf Jul 28 10:30:09.423015 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 Jul 28 10:30:09.423015 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project Jul 28 10:30:09.423015 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:30:09.423015 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:30:09.423015 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: e10809b2c48a4af0863ca9fbf29d1099 Jul 28 10:30:09.423015 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project Jul 28 10:30:09.423015 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:30:09.423015 n-d-850468-6 devstack@n-api.service[119463]: {"hw:numa_nodes": "1"} Jul 28 10:30:09.423015 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:30:09.423015 n-d-850468-6 devstack@n-api.service[119463]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 28 10:30:09.424286 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'flavor_id': '1833035826', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 28 10:30:09.424286 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:09.424286 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:09.424286 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:09.424286 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:09.424286 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:09.424286 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:09.424286 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:09.424286 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:09.424286 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:09.424286 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:09.424286 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 28 10:30:09.424286 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 28 10:30:09.424286 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:30:09.424286 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:30:09.424286 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:30:09.424286 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:30:09.424286 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:09.424286 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:09.425173 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:09.425173 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:09.425173 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:30:09.425173 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:30:09.425173 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:30:09.425173 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:30:09.425173 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:30:09.425173 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:30:09.425173 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 28 10:30:09.425173 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.425173 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:09.425173 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.425173 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:09.425173 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:09.425173 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:09.425173 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:30:09.425173 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:30:09.425173 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 28 10:30:09.425173 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.427432 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-aa7fbd22-e668-4b16-9fb5-961417686f61 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:09.427617 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-3427f110-01fa-4abf-8409-4bc28c58b0e0 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850468-6"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:09.428744 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-aa7fbd22-e668-4b16-9fb5-961417686f61 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173 tempest-FlavorsExtraSpecsNegativeTestJSON-1057709173-project] 10.222.0.46 "PUT /compute/v2.1/flavors/1833035826/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.020587 Jul 28 10:30:09.431053 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:09.431053 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:09.435246 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 18/27] 10.222.0.46 () {60 vars in 1265 bytes} [Thu Jul 28 10:30:09 2022] PUT /compute/v2.1/flavors/1833035826/os-extra_specs/hw:numa_nodes => generated 124 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:09.441664 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1a25ac85-cd07-48a3-84e4-6df82c0ba56e tempest-FlavorsAccessTestJSON-1520887096 tempest-FlavorsAccessTestJSON-1520887096-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-16593517", "id": 584580102, "os-flavor-access:is_public": "False"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:09.447612 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3427f110-01fa-4abf-8409-4bc28c58b0e0 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:09.456360 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3427f110-01fa-4abf-8409-4bc28c58b0e0 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:09.481371 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-1a25ac85-cd07-48a3-84e4-6df82c0ba56e tempest-FlavorsAccessTestJSON-1520887096 tempest-FlavorsAccessTestJSON-1520887096-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.042745 Jul 28 10:30:09.482776 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 19/28] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:09 2022] POST /compute/v2.1/flavors => generated 426 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:09.496890 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e131ef9f-96c7-4e84-85db-251fed01a5e5 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:09.497081 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:09.497081 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:09.513774 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-e131ef9f-96c7-4e84-85db-251fed01a5e5 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] HTTP exception thrown: Flavor 1833035826 has no extra specs with key hw:cpu_thread_policy. Jul 28 10:30:09.515540 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e131ef9f-96c7-4e84-85db-251fed01a5e5 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] Request method failure captured: Jul 28 10:30:09.515540 n-d-850468-6 devstack@n-api.service[119463]: request: DELETE /compute/v2.1/flavors/1833035826/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 28 10:30:09.515540 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:30:09.515540 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:30:09.515540 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:30:09.515540 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:30:09.515540 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:30:09.515540 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:30:09.515540 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:30:09.515540 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:09.515540 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mUsBXIaO7rAPnTd0nug6S7HcmQ4uLHdOpkQnwyFlO_wFcUC9G-iQcf1MV4Y-IOQ0Q8x4g0twb_95IMFAmKzcqOoJpbFk9TijoHvmxhTxoke6JxR3ekMZl36Ui9KhvlhKRlHJTZ3HV3OukWwSX9xi87Zb4NeAKGW65IVTOBfYZIorsw Jul 28 10:30:09.515540 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:30:09.515540 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:30:09.515540 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:30:09.515540 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:30:09.515540 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:30:09.515540 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:30:09.515540 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: f90681844fc34ca99ea69af1b3225dc6 Jul 28 10:30:09.515540 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 Jul 28 10:30:09.515540 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member,admin Jul 28 10:30:09.515540 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member,admin Jul 28 10:30:09.516606 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f90681844fc34ca99ea69af1b3225dc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f90681844fc34ca99ea69af1b3225dc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f90681844fc34ca99ea69af1b3225dc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f90681844fc34ca99ea69af1b3225dc6", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:09.516606 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 Jul 28 10:30:09.516606 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: f90681844fc34ca99ea69af1b3225dc6 Jul 28 10:30:09.516606 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 Jul 28 10:30:09.516606 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin Jul 28 10:30:09.516606 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:30:09.516606 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:30:09.516606 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: e3be71e0df7c449fb80bfa4ba5bbb008 Jul 28 10:30:09.516606 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin Jul 28 10:30:09.516606 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:30:09.516606 n-d-850468-6 devstack@n-api.service[119463]: exception: Flavor 1833035826 has no extra specs with key hw:cpu_thread_policy. Jul 28 10:30:09.517228 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'flavor_id': '1833035826', 'id': 'hw:cpu_thread_policy'} Jul 28 10:30:09.517228 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:09.517228 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:09.517228 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 28 10:30:09.517228 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 28 10:30:09.517228 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 28 10:30:09.517228 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.517228 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:09.517228 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.517228 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:09.517228 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:09.517228 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:09.517228 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:09.517228 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:09.517228 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:09.517228 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:09.517228 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 28 10:30:09.517228 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 10:30:09.517228 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1833035826 has no extra specs with key hw:cpu_thread_policy. Jul 28 10:30:09.517228 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.517228 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:09.517228 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.519838 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:09.519838 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:09.519838 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:09.519838 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:09.519838 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:09.519838 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1833035826 has no extra specs with key hw:cpu_thread_policy. Jul 28 10:30:09.519838 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.519838 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e131ef9f-96c7-4e84-85db-251fed01a5e5 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] Returning 404 to user: Flavor 1833035826 has no extra specs with key hw:cpu_thread_policy. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:09.519838 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e131ef9f-96c7-4e84-85db-251fed01a5e5 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1833035826/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.025187 Jul 28 10:30:09.519838 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 20/29] 10.222.0.46 () {58 vars in 1269 bytes} [Thu Jul 28 10:30:09 2022] DELETE /compute/v2.1/flavors/1833035826/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:09.523474 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-389874c9-3980-4877-b7ef-90f9b3494e77 tempest-FlavorsAccessTestJSON-1520887096 tempest-FlavorsAccessTestJSON-1520887096-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:09.526501 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:09.526501 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:09.543410 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-389874c9-3980-4877-b7ef-90f9b3494e77 tempest-FlavorsAccessTestJSON-1520887096 tempest-FlavorsAccessTestJSON-1520887096-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/584580102/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.024216 Jul 28 10:30:09.545168 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 21/30] 10.222.0.46 () {58 vars in 1206 bytes} [Thu Jul 28 10:30:09 2022] GET /compute/v2.1/flavors/584580102/os-flavor-access => generated 21 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:30:09.561891 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d194eb80-3e3d-46eb-9eaa-b62a84f9efc5 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:09.573717 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-d194eb80-3e3d-46eb-9eaa-b62a84f9efc5 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 28 10:30:09.576190 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d194eb80-3e3d-46eb-9eaa-b62a84f9efc5 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] Request method failure captured: Jul 28 10:30:09.576190 n-d-850468-6 devstack@n-api.service[119463]: request: PUT /compute/v2.1/flavors/1833035826/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 28 10:30:09.576190 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:30:09.576190 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:30:09.576190 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:30:09.576190 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 27 Jul 28 10:30:09.576190 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:30:09.576190 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:30:09.576190 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:30:09.576190 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:09.576190 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mUsBXIaO7rAPnTd0nug6S7HcmQ4uLHdOpkQnwyFlO_wFcUC9G-iQcf1MV4Y-IOQ0Q8x4g0twb_95IMFAmKzcqOoJpbFk9TijoHvmxhTxoke6JxR3ekMZl36Ui9KhvlhKRlHJTZ3HV3OukWwSX9xi87Zb4NeAKGW65IVTOBfYZIorsw Jul 28 10:30:09.576190 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:30:09.576190 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:30:09.576190 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:30:09.576190 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:30:09.576190 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:30:09.576190 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:30:09.576190 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: f90681844fc34ca99ea69af1b3225dc6 Jul 28 10:30:09.576190 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 Jul 28 10:30:09.576190 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member,admin Jul 28 10:30:09.576190 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member,admin Jul 28 10:30:09.577446 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f90681844fc34ca99ea69af1b3225dc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f90681844fc34ca99ea69af1b3225dc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f90681844fc34ca99ea69af1b3225dc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f90681844fc34ca99ea69af1b3225dc6", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:09.577446 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 Jul 28 10:30:09.577446 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: f90681844fc34ca99ea69af1b3225dc6 Jul 28 10:30:09.577446 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 Jul 28 10:30:09.577446 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin Jul 28 10:30:09.577446 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:30:09.577446 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:30:09.577446 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: e3be71e0df7c449fb80bfa4ba5bbb008 Jul 28 10:30:09.577446 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin Jul 28 10:30:09.577446 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:30:09.577446 n-d-850468-6 devstack@n-api.service[119463]: {"hw:cpu_policy": "shared"} Jul 28 10:30:09.577446 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:30:09.577446 n-d-850468-6 devstack@n-api.service[119463]: exception: Request body and URI mismatch Jul 28 10:30:09.578162 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'flavor_id': '1833035826', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 28 10:30:09.578162 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:09.578162 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:09.578162 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:09.578162 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:09.578162 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:09.578162 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:09.578162 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:09.578162 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:09.578162 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:09.578162 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:09.578162 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 28 10:30:09.578162 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 28 10:30:09.578162 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 28 10:30:09.578162 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.578162 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:09.578162 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.578162 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:09.578162 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:09.578162 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:09.579236 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:09.579236 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:09.579236 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 28 10:30:09.579236 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.579236 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d194eb80-3e3d-46eb-9eaa-b62a84f9efc5 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:09.582286 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d194eb80-3e3d-46eb-9eaa-b62a84f9efc5 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] 10.222.0.46 "PUT /compute/v2.1/flavors/1833035826/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.019548 Jul 28 10:30:09.588897 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 22/31] 10.222.0.46 () {60 vars in 1265 bytes} [Thu Jul 28 10:30:09 2022] PUT /compute/v2.1/flavors/1833035826/os-extra_specs/hw:numa_nodes => generated 73 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 10:30:09.595261 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-228cfd94-2ef5-4646-9607-46f00fcecf37 tempest-FlavorsAccessTestJSON-1520887096 tempest-FlavorsAccessTestJSON-1520887096-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:09.714036 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-228cfd94-2ef5-4646-9607-46f00fcecf37 tempest-FlavorsAccessTestJSON-1520887096 tempest-FlavorsAccessTestJSON-1520887096-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/584580102" status: 202 len: 0 microversion: 2.1 time: 0.125088 Jul 28 10:30:09.714919 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 23/32] 10.222.0.46 () {58 vars in 1158 bytes} [Thu Jul 28 10:30:09 2022] DELETE /compute/v2.1/flavors/584580102 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:30:09.745613 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-29d0445b-4f91-450f-9421-d4c8fa78205b tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:09.763996 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-29d0445b-4f91-450f-9421-d4c8fa78205b tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] Request method failure captured: Jul 28 10:30:09.763996 n-d-850468-6 devstack@n-api.service[119463]: request: PUT /compute/v2.1/flavors/1833035826/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 28 10:30:09.763996 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:30:09.763996 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:30:09.763996 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:30:09.763996 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 49 Jul 28 10:30:09.763996 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:30:09.763996 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:30:09.763996 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:30:09.763996 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:09.763996 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mUsBXIaO7rAPnTd0nug6S7HcmQ4uLHdOpkQnwyFlO_wFcUC9G-iQcf1MV4Y-IOQ0Q8x4g0twb_95IMFAmKzcqOoJpbFk9TijoHvmxhTxoke6JxR3ekMZl36Ui9KhvlhKRlHJTZ3HV3OukWwSX9xi87Zb4NeAKGW65IVTOBfYZIorsw Jul 28 10:30:09.763996 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:30:09.763996 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:30:09.763996 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:30:09.763996 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:30:09.763996 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:30:09.763996 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:30:09.763996 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: f90681844fc34ca99ea69af1b3225dc6 Jul 28 10:30:09.763996 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 Jul 28 10:30:09.763996 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member,admin Jul 28 10:30:09.763996 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member,admin Jul 28 10:30:09.765330 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f90681844fc34ca99ea69af1b3225dc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f90681844fc34ca99ea69af1b3225dc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f90681844fc34ca99ea69af1b3225dc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f90681844fc34ca99ea69af1b3225dc6", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:09.765330 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 Jul 28 10:30:09.765330 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: f90681844fc34ca99ea69af1b3225dc6 Jul 28 10:30:09.765330 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 Jul 28 10:30:09.765330 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin Jul 28 10:30:09.765330 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:30:09.765330 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:30:09.765330 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: e3be71e0df7c449fb80bfa4ba5bbb008 Jul 28 10:30:09.765330 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin Jul 28 10:30:09.765330 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:30:09.765330 n-d-850468-6 devstack@n-api.service[119463]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 28 10:30:09.765330 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:30:09.766318 n-d-850468-6 devstack@n-api.service[119463]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 28 10:30:09.766318 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'flavor_id': '1833035826', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 28 10:30:09.766318 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:09.766318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:09.766318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 10:30:09.766318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 10:30:09.766318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 10:30:09.766318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise error Jul 28 10:30:09.766318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 28 10:30:09.766318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.766318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 28 10:30:09.766318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 28 10:30:09.766318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 28 10:30:09.766318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 28 10:30:09.766318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 28 10:30:09.766318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 28 10:30:09.766318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 28 10:30:09.766318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 28 10:30:09.766318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.766318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi On instance: Jul 28 10:30:09.766318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 28 10:30:09.766318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.767653 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:09.767653 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.767653 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:09.767653 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:09.767653 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:09.767653 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:09.767653 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:09.767653 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:09.767653 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:09.767653 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 10:30:09.767653 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 10:30:09.767653 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 10:30:09.767653 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 10:30:09.767653 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 10:30:09.767653 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 10:30:09.767653 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 28 10:30:09.767653 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.767653 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:09.767653 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.767653 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:09.768885 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:09.768885 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:09.768885 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 10:30:09.768885 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 10:30:09.768885 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 28 10:30:09.768885 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:09.773665 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-29d0445b-4f91-450f-9421-d4c8fa78205b tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:09.777001 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-29d0445b-4f91-450f-9421-d4c8fa78205b tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] 10.222.0.46 "PUT /compute/v2.1/flavors/1833035826/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.056106 Jul 28 10:30:09.779277 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 24/33] 10.222.0.46 () {60 vars in 1265 bytes} [Thu Jul 28 10:30:09 2022] PUT /compute/v2.1/flavors/1833035826/os-extra_specs/hw:numa_nodes => generated 117 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:30:09.795295 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-db57b60a-a621-4fb9-9673-abae5405e7fb tempest-FlavorsAccessTestJSON-1520887096 tempest-FlavorsAccessTestJSON-1520887096-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:09.823241 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-3427f110-01fa-4abf-8409-4bc28c58b0e0 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.417189 Jul 28 10:30:09.824197 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 10/34] 10.222.0.46 () {60 vars in 1191 bytes} [Thu Jul 28 10:30:09 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:09.832936 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-123de6f4-f667-49a8-93cf-71e02f28c7f6 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:09.839337 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:09.839337 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:09.871868 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-db57b60a-a621-4fb9-9673-abae5405e7fb tempest-FlavorsAccessTestJSON-1520887096 tempest-FlavorsAccessTestJSON-1520887096-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.091229 Jul 28 10:30:09.874760 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 25/35] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:09 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:09.886934 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-998f6698-58ba-4b82-8d3f-8902607beb11 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:09.888204 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:09.888204 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:09.924718 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-123de6f4-f667-49a8-93cf-71e02f28c7f6 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1833035826" status: 202 len: 0 microversion: 2.1 time: 0.096937 Jul 28 10:30:09.929488 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 11/36] 10.222.0.46 () {58 vars in 1161 bytes} [Thu Jul 28 10:30:09 2022] DELETE /compute/v2.1/flavors/1833035826 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:30:09.952665 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e17b6f6e-cd97-4bb0-9e0d-9bf3871291b2 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:09.985986 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e17b6f6e-cd97-4bb0-9e0d-9bf3871291b2 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421 tempest-FlavorsExtraSpecsNegativeTestJSON-1993374421-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050114 Jul 28 10:30:09.987076 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 12/37] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:10.057064 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-998f6698-58ba-4b82-8d3f-8902607beb11 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.180949 Jul 28 10:30:10.057717 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 26/38] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:30:09 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 10:30:10.069503 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-69ce132c-ab18-4e26-8af8-f6022494883c tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1159372393"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:10.073314 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:10.073314 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:10.075242 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.aggregate [None req-69ce132c-ab18-4e26-8af8-f6022494883c tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Generated uuid 7f2a2de5-1e0e-4fc7-bb70-052ba6968fee for aggregate {{(pid=119464) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 10:30:10.095469 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-51d511ee-1c73-4e8b-8feb-a317380515fb tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1344211254", "name": "tempest-test_aggregate-101009119"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:10.125468 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:10.125468 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:10.126105 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-69ce132c-ab18-4e26-8af8-f6022494883c tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.062565 Jul 28 10:30:10.127142 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.aggregate [None req-51d511ee-1c73-4e8b-8feb-a317380515fb tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Generated uuid eddb4c98-fffd-4c35-857d-cfaf1c9606ea for aggregate {{(pid=119463) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 10:30:10.131808 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=12,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:10.133308 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 13/39] 10.222.0.46 () {60 vars in 1164 bytes} [Thu Jul 28 10:30:10 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:10.195995 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-51d511ee-1c73-4e8b-8feb-a317380515fb tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.105122 Jul 28 10:30:10.213995 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 27/40] 10.222.0.46 () {60 vars in 1165 bytes} [Thu Jul 28 10:30:10 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:10.849062 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1d29eef9-c50a-4718-bd7e-df97631226cf tempest-AZAdminV2TestJSON-1483713741 tempest-AZAdminV2TestJSON-1483713741-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:10.850940 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1d29eef9-c50a-4718-bd7e-df97631226cf tempest-AZAdminV2TestJSON-1483713741 tempest-AZAdminV2TestJSON-1483713741-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:10.851397 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1d29eef9-c50a-4718-bd7e-df97631226cf tempest-AZAdminV2TestJSON-1483713741 tempest-AZAdminV2TestJSON-1483713741-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:10.853453 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1d29eef9-c50a-4718-bd7e-df97631226cf tempest-AZAdminV2TestJSON-1483713741 tempest-AZAdminV2TestJSON-1483713741-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:10.853997 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1d29eef9-c50a-4718-bd7e-df97631226cf tempest-AZAdminV2TestJSON-1483713741 tempest-AZAdminV2TestJSON-1483713741-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:10.933113 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1d29eef9-c50a-4718-bd7e-df97631226cf tempest-AZAdminV2TestJSON-1483713741 tempest-AZAdminV2TestJSON-1483713741-project-admin] 10.222.0.46 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.794198 Jul 28 10:30:10.939236 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 14/41] 10.222.0.46 () {58 vars in 1164 bytes} [Thu Jul 28 10:30:10 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:30:10.948678 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0a1c211a-4f86-4d32-b6b1-13be86b0fa3b tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850468-6"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:10.949605 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1f08109c-13e7-47ab-806f-7aa2d8ca01e4 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:10.950413 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:10.950413 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:10.958428 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:10.958428 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:10.959655 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-0a1c211a-4f86-4d32-b6b1-13be86b0fa3b tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '2409deb675254c8492a2846e0b412b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b6e6a2a1a14fc68b2b68160dcc4fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:10.972353 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0a1c211a-4f86-4d32-b6b1-13be86b0fa3b tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Request method failure captured: Jul 28 10:30:10.972353 n-d-850468-6 devstack@n-api.service[119463]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Jul 28 10:30:10.972353 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:30:10.972353 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:30:10.972353 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:30:10.972353 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 39 Jul 28 10:30:10.972353 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:30:10.972353 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:30:10.972353 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:30:10.972353 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:10.972353 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mUnnfwbbgEOZuTyUOrQC1OG4JPY2VBaSE6jueEG1VMO2NkmEr7V54P067GU_ND2qYgL2I6H3JhVBbn6i34O3cEjvIXgzm41lDv-e2YAXj0PKOpa9aVBfniDm_-ZMX65gjq-HbKuwPHruoDgD02OEZXN34MeHuTFc7uhfJYnmbZtm2Y Jul 28 10:30:10.972353 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:30:10.972353 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:30:10.972353 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:30:10.972353 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:30:10.972353 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:30:10.972353 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:30:10.972353 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 66b6e6a2a1a14fc68b2b68160dcc4fa3 Jul 28 10:30:10.972353 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-807240337 Jul 28 10:30:10.972353 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:30:10.972353 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:30:10.973651 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/66b6e6a2a1a14fc68b2b68160dcc4fa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66b6e6a2a1a14fc68b2b68160dcc4fa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66b6e6a2a1a14fc68b2b68160dcc4fa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_66b6e6a2a1a14fc68b2b68160dcc4fa3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:10.973651 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-807240337 Jul 28 10:30:10.973651 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 66b6e6a2a1a14fc68b2b68160dcc4fa3 Jul 28 10:30:10.973651 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-807240337 Jul 28 10:30:10.973651 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-AggregatesAdminNegativeTestJSON-807240337-project Jul 28 10:30:10.973651 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:30:10.973651 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:30:10.973651 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 2409deb675254c8492a2846e0b412b73 Jul 28 10:30:10.973651 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-807240337-project Jul 28 10:30:10.973651 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:30:10.973651 n-d-850468-6 devstack@n-api.service[119463]: {"add_host": {"host": "n-h2-850468-6"}} Jul 28 10:30:10.973651 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:30:10.973651 n-d-850468-6 devstack@n-api.service[119463]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 28 10:30:10.974556 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-850468-6'}}} Jul 28 10:30:10.974556 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:10.974556 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:10.974556 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:10.974556 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:10.974556 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:10.974556 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:10.974556 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:10.974556 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:10.974556 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:10.974556 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:10.974556 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 28 10:30:10.974556 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 28 10:30:10.974556 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:30:10.974556 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:30:10.974556 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:30:10.974556 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:30:10.974556 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:10.974556 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:10.975436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:10.975436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:10.975436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:30:10.975436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:30:10.975436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:30:10.975436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:30:10.975436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:30:10.975436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:30:10.975436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 28 10:30:10.975436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:10.975436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:10.975436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:10.975436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:10.975436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:10.975436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:10.975436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:30:10.975436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:30:10.975436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 28 10:30:10.975436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:10.979708 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0a1c211a-4f86-4d32-b6b1-13be86b0fa3b tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:10.979708 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-0a1c211a-4f86-4d32-b6b1-13be86b0fa3b tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] 10.222.0.46 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.758567 Jul 28 10:30:10.984388 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1f08109c-13e7-47ab-806f-7aa2d8ca01e4 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 200 len: 516 microversion: 2.1 time: 0.044018 Jul 28 10:30:10.984984 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 15/42] 10.222.0.46 () {58 vars in 1143 bytes} [Thu Jul 28 10:30:10 2022] GET /compute/v2.1/os-aggregates => generated 516 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:10.986479 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 28/43] 10.222.0.46 () {60 vars in 1191 bytes} [Thu Jul 28 10:30:10 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 772 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:10.996742 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c354de26-aae7-4ab0-8771-c3604c58da00 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:10.997706 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:10.997706 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:11.001994 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-93719491-caea-4ca4-abcd-af95d3afb307 tempest-AZAdminV2TestJSON-1483713741 tempest-AZAdminV2TestJSON-1483713741-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:11.002822 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:11.002822 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:11.004001 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-93719491-caea-4ca4-abcd-af95d3afb307 tempest-AZAdminV2TestJSON-1483713741 tempest-AZAdminV2TestJSON-1483713741-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:11.004461 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-93719491-caea-4ca4-abcd-af95d3afb307 tempest-AZAdminV2TestJSON-1483713741 tempest-AZAdminV2TestJSON-1483713741-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:11.005282 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-93719491-caea-4ca4-abcd-af95d3afb307 tempest-AZAdminV2TestJSON-1483713741 tempest-AZAdminV2TestJSON-1483713741-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:11.005721 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-93719491-caea-4ca4-abcd-af95d3afb307 tempest-AZAdminV2TestJSON-1483713741 tempest-AZAdminV2TestJSON-1483713741-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:11.035889 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c354de26-aae7-4ab0-8771-c3604c58da00 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.047001 Jul 28 10:30:11.036658 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 29/44] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:30:10 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 10:30:11.048984 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-00476926-2cf8-4517-b0f6-f51a485ae071 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850468-6"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:11.058019 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:11.058019 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:11.082291 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-93719491-caea-4ca4-abcd-af95d3afb307 tempest-AZAdminV2TestJSON-1483713741 tempest-AZAdminV2TestJSON-1483713741-project-admin] 10.222.0.46 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.094553 Jul 28 10:30:11.086135 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 16/45] 10.222.0.46 () {58 vars in 1185 bytes} [Thu Jul 28 10:30:10 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:11.098606 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ca293a67-140e-41a1-87c7-7bf1e5b247cf tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1018850945"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:11.099664 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-00476926-2cf8-4517-b0f6-f51a485ae071 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:11.101318 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:11.101318 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:11.101968 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-00476926-2cf8-4517-b0f6-f51a485ae071 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:11.103695 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.aggregate [None req-ca293a67-140e-41a1-87c7-7bf1e5b247cf tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Generated uuid e2069e53-fe7a-47a6-a19c-fbb7f2765cd1 for aggregate {{(pid=119464) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 10:30:11.162288 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ca293a67-140e-41a1-87c7-7bf1e5b247cf tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.072870 Jul 28 10:30:11.171910 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 17/46] 10.222.0.46 () {60 vars in 1164 bytes} [Thu Jul 28 10:30:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:11.180526 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fbd40e5d-b85b-4a3b-a94a-a60c819b9b7a tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1063530281"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:11.189016 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:11.189016 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:11.209632 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fbd40e5d-b85b-4a3b-a94a-a60c819b9b7a tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:11.218632 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fbd40e5d-b85b-4a3b-a94a-a60c819b9b7a tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:11.255859 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fbd40e5d-b85b-4a3b-a94a-a60c819b9b7a tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:11.256350 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fbd40e5d-b85b-4a3b-a94a-a60c819b9b7a tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:11.286599 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-fbd40e5d-b85b-4a3b-a94a-a60c819b9b7a tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1063530281 could not be found. Jul 28 10:30:11.296618 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fbd40e5d-b85b-4a3b-a94a-a60c819b9b7a tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Request method failure captured: Jul 28 10:30:11.296618 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Jul 28 10:30:11.296618 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:11.296618 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:11.296618 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:11.296618 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 58 Jul 28 10:30:11.296618 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:11.296618 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:11.296618 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:11.296618 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:11.296618 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mUrvnOKR7s2erMDEF-eWgoTtWeskMcU69AoBqvQ_ggKW-ftZgGFq0vfovDXBWVUghxdR3AJNICypBkFp2gZ25pv8tI_HqVAIgT-bk3pLUGrKlaztDyIl6elwzgiOj9t7pS2mwD6DbypP9_TCjoLU0VdJME_2bI8gUmZmVtSdtD3Uiw Jul 28 10:30:11.296618 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:11.296618 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:11.296618 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:11.296618 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:11.296618 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:11.296618 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:11.296618 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 5b3cdc506169435795c2c4ff25801a89 Jul 28 10:30:11.296618 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:11.296618 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:30:11.296618 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:30:11.298729 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5b3cdc506169435795c2c4ff25801a89", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:11.298729 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:11.298729 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 5b3cdc506169435795c2c4ff25801a89 Jul 28 10:30:11.298729 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:11.298729 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin Jul 28 10:30:11.298729 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:11.298729 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:11.298729 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 7eb41802201e494bb70118c7ba700376 Jul 28 10:30:11.298729 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin Jul 28 10:30:11.298729 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:30:11.298729 n-d-850468-6 devstack@n-api.service[119464]: {"add_host": {"host": "tempest-nonexist_host-1063530281"}} Jul 28 10:30:11.298729 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:11.298729 n-d-850468-6 devstack@n-api.service[119464]: exception: Compute host tempest-nonexist_host-1063530281 could not be found. Jul 28 10:30:11.299802 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-1063530281'}}} Jul 28 10:30:11.299802 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:11.299802 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:11.299802 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5950, in _get_service_in_cell_by_host Jul 28 10:30:11.299802 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 28 10:30:11.299802 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:30:11.299802 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:30:11.299802 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 28 10:30:11.299802 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 28 10:30:11.299802 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:30:11.299802 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:30:11.299802 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 28 10:30:11.299802 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 28 10:30:11.299802 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1063530281' is not mapped to any cell Jul 28 10:30:11.299802 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.299802 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:11.299802 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.299802 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:11.299802 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5956, in _get_service_in_cell_by_host Jul 28 10:30:11.301425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 28 10:30:11.301425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6018, in _find_service_in_cell Jul 28 10:30:11.301425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 28 10:30:11.301425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 28 10:30:11.301425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.301425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:11.301425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.301425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:11.301425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 28 10:30:11.301425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 28 10:30:11.301425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 10:30:11.301425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 10:30:11.301425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:11.301425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:11.301425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:11.301425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:11.301425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 10:30:11.301425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 10:30:11.301425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6575, in add_host_to_aggregate Jul 28 10:30:11.301425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 28 10:30:11.307789 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5958, in _get_service_in_cell_by_host Jul 28 10:30:11.307789 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 28 10:30:11.307789 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1063530281 could not be found. Jul 28 10:30:11.307789 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.307789 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:11.307789 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.307789 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:11.307789 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:11.307789 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:11.307789 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:11.307789 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:11.307789 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:11.307789 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:11.307789 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:11.307789 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:11.307789 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 28 10:30:11.307789 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:30:11.307789 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1063530281 could not be found. Jul 28 10:30:11.307789 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.307789 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:11.307789 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.312057 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:11.312057 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:11.312057 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:11.312057 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:11.312057 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:11.312057 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1063530281 could not be found. Jul 28 10:30:11.312057 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.326540 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fbd40e5d-b85b-4a3b-a94a-a60c819b9b7a tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1063530281 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:11.336076 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-fbd40e5d-b85b-4a3b-a94a-a60c819b9b7a tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.158666 Jul 28 10:30:11.343438 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 18/47] 10.222.0.46 () {60 vars in 1191 bytes} [Thu Jul 28 10:30:11 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:11.362911 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-340983cf-05a3-4e98-88a3-5c5815441e08 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:11.363927 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:11.363927 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:11.455889 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-340983cf-05a3-4e98-88a3-5c5815441e08 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.111034 Jul 28 10:30:11.463212 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 19/48] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:30:11 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 10:30:11.477007 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-29437db8-3886-4e9e-baa6-9781e9090c60 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:11.490801 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-29437db8-3886-4e9e-baa6-9781e9090c60 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Request method failure captured: Jul 28 10:30:11.490801 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 28 10:30:11.490801 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:11.490801 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:11.490801 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:11.490801 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 283 Jul 28 10:30:11.490801 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:11.490801 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:11.490801 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:11.490801 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:11.490801 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mUrvnOKR7s2erMDEF-eWgoTtWeskMcU69AoBqvQ_ggKW-ftZgGFq0vfovDXBWVUghxdR3AJNICypBkFp2gZ25pv8tI_HqVAIgT-bk3pLUGrKlaztDyIl6elwzgiOj9t7pS2mwD6DbypP9_TCjoLU0VdJME_2bI8gUmZmVtSdtD3Uiw Jul 28 10:30:11.490801 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:11.490801 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:11.490801 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:11.490801 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:11.490801 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:11.490801 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:11.490801 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 5b3cdc506169435795c2c4ff25801a89 Jul 28 10:30:11.490801 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:11.490801 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:30:11.490801 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:30:11.491964 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5b3cdc506169435795c2c4ff25801a89", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:11.491964 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:11.491964 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 5b3cdc506169435795c2c4ff25801a89 Jul 28 10:30:11.491964 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:11.491964 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin Jul 28 10:30:11.491964 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:11.491964 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:11.491964 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 7eb41802201e494bb70118c7ba700376 Jul 28 10:30:11.491964 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin Jul 28 10:30:11.491964 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:30:11.491964 n-d-850468-6 devstack@n-api.service[119464]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 28 10:30:11.494239 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:11.494239 n-d-850468-6 devstack@n-api.service[119464]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 10:30:11.494239 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 28 10:30:11.494239 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:11.494239 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:11.494239 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 10:30:11.494239 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 10:30:11.494239 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 10:30:11.494239 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise error Jul 28 10:30:11.494239 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 10:30:11.494239 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.495352 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 28 10:30:11.495352 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 10:30:11.495352 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.495352 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 28 10:30:11.495352 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 28 10:30:11.495352 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.495352 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:11.495352 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.495352 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:11.495352 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:11.495352 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:11.495352 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:11.495352 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:11.495352 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:11.495352 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:11.495352 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:11.495352 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:11.495352 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 10:30:11.495352 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 10:30:11.497568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 10:30:11.497568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 10:30:11.497568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 10:30:11.497568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 10:30:11.497568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 10:30:11.497568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.497568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:11.497568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.497568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:11.497568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:11.497568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:11.497568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 10:30:11.497568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 10:30:11.498821 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 10:30:11.498821 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.503383 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-29437db8-3886-4e9e-baa6-9781e9090c60 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:11.506606 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-29437db8-3886-4e9e-baa6-9781e9090c60 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.041681 Jul 28 10:30:11.516540 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 20/49] 10.222.0.46 () {60 vars in 1165 bytes} [Thu Jul 28 10:30:11 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:30:11.523733 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0506b674-d67c-4f1a-abc5-4d4dc1452bdd tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:11.532138 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0506b674-d67c-4f1a-abc5-4d4dc1452bdd tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Request method failure captured: Jul 28 10:30:11.532138 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 28 10:30:11.532138 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:11.532138 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:11.532138 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:11.532138 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 27 Jul 28 10:30:11.532138 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:11.532138 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:11.532138 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:11.532138 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:11.532138 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mUrvnOKR7s2erMDEF-eWgoTtWeskMcU69AoBqvQ_ggKW-ftZgGFq0vfovDXBWVUghxdR3AJNICypBkFp2gZ25pv8tI_HqVAIgT-bk3pLUGrKlaztDyIl6elwzgiOj9t7pS2mwD6DbypP9_TCjoLU0VdJME_2bI8gUmZmVtSdtD3Uiw Jul 28 10:30:11.532138 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:11.532138 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:11.532138 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:11.532138 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:11.532138 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:11.532138 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:11.532138 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 5b3cdc506169435795c2c4ff25801a89 Jul 28 10:30:11.532138 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:11.532138 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:30:11.532138 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:30:11.533526 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5b3cdc506169435795c2c4ff25801a89", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:11.533526 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:11.533526 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 5b3cdc506169435795c2c4ff25801a89 Jul 28 10:30:11.533526 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:11.533526 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin Jul 28 10:30:11.533526 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:11.533526 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:11.533526 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 7eb41802201e494bb70118c7ba700376 Jul 28 10:30:11.533526 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin Jul 28 10:30:11.533526 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:30:11.533526 n-d-850468-6 devstack@n-api.service[119464]: {"aggregate": {"name": ""}} Jul 28 10:30:11.533526 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:11.533526 n-d-850468-6 devstack@n-api.service[119464]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 28 10:30:11.534223 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 28 10:30:11.534223 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:11.534223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:11.534223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 10:30:11.534223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 10:30:11.534223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 10:30:11.534223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise error Jul 28 10:30:11.534223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 28 10:30:11.534223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.534223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 28 10:30:11.534223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 10:30:11.534223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.534223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 28 10:30:11.534223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi '' Jul 28 10:30:11.534223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.534223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:11.534223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.534223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:11.534223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:11.534223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:11.534223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:11.534223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:11.534223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:11.535322 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:11.535322 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:11.535322 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:11.535322 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 10:30:11.535322 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 10:30:11.535322 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 10:30:11.535322 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 10:30:11.535322 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 10:30:11.535322 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 10:30:11.535322 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 28 10:30:11.535322 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.535322 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:11.535322 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.535322 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:11.535322 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:11.535322 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:11.535322 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 10:30:11.535322 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 10:30:11.535322 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 28 10:30:11.535322 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.539183 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0506b674-d67c-4f1a-abc5-4d4dc1452bdd tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:11.542442 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0506b674-d67c-4f1a-abc5-4d4dc1452bdd tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.024309 Jul 28 10:30:11.550578 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 21/50] 10.222.0.46 () {60 vars in 1164 bytes} [Thu Jul 28 10:30:11 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:30:11.565127 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e2539af2-279b-4123-a4d0-f5d5bc253248 tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-105435988"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:11.570618 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:11.570618 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:11.576337 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-e2539af2-279b-4123-a4d0-f5d5bc253248 tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '2409deb675254c8492a2846e0b412b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b6e6a2a1a14fc68b2b68160dcc4fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:11.579819 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e2539af2-279b-4123-a4d0-f5d5bc253248 tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Request method failure captured: Jul 28 10:30:11.579819 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 28 10:30:11.579819 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:11.579819 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:11.579819 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:11.579819 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 59 Jul 28 10:30:11.579819 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:11.579819 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:11.579819 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:11.579819 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:11.579819 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mUnnfwbbgEOZuTyUOrQC1OG4JPY2VBaSE6jueEG1VMO2NkmEr7V54P067GU_ND2qYgL2I6H3JhVBbn6i34O3cEjvIXgzm41lDv-e2YAXj0PKOpa9aVBfniDm_-ZMX65gjq-HbKuwPHruoDgD02OEZXN34MeHuTFc7uhfJYnmbZtm2Y Jul 28 10:30:11.579819 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:11.579819 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:11.579819 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:11.579819 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:11.579819 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:11.579819 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:11.579819 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 66b6e6a2a1a14fc68b2b68160dcc4fa3 Jul 28 10:30:11.579819 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-807240337 Jul 28 10:30:11.579819 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:30:11.579819 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:30:11.580919 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/66b6e6a2a1a14fc68b2b68160dcc4fa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66b6e6a2a1a14fc68b2b68160dcc4fa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66b6e6a2a1a14fc68b2b68160dcc4fa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_66b6e6a2a1a14fc68b2b68160dcc4fa3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:11.580919 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-807240337 Jul 28 10:30:11.580919 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 66b6e6a2a1a14fc68b2b68160dcc4fa3 Jul 28 10:30:11.580919 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-807240337 Jul 28 10:30:11.580919 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-AggregatesAdminNegativeTestJSON-807240337-project Jul 28 10:30:11.580919 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:11.580919 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:11.580919 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 2409deb675254c8492a2846e0b412b73 Jul 28 10:30:11.580919 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-807240337-project Jul 28 10:30:11.580919 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:30:11.580919 n-d-850468-6 devstack@n-api.service[119464]: {"aggregate": {"name": "tempest-test_aggregate-105435988"}} Jul 28 10:30:11.580919 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:11.580919 n-d-850468-6 devstack@n-api.service[119464]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 28 10:30:11.581585 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-105435988'}}} Jul 28 10:30:11.581585 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:11.581585 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:11.581585 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:11.581585 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:11.581585 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:11.581585 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:11.581585 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:11.581585 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:11.581585 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:11.581585 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:11.581585 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:11.581585 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:11.581585 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 28 10:30:11.581585 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 28 10:30:11.581585 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:30:11.581585 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:30:11.581585 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:30:11.581585 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:30:11.582534 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:11.582534 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:11.582534 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:11.582534 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:11.582534 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:30:11.582534 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:30:11.582534 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:30:11.582534 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:30:11.582534 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:30:11.582534 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:30:11.582534 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 28 10:30:11.582534 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.582534 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:11.582534 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.582534 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:11.582534 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:11.582534 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:11.582534 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:30:11.582534 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:30:11.582534 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 28 10:30:11.583508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.587345 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e2539af2-279b-4123-a4d0-f5d5bc253248 tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:11.588932 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e2539af2-279b-4123-a4d0-f5d5bc253248 tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.029868 Jul 28 10:30:11.599284 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 22/51] 10.222.0.46 () {60 vars in 1164 bytes} [Thu Jul 28 10:30:11 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:11.609609 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-90d5b98c-8eb3-4590-8d94-54b3497e39f3 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1907046953"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:11.621176 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.aggregate [None req-90d5b98c-8eb3-4590-8d94-54b3497e39f3 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Generated uuid 2ea5d88f-4114-403f-aaba-1c49ca5e967a for aggregate {{(pid=119464) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 10:30:11.708997 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-90d5b98c-8eb3-4590-8d94-54b3497e39f3 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.101905 Jul 28 10:30:11.722940 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 23/52] 10.222.0.46 () {60 vars in 1164 bytes} [Thu Jul 28 10:30:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:11.757116 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7914c7c0-3bd1-4195-ab02-133972032631 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1907046953"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:11.779901 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:11.779901 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:11.781191 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.aggregate [None req-7914c7c0-3bd1-4195-ab02-133972032631 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Generated uuid 704e0ef2-8bf0-4d73-9193-c828b4277294 for aggregate {{(pid=119464) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 10:30:11.813586 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-7914c7c0-3bd1-4195-ab02-133972032631 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1907046953 already exists. Jul 28 10:30:11.816884 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7914c7c0-3bd1-4195-ab02-133972032631 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Request method failure captured: Jul 28 10:30:11.816884 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 28 10:30:11.816884 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:11.816884 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:11.816884 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:11.816884 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 60 Jul 28 10:30:11.816884 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:11.816884 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:11.816884 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:11.816884 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:11.816884 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mUrvnOKR7s2erMDEF-eWgoTtWeskMcU69AoBqvQ_ggKW-ftZgGFq0vfovDXBWVUghxdR3AJNICypBkFp2gZ25pv8tI_HqVAIgT-bk3pLUGrKlaztDyIl6elwzgiOj9t7pS2mwD6DbypP9_TCjoLU0VdJME_2bI8gUmZmVtSdtD3Uiw Jul 28 10:30:11.816884 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:11.816884 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:11.816884 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:11.816884 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:11.816884 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:11.816884 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:11.816884 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 5b3cdc506169435795c2c4ff25801a89 Jul 28 10:30:11.816884 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:11.816884 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:30:11.816884 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:30:11.818024 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5b3cdc506169435795c2c4ff25801a89", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:11.818024 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:11.818024 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 5b3cdc506169435795c2c4ff25801a89 Jul 28 10:30:11.818024 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:11.818024 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin Jul 28 10:30:11.818024 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:11.818024 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:11.818024 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 7eb41802201e494bb70118c7ba700376 Jul 28 10:30:11.818024 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin Jul 28 10:30:11.818024 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:30:11.818024 n-d-850468-6 devstack@n-api.service[119464]: {"aggregate": {"name": "tempest-test_aggregate-1907046953"}} Jul 28 10:30:11.818024 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:11.818024 n-d-850468-6 devstack@n-api.service[119464]: exception: Aggregate tempest-test_aggregate-1907046953 already exists. Jul 28 10:30:11.818660 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1907046953'}}} Jul 28 10:30:11.818660 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:11.818660 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:11.818660 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 28 10:30:11.818660 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 28 10:30:11.818660 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 10:30:11.818660 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 10:30:11.818660 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:11.818660 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:11.818660 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:11.818660 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:11.818660 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 10:30:11.818660 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 10:30:11.818660 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6412, in create_aggregate Jul 28 10:30:11.818660 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 28 10:30:11.818660 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 28 10:30:11.818660 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 28 10:30:11.818660 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 28 10:30:11.818660 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 28 10:30:11.819587 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:30:11.819587 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:30:11.819587 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 28 10:30:11.819587 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 28 10:30:11.819587 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1907046953 already exists. Jul 28 10:30:11.819587 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.819587 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:11.819587 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.819587 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:11.819587 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:11.819587 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:11.819587 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:11.819587 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:11.819587 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:11.819587 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:11.819587 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:11.819587 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:11.819587 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:11.819587 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:11.819587 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 28 10:30:11.823125 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 28 10:30:11.823125 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1907046953 already exists. Jul 28 10:30:11.823125 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.823125 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:11.823125 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.823125 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:11.823125 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:11.823125 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:11.823125 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:11.823125 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:11.823125 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1907046953 already exists. Jul 28 10:30:11.823125 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:11.831802 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7914c7c0-3bd1-4195-ab02-133972032631 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1907046953 already exists. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:11.833586 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7914c7c0-3bd1-4195-ab02-133972032631 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.105326 Jul 28 10:30:11.839048 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 24/53] 10.222.0.46 () {60 vars in 1164 bytes} [Thu Jul 28 10:30:11 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:30:11.851355 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-472f3f55-568f-4431-8ae3-d654efebd040 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:11.853506 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:11.853506 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:11.950249 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-472f3f55-568f-4431-8ae3-d654efebd040 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.106787 Jul 28 10:30:11.951648 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 25/54] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:30:11 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 10:30:11.961087 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-dba3bff1-07a0-4a00-a44d-6df6848b5cdf tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2050696040"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:11.968250 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:11.968250 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:11.972641 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.aggregate [None req-dba3bff1-07a0-4a00-a44d-6df6848b5cdf tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Generated uuid 2f93a772-1134-4a20-911d-3d5b0078c512 for aggregate {{(pid=119464) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 10:30:12.030518 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-dba3bff1-07a0-4a00-a44d-6df6848b5cdf tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.074052 Jul 28 10:30:12.032375 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 26/55] 10.222.0.46 () {60 vars in 1164 bytes} [Thu Jul 28 10:30:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:30:12.046327 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-93537fde-de75-44a1-9922-746d6a0d198b tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:12.048562 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:12.048562 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:12.053203 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-93537fde-de75-44a1-9922-746d6a0d198b tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '2409deb675254c8492a2846e0b412b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b6e6a2a1a14fc68b2b68160dcc4fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:12.055448 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-93537fde-de75-44a1-9922-746d6a0d198b tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Request method failure captured: Jul 28 10:30:12.055448 n-d-850468-6 devstack@n-api.service[119464]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Jul 28 10:30:12.055448 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:12.055448 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:12.055448 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:12.055448 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:30:12.055448 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:12.055448 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:12.055448 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:12.055448 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:12.055448 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mUnnfwbbgEOZuTyUOrQC1OG4JPY2VBaSE6jueEG1VMO2NkmEr7V54P067GU_ND2qYgL2I6H3JhVBbn6i34O3cEjvIXgzm41lDv-e2YAXj0PKOpa9aVBfniDm_-ZMX65gjq-HbKuwPHruoDgD02OEZXN34MeHuTFc7uhfJYnmbZtm2Y Jul 28 10:30:12.055448 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:12.055448 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:12.055448 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:12.055448 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:12.055448 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:12.055448 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:12.055448 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 66b6e6a2a1a14fc68b2b68160dcc4fa3 Jul 28 10:30:12.055448 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-807240337 Jul 28 10:30:12.055448 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:30:12.055448 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:30:12.057516 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/66b6e6a2a1a14fc68b2b68160dcc4fa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66b6e6a2a1a14fc68b2b68160dcc4fa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66b6e6a2a1a14fc68b2b68160dcc4fa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_66b6e6a2a1a14fc68b2b68160dcc4fa3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:12.057516 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-807240337 Jul 28 10:30:12.057516 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 66b6e6a2a1a14fc68b2b68160dcc4fa3 Jul 28 10:30:12.057516 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-807240337 Jul 28 10:30:12.057516 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-AggregatesAdminNegativeTestJSON-807240337-project Jul 28 10:30:12.057516 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:12.057516 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:12.057516 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 2409deb675254c8492a2846e0b412b73 Jul 28 10:30:12.057516 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-807240337-project Jul 28 10:30:12.057516 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:12.057516 n-d-850468-6 devstack@n-api.service[119464]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 28 10:30:12.057516 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '6'} Jul 28 10:30:12.058276 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:12.058276 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:12.058276 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:12.058276 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:12.058276 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:12.058276 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:12.058276 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:12.058276 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:12.058276 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 28 10:30:12.058276 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 28 10:30:12.058276 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:30:12.058276 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:30:12.058276 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:30:12.058276 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:30:12.058276 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:12.058276 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:12.058276 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:12.058276 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:12.058276 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:30:12.059223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:30:12.059223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:30:12.059223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:30:12.059223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:30:12.059223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:30:12.059223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 28 10:30:12.059223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:12.059223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:12.059223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:12.059223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:12.059223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:12.059223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:12.059223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:30:12.059223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:30:12.059223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 28 10:30:12.059223 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:12.063012 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-93537fde-de75-44a1-9922-746d6a0d198b tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:12.067109 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-93537fde-de75-44a1-9922-746d6a0d198b tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.026847 Jul 28 10:30:12.068500 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 27/56] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:30:12 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:30:12.078557 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c65e4084-2f33-468a-9e00-0c7208674fcc tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:12.118334 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=9,nova_api:DELETE=8 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:12.157999 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c65e4084-2f33-468a-9e00-0c7208674fcc tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.080276 Jul 28 10:30:12.159594 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 28/57] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:30:12 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 10:30:12.170938 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-3b83f94e-0df0-4f00-a631-81c38eb3c460 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:12.172837 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:12.172837 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:12.186415 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-3b83f94e-0df0-4f00-a631-81c38eb3c460 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 28 10:30:12.188756 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-3b83f94e-0df0-4f00-a631-81c38eb3c460 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Request method failure captured: Jul 28 10:30:12.188756 n-d-850468-6 devstack@n-api.service[119464]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 28 10:30:12.188756 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:12.188756 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:12.188756 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:12.188756 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:30:12.188756 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:12.188756 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:12.188756 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:12.188756 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:12.188756 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mUrvnOKR7s2erMDEF-eWgoTtWeskMcU69AoBqvQ_ggKW-ftZgGFq0vfovDXBWVUghxdR3AJNICypBkFp2gZ25pv8tI_HqVAIgT-bk3pLUGrKlaztDyIl6elwzgiOj9t7pS2mwD6DbypP9_TCjoLU0VdJME_2bI8gUmZmVtSdtD3Uiw Jul 28 10:30:12.188756 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:12.188756 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:12.188756 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:12.188756 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:12.188756 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:12.188756 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:12.188756 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 5b3cdc506169435795c2c4ff25801a89 Jul 28 10:30:12.188756 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:12.188756 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:30:12.188756 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:30:12.189931 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5b3cdc506169435795c2c4ff25801a89", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:12.189931 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:12.189931 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 5b3cdc506169435795c2c4ff25801a89 Jul 28 10:30:12.189931 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:12.189931 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin Jul 28 10:30:12.189931 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:12.189931 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:12.189931 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 7eb41802201e494bb70118c7ba700376 Jul 28 10:30:12.189931 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin Jul 28 10:30:12.189931 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:12.189931 n-d-850468-6 devstack@n-api.service[119464]: exception: Aggregate -1 could not be found. Jul 28 10:30:12.189931 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '-1'} Jul 28 10:30:12.190542 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:12.190542 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:12.190542 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 28 10:30:12.190542 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 28 10:30:12.190542 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 10:30:12.190542 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 10:30:12.190542 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:12.190542 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:12.190542 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:12.190542 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:12.190542 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 10:30:12.190542 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 10:30:12.190542 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6471, in delete_aggregate Jul 28 10:30:12.190542 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 28 10:30:12.190542 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:30:12.190542 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:30:12.190542 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 28 10:30:12.190542 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 28 10:30:12.190542 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:30:12.191526 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:30:12.191526 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 28 10:30:12.191526 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 28 10:30:12.191526 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 28 10:30:12.191526 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:12.191526 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:12.191526 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:12.191526 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:12.191526 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:12.191526 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:12.191526 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:12.191526 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:12.191526 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:12.191526 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:12.191526 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 28 10:30:12.191526 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:30:12.191526 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 28 10:30:12.191526 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:12.191526 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:12.191526 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:12.191526 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:12.194121 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:12.194121 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:12.194121 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:12.194121 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:12.194121 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 28 10:30:12.194121 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:12.196624 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-3b83f94e-0df0-4f00-a631-81c38eb3c460 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:12.197726 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-3b83f94e-0df0-4f00-a631-81c38eb3c460 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.031503 Jul 28 10:30:12.198755 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 29/58] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Jul 28 10:30:12 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:30:12.208944 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-53a7e0c2-37db-421b-8ffa-8fa93b90af8b tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1336307948"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:12.213044 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:12.213044 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:12.214545 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.aggregate [None req-53a7e0c2-37db-421b-8ffa-8fa93b90af8b tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Generated uuid 4f308ddb-c93b-48c6-a555-27a0cb966106 for aggregate {{(pid=119464) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 10:30:12.245016 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-53a7e0c2-37db-421b-8ffa-8fa93b90af8b tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.040403 Jul 28 10:30:12.256266 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 30/59] 10.222.0.46 () {60 vars in 1164 bytes} [Thu Jul 28 10:30:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:30:12.265382 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7fef50d2-a33c-41e6-be5e-00974504f4b7 tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:12.267651 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:12.267651 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:12.269814 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-7fef50d2-a33c-41e6-be5e-00974504f4b7 tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '2409deb675254c8492a2846e0b412b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b6e6a2a1a14fc68b2b68160dcc4fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:12.273513 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7fef50d2-a33c-41e6-be5e-00974504f4b7 tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Request method failure captured: Jul 28 10:30:12.273513 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 28 10:30:12.273513 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:12.273513 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:12.273513 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:12.273513 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:30:12.273513 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:12.273513 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:12.273513 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:12.273513 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:12.273513 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mUnnfwbbgEOZuTyUOrQC1OG4JPY2VBaSE6jueEG1VMO2NkmEr7V54P067GU_ND2qYgL2I6H3JhVBbn6i34O3cEjvIXgzm41lDv-e2YAXj0PKOpa9aVBfniDm_-ZMX65gjq-HbKuwPHruoDgD02OEZXN34MeHuTFc7uhfJYnmbZtm2Y Jul 28 10:30:12.273513 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:12.273513 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:12.273513 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:12.273513 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:12.273513 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:12.273513 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:12.273513 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 66b6e6a2a1a14fc68b2b68160dcc4fa3 Jul 28 10:30:12.273513 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-807240337 Jul 28 10:30:12.273513 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:30:12.273513 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:30:12.276291 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/66b6e6a2a1a14fc68b2b68160dcc4fa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66b6e6a2a1a14fc68b2b68160dcc4fa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66b6e6a2a1a14fc68b2b68160dcc4fa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_66b6e6a2a1a14fc68b2b68160dcc4fa3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:12.276291 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-807240337 Jul 28 10:30:12.276291 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 66b6e6a2a1a14fc68b2b68160dcc4fa3 Jul 28 10:30:12.276291 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-807240337 Jul 28 10:30:12.276291 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-AggregatesAdminNegativeTestJSON-807240337-project Jul 28 10:30:12.276291 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:12.276291 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:12.276291 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 2409deb675254c8492a2846e0b412b73 Jul 28 10:30:12.276291 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-807240337-project Jul 28 10:30:12.276291 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:12.276291 n-d-850468-6 devstack@n-api.service[119464]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 28 10:30:12.276291 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '7'} Jul 28 10:30:12.277467 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:12.277467 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:12.277467 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:12.277467 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:12.277467 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:12.277467 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:12.277467 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:12.277467 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:12.277467 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 28 10:30:12.277467 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 28 10:30:12.277467 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:30:12.277467 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:30:12.277467 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:30:12.277467 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:30:12.277467 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:12.277467 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:12.277467 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:12.277467 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:12.277467 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:30:12.282972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:30:12.282972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:30:12.282972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:30:12.282972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:30:12.282972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:30:12.282972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 28 10:30:12.282972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:12.282972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:12.282972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:12.282972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:12.282972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:12.282972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:12.282972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:30:12.282972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:30:12.282972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 28 10:30:12.282972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:12.282972 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7fef50d2-a33c-41e6-be5e-00974504f4b7 tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:12.294600 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7fef50d2-a33c-41e6-be5e-00974504f4b7 tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] 10.222.0.46 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.022716 Jul 28 10:30:12.294600 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 31/60] 10.222.0.46 () {58 vars in 1149 bytes} [Thu Jul 28 10:30:12 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:12.309435 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c4237e47-8d3f-46be-ae4b-84d7fb15694d tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:12.310858 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:12.310858 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:12.415258 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c4237e47-8d3f-46be-ae4b-84d7fb15694d tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.121768 Jul 28 10:30:12.422040 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 32/61] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:30:12 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 10:30:12.459977 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-cf82c469-8e92-4637-baff-cb9ee70c98c1 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:12.461171 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:12.461171 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:12.495960 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-cf82c469-8e92-4637-baff-cb9ee70c98c1 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 28 10:30:12.511397 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-cf82c469-8e92-4637-baff-cb9ee70c98c1 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Request method failure captured: Jul 28 10:30:12.511397 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 28 10:30:12.511397 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:12.511397 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:12.511397 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:12.511397 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:30:12.511397 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:12.511397 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:12.511397 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:12.511397 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:12.511397 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mUrvnOKR7s2erMDEF-eWgoTtWeskMcU69AoBqvQ_ggKW-ftZgGFq0vfovDXBWVUghxdR3AJNICypBkFp2gZ25pv8tI_HqVAIgT-bk3pLUGrKlaztDyIl6elwzgiOj9t7pS2mwD6DbypP9_TCjoLU0VdJME_2bI8gUmZmVtSdtD3Uiw Jul 28 10:30:12.511397 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:12.511397 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:12.511397 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:12.511397 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:12.511397 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:12.511397 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:12.511397 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 5b3cdc506169435795c2c4ff25801a89 Jul 28 10:30:12.511397 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:12.511397 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:30:12.511397 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:30:12.512571 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5b3cdc506169435795c2c4ff25801a89", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:12.512571 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:12.512571 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 5b3cdc506169435795c2c4ff25801a89 Jul 28 10:30:12.512571 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:12.512571 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin Jul 28 10:30:12.512571 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:12.512571 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:12.512571 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 7eb41802201e494bb70118c7ba700376 Jul 28 10:30:12.512571 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin Jul 28 10:30:12.512571 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:12.512571 n-d-850468-6 devstack@n-api.service[119464]: exception: Aggregate -1 could not be found. Jul 28 10:30:12.512571 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '-1'} Jul 28 10:30:12.513235 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:12.513235 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:12.513235 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 28 10:30:12.513235 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 28 10:30:12.513235 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6418, in get_aggregate Jul 28 10:30:12.513235 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 28 10:30:12.513235 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:30:12.513235 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:30:12.513235 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 28 10:30:12.513235 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 28 10:30:12.513235 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:30:12.513235 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:30:12.513235 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 28 10:30:12.513235 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 28 10:30:12.513235 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 28 10:30:12.513235 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:12.513235 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:12.513235 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:12.513235 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:12.513235 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:12.514229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:12.514229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:12.514229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:12.514229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:12.514229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:12.514229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 28 10:30:12.514229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:30:12.514229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 28 10:30:12.514229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:12.514229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:12.514229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:12.514229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:12.514229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:12.514229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:12.514229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:12.514229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:12.514229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 28 10:30:12.514229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:12.515128 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-cf82c469-8e92-4637-baff-cb9ee70c98c1 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:12.521934 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-cf82c469-8e92-4637-baff-cb9ee70c98c1 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.095738 Jul 28 10:30:12.532428 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 33/62] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:30:12 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 28 10:30:12.553706 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8b6b9c9c-7b5f-4ac2-83dc-cf160e66f965 tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:12.560645 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:12.560645 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:12.596916 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-8b6b9c9c-7b5f-4ac2-83dc-cf160e66f965 tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '2409deb675254c8492a2846e0b412b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b6e6a2a1a14fc68b2b68160dcc4fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:12.606035 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8b6b9c9c-7b5f-4ac2-83dc-cf160e66f965 tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Request method failure captured: Jul 28 10:30:12.606035 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 28 10:30:12.606035 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:12.606035 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:12.606035 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:12.606035 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:30:12.606035 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:12.606035 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:12.606035 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:12.606035 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:12.606035 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mUnnfwbbgEOZuTyUOrQC1OG4JPY2VBaSE6jueEG1VMO2NkmEr7V54P067GU_ND2qYgL2I6H3JhVBbn6i34O3cEjvIXgzm41lDv-e2YAXj0PKOpa9aVBfniDm_-ZMX65gjq-HbKuwPHruoDgD02OEZXN34MeHuTFc7uhfJYnmbZtm2Y Jul 28 10:30:12.606035 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:12.606035 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:12.606035 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:12.606035 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:12.606035 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:12.606035 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:12.606035 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 66b6e6a2a1a14fc68b2b68160dcc4fa3 Jul 28 10:30:12.606035 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-807240337 Jul 28 10:30:12.606035 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:30:12.606035 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:30:12.607209 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/66b6e6a2a1a14fc68b2b68160dcc4fa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66b6e6a2a1a14fc68b2b68160dcc4fa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66b6e6a2a1a14fc68b2b68160dcc4fa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_66b6e6a2a1a14fc68b2b68160dcc4fa3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:12.607209 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-807240337 Jul 28 10:30:12.607209 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 66b6e6a2a1a14fc68b2b68160dcc4fa3 Jul 28 10:30:12.607209 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-807240337 Jul 28 10:30:12.607209 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-AggregatesAdminNegativeTestJSON-807240337-project Jul 28 10:30:12.607209 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:12.607209 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:12.607209 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 2409deb675254c8492a2846e0b412b73 Jul 28 10:30:12.607209 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-807240337-project Jul 28 10:30:12.607209 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:12.607209 n-d-850468-6 devstack@n-api.service[119464]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 28 10:30:12.607209 n-d-850468-6 devstack@n-api.service[119464]: action_args: {} Jul 28 10:30:12.607912 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:12.607912 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:12.607912 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:12.607912 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:12.607912 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:12.607912 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:12.607912 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:12.607912 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:12.607912 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 28 10:30:12.607912 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 28 10:30:12.607912 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:30:12.607912 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:30:12.607912 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:30:12.607912 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:30:12.607912 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:12.607912 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:12.607912 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:12.607912 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:12.607912 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:30:12.608881 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:30:12.608881 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:30:12.608881 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:30:12.608881 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:30:12.608881 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:30:12.608881 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 28 10:30:12.608881 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:12.608881 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:12.608881 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:12.608881 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:12.608881 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:12.608881 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:12.608881 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:30:12.608881 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:30:12.608881 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 28 10:30:12.608881 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:12.609696 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8b6b9c9c-7b5f-4ac2-83dc-cf160e66f965 tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:12.613795 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-8b6b9c9c-7b5f-4ac2-83dc-cf160e66f965 tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.073758 Jul 28 10:30:12.615191 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 34/63] 10.222.0.46 () {58 vars in 1143 bytes} [Thu Jul 28 10:30:12 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 82 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:13.374264 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-00476926-2cf8-4517-b0f6-f51a485ae071 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 314 microversion: 2.1 time: 2.335458 Jul 28 10:30:13.395692 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 30/64] 10.222.0.46 () {60 vars in 1191 bytes} [Thu Jul 28 10:30:11 2022] POST /compute/v2.1/os-aggregates/3/action => generated 314 bytes in 2357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:14.641480 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1957951791", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "availability_zone": "tempest-test_az-1344211254"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:14.678653 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:14.682083 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:14.683054 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:14.685062 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:16.478909 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:16.540514 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] validate_networks() for None {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:30:16.980201 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-686770269", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "1c87581d-6ea4-480a-85dd-94af3087f3e2"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:17.173971 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:30:17.174630 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:30:17.175291 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:30:17.175881 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:30:17.177036 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:30:17.202814 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:17.203508 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:17.204853 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:17.205914 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:17.249420 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Getting quotas for project f184573e6f5744f0aabab0891617674e. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:30:17.258915 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Getting quotas for user d1a0245b64224d559ed11c1cefc943a8 and project f184573e6f5744f0aabab0891617674e. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:30:17.278054 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:30:17.282701 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] [instance: 05c29a68-71b4-4f0e-83db-4576f1d78a52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:30:17.355113 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b05b4fd5-eee6-44a3-89d8-37fcc0c117d1 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.587901 Jul 28 10:30:17.356385 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 35/65] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:30:17.374085 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6ee5197c-cef3-4648-a45b-121c0dc6bc27 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:17.374604 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-6ee5197c-cef3-4648-a45b-121c0dc6bc27 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] [instance: 05c29a68-71b4-4f0e-83db-4576f1d78a52] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:17.532002 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-6ee5197c-cef3-4648-a45b-121c0dc6bc27 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a0245b64224d559ed11c1cefc943a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f184573e6f5744f0aabab0891617674e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:17.550976 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-6ee5197c-cef3-4648-a45b-121c0dc6bc27 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] 10.222.0.46 "GET /compute/v2.1/servers/05c29a68-71b4-4f0e-83db-4576f1d78a52" status: 200 len: 1243 microversion: 2.1 time: 0.187761 Jul 28 10:30:17.552484 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 36/66] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:30:17 2022] GET /compute/v2.1/servers/05c29a68-71b4-4f0e-83db-4576f1d78a52 => generated 1243 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:18.357039 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] validate_networks() for [('1c87581d-6ea4-480a-85dd-94af3087f3e2', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:30:18.391449 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1900137357", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:18.488897 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] validate_networks() for None {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:30:18.876104 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:30:18.876720 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:30:18.877271 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:30:18.877765 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:30:18.878481 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:30:18.902801 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:18.904016 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:18.905244 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:18.906061 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:18.940233 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Getting quotas for project ad5b53a76f3a4ed1bdbf8d475dff9f83. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:30:18.952510 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Getting quotas for user d4a3a77b4a3e4afbab66d34833cdcb0c and project ad5b53a76f3a4ed1bdbf8d475dff9f83. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:30:18.981245 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:30:18.984920 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: fd361365-e1d0-4dfe-a96e-7955db1eb655] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:30:19.042244 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-cbeb1478-a169-42c5-953b-996f4b76a4fc tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.284490 Jul 28 10:30:19.043687 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 37/67] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:30:19.048828 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7c5b0377-c505-44c5-b22f-00cbc3006502 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:19.049605 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-7c5b0377-c505-44c5-b22f-00cbc3006502 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] [instance: 05c29a68-71b4-4f0e-83db-4576f1d78a52] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:19.065933 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7c5b0377-c505-44c5-b22f-00cbc3006502 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:19.066726 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7c5b0377-c505-44c5-b22f-00cbc3006502 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:19.068396 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7c5b0377-c505-44c5-b22f-00cbc3006502 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:19.069239 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7c5b0377-c505-44c5-b22f-00cbc3006502 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:19.278378 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7c5b0377-c505-44c5-b22f-00cbc3006502 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:19.279043 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7c5b0377-c505-44c5-b22f-00cbc3006502 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:19.279699 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-7c5b0377-c505-44c5-b22f-00cbc3006502 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lazy-loading 'fault' on Instance uuid 05c29a68-71b4-4f0e-83db-4576f1d78a52 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:30:19.366240 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-7c5b0377-c505-44c5-b22f-00cbc3006502 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a0245b64224d559ed11c1cefc943a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f184573e6f5744f0aabab0891617674e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:19.384861 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7c5b0377-c505-44c5-b22f-00cbc3006502 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] 10.222.0.46 "GET /compute/v2.1/servers/05c29a68-71b4-4f0e-83db-4576f1d78a52" status: 200 len: 1316 microversion: 2.1 time: 0.339923 Jul 28 10:30:19.386120 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 38/68] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:30:19 2022] GET /compute/v2.1/servers/05c29a68-71b4-4f0e-83db-4576f1d78a52 => generated 1316 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:19.394293 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-397ce70c-7d30-42a2-8472-eebaf14735b8 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:19.401479 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-397ce70c-7d30-42a2-8472-eebaf14735b8 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: fd361365-e1d0-4dfe-a96e-7955db1eb655] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:19.493035 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-397ce70c-7d30-42a2-8472-eebaf14735b8 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a3a77b4a3e4afbab66d34833cdcb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5b53a76f3a4ed1bdbf8d475dff9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:19.506470 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-397ce70c-7d30-42a2-8472-eebaf14735b8 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] 10.222.0.46 "GET /compute/v2.1/servers/fd361365-e1d0-4dfe-a96e-7955db1eb655" status: 200 len: 1220 microversion: 2.1 time: 0.118400 Jul 28 10:30:19.521928 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 39/69] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:30:19 2022] GET /compute/v2.1/servers/fd361365-e1d0-4dfe-a96e-7955db1eb655 => generated 1220 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:19.547990 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-79c478a7-9e4a-4e98-9dce-44fb2ba60298 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:19.549016 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-79c478a7-9e4a-4e98-9dce-44fb2ba60298 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] [instance: 05c29a68-71b4-4f0e-83db-4576f1d78a52] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:19.559150 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-79c478a7-9e4a-4e98-9dce-44fb2ba60298 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:19.559884 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-79c478a7-9e4a-4e98-9dce-44fb2ba60298 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:19.560870 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-79c478a7-9e4a-4e98-9dce-44fb2ba60298 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:19.561462 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-79c478a7-9e4a-4e98-9dce-44fb2ba60298 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:19.614116 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-79c478a7-9e4a-4e98-9dce-44fb2ba60298 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] [instance: 05c29a68-71b4-4f0e-83db-4576f1d78a52] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:30:19.740854 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-79c478a7-9e4a-4e98-9dce-44fb2ba60298 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] [instance: 05c29a68-71b4-4f0e-83db-4576f1d78a52] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:30:19.742024 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-79c478a7-9e4a-4e98-9dce-44fb2ba60298 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:19.743464 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-79c478a7-9e4a-4e98-9dce-44fb2ba60298 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:19.745200 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-79c478a7-9e4a-4e98-9dce-44fb2ba60298 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] [instance: 05c29a68-71b4-4f0e-83db-4576f1d78a52] instance's host None is down, deleting from database Jul 28 10:30:19.749118 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-79c478a7-9e4a-4e98-9dce-44fb2ba60298 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] [instance: 05c29a68-71b4-4f0e-83db-4576f1d78a52] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:30:19.826806 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-79c478a7-9e4a-4e98-9dce-44fb2ba60298 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] [instance: 05c29a68-71b4-4f0e-83db-4576f1d78a52] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:30:19.841622 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-79c478a7-9e4a-4e98-9dce-44fb2ba60298 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] [instance: 05c29a68-71b4-4f0e-83db-4576f1d78a52] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:30:20.398227 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:30:20.399868 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:30:20.400026 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:30:20.400448 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:30:20.400876 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:30:20.417652 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:20.418259 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:20.419231 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:20.419710 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:20.476537 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Getting quotas for project 07e2042b56704e9fb5195d43d8116494. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:30:20.485309 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Getting quotas for user 5a46f399714c4124a253c57a26f77a0b and project 07e2042b56704e9fb5195d43d8116494. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:30:20.502531 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:30:20.506230 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: bde8bb05-4dc9-47d5-a97c-51184776c21f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:30:20.606067 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-fc8e4045-57d7-45ad-99de-cf4bea509578 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 4.129525 Jul 28 10:30:20.607207 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 31/70] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Jul 28 10:30:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 4132 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 10:30:20.614496 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-77a56f3a-adcd-43af-a0a4-9b363a444fd7 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:20.615593 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-77a56f3a-adcd-43af-a0a4-9b363a444fd7 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: fd361365-e1d0-4dfe-a96e-7955db1eb655] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:20.632839 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-77a56f3a-adcd-43af-a0a4-9b363a444fd7 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:20.634098 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-77a56f3a-adcd-43af-a0a4-9b363a444fd7 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:20.635545 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-77a56f3a-adcd-43af-a0a4-9b363a444fd7 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:20.636218 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-77a56f3a-adcd-43af-a0a4-9b363a444fd7 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:20.754729 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-77a56f3a-adcd-43af-a0a4-9b363a444fd7 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:20.762230 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-77a56f3a-adcd-43af-a0a4-9b363a444fd7 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:20.762788 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-77a56f3a-adcd-43af-a0a4-9b363a444fd7 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lazy-loading 'fault' on Instance uuid fd361365-e1d0-4dfe-a96e-7955db1eb655 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:30:20.871771 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-77a56f3a-adcd-43af-a0a4-9b363a444fd7 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a3a77b4a3e4afbab66d34833cdcb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5b53a76f3a4ed1bdbf8d475dff9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:20.895689 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-77a56f3a-adcd-43af-a0a4-9b363a444fd7 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] 10.222.0.46 "GET /compute/v2.1/servers/fd361365-e1d0-4dfe-a96e-7955db1eb655" status: 200 len: 1293 microversion: 2.1 time: 0.286223 Jul 28 10:30:20.908485 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 32/71] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:30:20 2022] GET /compute/v2.1/servers/fd361365-e1d0-4dfe-a96e-7955db1eb655 => generated 1293 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:20.922015 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ddda6436-ad04-4303-bd8a-e21b45202ed1 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:20.923031 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ddda6436-ad04-4303-bd8a-e21b45202ed1 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: bde8bb05-4dc9-47d5-a97c-51184776c21f] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:20.934202 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ddda6436-ad04-4303-bd8a-e21b45202ed1 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:20.934900 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ddda6436-ad04-4303-bd8a-e21b45202ed1 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:20.935719 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ddda6436-ad04-4303-bd8a-e21b45202ed1 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:20.936161 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ddda6436-ad04-4303-bd8a-e21b45202ed1 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:21.023408 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-ddda6436-ad04-4303-bd8a-e21b45202ed1 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:21.038155 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-ddda6436-ad04-4303-bd8a-e21b45202ed1 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:21.040597 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-ddda6436-ad04-4303-bd8a-e21b45202ed1 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:21.042245 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ddda6436-ad04-4303-bd8a-e21b45202ed1 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] 10.222.0.46 "GET /compute/v2.1/servers/bde8bb05-4dc9-47d5-a97c-51184776c21f" status: 200 len: 1261 microversion: 2.25 time: 0.129099 Jul 28 10:30:21.046636 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 33/72] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:30:20 2022] GET /compute/v2.1/servers/bde8bb05-4dc9-47d5-a97c-51184776c21f => generated 1261 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:30:21.058706 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2a563126-99de-4cb3-bdad-f6d2b4af9c73 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:21.059414 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-2a563126-99de-4cb3-bdad-f6d2b4af9c73 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: fd361365-e1d0-4dfe-a96e-7955db1eb655] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:21.065509 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2a563126-99de-4cb3-bdad-f6d2b4af9c73 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:21.066120 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2a563126-99de-4cb3-bdad-f6d2b4af9c73 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:21.067158 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2a563126-99de-4cb3-bdad-f6d2b4af9c73 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:21.067453 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2a563126-99de-4cb3-bdad-f6d2b4af9c73 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:21.104208 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-2a563126-99de-4cb3-bdad-f6d2b4af9c73 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: fd361365-e1d0-4dfe-a96e-7955db1eb655] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:30:21.218336 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-2a563126-99de-4cb3-bdad-f6d2b4af9c73 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: fd361365-e1d0-4dfe-a96e-7955db1eb655] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:30:21.219330 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2a563126-99de-4cb3-bdad-f6d2b4af9c73 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:21.219869 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2a563126-99de-4cb3-bdad-f6d2b4af9c73 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:21.220861 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-2a563126-99de-4cb3-bdad-f6d2b4af9c73 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: fd361365-e1d0-4dfe-a96e-7955db1eb655] instance's host None is down, deleting from database Jul 28 10:30:21.226420 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-2a563126-99de-4cb3-bdad-f6d2b4af9c73 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: fd361365-e1d0-4dfe-a96e-7955db1eb655] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:30:21.242159 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-79c478a7-9e4a-4e98-9dce-44fb2ba60298 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] 10.222.0.46 "DELETE /compute/v2.1/servers/05c29a68-71b4-4f0e-83db-4576f1d78a52" status: 204 len: 0 microversion: 2.1 time: 1.718350 Jul 28 10:30:21.244511 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 40/73] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:30:19 2022] DELETE /compute/v2.1/servers/05c29a68-71b4-4f0e-83db-4576f1d78a52 => generated 0 bytes in 1721 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:30:21.255589 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e2c5d81a-c96e-42a2-be09-fdfdca67fe35 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:21.256417 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-e2c5d81a-c96e-42a2-be09-fdfdca67fe35 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] [instance: 05c29a68-71b4-4f0e-83db-4576f1d78a52] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:21.269092 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-2a563126-99de-4cb3-bdad-f6d2b4af9c73 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: fd361365-e1d0-4dfe-a96e-7955db1eb655] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:30:21.270929 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e2c5d81a-c96e-42a2-be09-fdfdca67fe35 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:21.271589 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e2c5d81a-c96e-42a2-be09-fdfdca67fe35 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:21.273032 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e2c5d81a-c96e-42a2-be09-fdfdca67fe35 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:21.274828 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e2c5d81a-c96e-42a2-be09-fdfdca67fe35 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:21.279935 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-2a563126-99de-4cb3-bdad-f6d2b4af9c73 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: fd361365-e1d0-4dfe-a96e-7955db1eb655] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:30:21.294313 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-e2c5d81a-c96e-42a2-be09-fdfdca67fe35 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] HTTP exception thrown: Instance 05c29a68-71b4-4f0e-83db-4576f1d78a52 could not be found. Jul 28 10:30:21.296995 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e2c5d81a-c96e-42a2-be09-fdfdca67fe35 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Request method failure captured: Jul 28 10:30:21.296995 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/05c29a68-71b4-4f0e-83db-4576f1d78a52 HTTP/1.1 Jul 28 10:30:21.296995 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:21.296995 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:21.296995 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:21.296995 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:30:21.296995 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:21.296995 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:21.296995 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:21.296995 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:21.296995 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mUony1WBYpgZEyRORT7CU1utpStNVjUMXEmpfi8l21_AZaL09qBwLCQfQdm42anw4uUquOfFZgUE_2TN8AMqBMwW4u0src3H3t7jZizjYLh6GC4moa6ObR-ozpPUTY9mYP90dXZGhxjCGzFr9b6-piRWJVymIfJG-JHaLJPi9EzlU8 Jul 28 10:30:21.296995 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:21.296995 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:21.296995 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:21.296995 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:21.296995 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:21.296995 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:21.296995 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: f184573e6f5744f0aabab0891617674e Jul 28 10:30:21.296995 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-AggregatesAdminTestJSON-2114286520 Jul 28 10:30:21.296995 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:30:21.296995 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:30:21.298280 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f184573e6f5744f0aabab0891617674e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f184573e6f5744f0aabab0891617674e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f184573e6f5744f0aabab0891617674e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f184573e6f5744f0aabab0891617674e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:21.298280 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-AggregatesAdminTestJSON-2114286520 Jul 28 10:30:21.298280 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: f184573e6f5744f0aabab0891617674e Jul 28 10:30:21.298280 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2114286520 Jul 28 10:30:21.298280 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-AggregatesAdminTestJSON-2114286520-project Jul 28 10:30:21.298280 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:21.298280 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:21.298280 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: d1a0245b64224d559ed11c1cefc943a8 Jul 28 10:30:21.298280 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-AggregatesAdminTestJSON-2114286520-project Jul 28 10:30:21.298280 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:21.298280 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 05c29a68-71b4-4f0e-83db-4576f1d78a52 could not be found. Jul 28 10:30:21.298280 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '05c29a68-71b4-4f0e-83db-4576f1d78a52'} Jul 28 10:30:21.299037 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:21.299037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:21.299037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:30:21.299037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:30:21.299037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:30:21.299037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:30:21.299037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:30:21.299037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:30:21.299037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:30:21.299037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:30:21.299037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c29a68-71b4-4f0e-83db-4576f1d78a52 could not be found. Jul 28 10:30:21.299037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:21.299037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:21.299037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:21.299037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:21.299037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:21.299037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:21.299037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:21.299037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:21.299037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:21.300090 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:21.300090 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:30:21.300090 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:30:21.300090 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:30:21.300090 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:30:21.300090 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:30:21.300090 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:30:21.300090 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c29a68-71b4-4f0e-83db-4576f1d78a52 could not be found. Jul 28 10:30:21.300090 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:21.300090 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:21.300090 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:21.300090 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:21.300090 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:21.300090 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:21.300090 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:21.300090 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:21.300090 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c29a68-71b4-4f0e-83db-4576f1d78a52 could not be found. Jul 28 10:30:21.300090 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:21.300970 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e2c5d81a-c96e-42a2-be09-fdfdca67fe35 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] Returning 404 to user: Instance 05c29a68-71b4-4f0e-83db-4576f1d78a52 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:21.300970 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e2c5d81a-c96e-42a2-be09-fdfdca67fe35 tempest-AggregatesAdminTestJSON-2114286520 tempest-AggregatesAdminTestJSON-2114286520-project] 10.222.0.46 "GET /compute/v2.1/servers/05c29a68-71b4-4f0e-83db-4576f1d78a52" status: 404 len: 111 microversion: 2.1 time: 0.049918 Jul 28 10:30:21.301635 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 41/74] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:30:21 2022] GET /compute/v2.1/servers/05c29a68-71b4-4f0e-83db-4576f1d78a52 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:21.311506 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9cae33cc-65a1-4efb-a47c-59431d19e044 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850468-6"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:21.314459 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:21.314459 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:21.324094 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9cae33cc-65a1-4efb-a47c-59431d19e044 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:21.324759 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9cae33cc-65a1-4efb-a47c-59431d19e044 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:21.480102 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9cae33cc-65a1-4efb-a47c-59431d19e044 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 299 microversion: 2.1 time: 0.172319 Jul 28 10:30:21.480730 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 42/75] 10.222.0.46 () {60 vars in 1191 bytes} [Thu Jul 28 10:30:21 2022] POST /compute/v2.1/os-aggregates/3/action => generated 299 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:21.723963 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-3882ba5a-fb3a-4e27-b465-08d3fc338889 tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] Calling method '.version_select at 0x7fa95803d160>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:21.725568 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:21.725568 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:21.727539 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-3882ba5a-fb3a-4e27-b465-08d3fc338889 tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '04e0e5a7067b4f799bcb1f9d378d88e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2aa532803a4e9588871fc423daf7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:21.735644 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-3882ba5a-fb3a-4e27-b465-08d3fc338889 tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] Request method failure captured: Jul 28 10:30:21.735644 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 28 10:30:21.735644 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:21.735644 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:21.735644 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:21.735644 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:30:21.735644 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:21.735644 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:21.735644 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:21.735644 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:21.735644 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mU6iNdK0LGjuEQX9woowofIpuXSCOg5ULcU23VSAxqpoS3QHfJ2pYQ0gMxbjgHfzfGy-kx91tbccDHRwhHHW4g8dQW63GJJyT3FDh-fvw4_3iiCa1L3gZhhon9QMD0JKgK2Z7KmemgNx797F0ul6iJvYtuP_L5SVdTaIdbnX7OYylw Jul 28 10:30:21.735644 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:21.735644 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:21.735644 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:21.735644 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:21.735644 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:21.735644 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:21.735644 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 9a2aa532803a4e9588871fc423daf7dd Jul 28 10:30:21.735644 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1384940952 Jul 28 10:30:21.735644 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:30:21.735644 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:30:21.738303 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9a2aa532803a4e9588871fc423daf7dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9a2aa532803a4e9588871fc423daf7dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9a2aa532803a4e9588871fc423daf7dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9a2aa532803a4e9588871fc423daf7dd", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:21.738303 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1384940952 Jul 28 10:30:21.738303 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 9a2aa532803a4e9588871fc423daf7dd Jul 28 10:30:21.738303 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1384940952 Jul 28 10:30:21.738303 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-HypervisorAdminNegativeTestJSON-1384940952-project Jul 28 10:30:21.738303 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:21.738303 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:21.738303 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 04e0e5a7067b4f799bcb1f9d378d88e4 Jul 28 10:30:21.738303 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1384940952-project Jul 28 10:30:21.738303 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:30:21.738303 n-d-850468-6 devstack@n-api.service[119464]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 28 10:30:21.738303 n-d-850468-6 devstack@n-api.service[119464]: action_args: {} Jul 28 10:30:21.738303 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:21.739729 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:21.739729 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:21.739729 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:21.739729 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:21.739729 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:21.739729 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:30:21.739729 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:30:21.739729 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:21.739729 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:21.739729 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 28 10:30:21.739729 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 28 10:30:21.739729 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 28 10:30:21.739729 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 28 10:30:21.739729 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:30:21.739729 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:30:21.739729 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:30:21.739729 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:30:21.739729 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:21.739729 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:21.741812 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:21.741812 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:21.741812 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:30:21.741812 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:30:21.741812 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:30:21.741812 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:30:21.741812 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:30:21.741812 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:30:21.741812 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 28 10:30:21.741812 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:21.741812 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:21.741812 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:21.741812 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:21.741812 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:21.741812 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:21.741812 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:30:21.741812 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:30:21.741812 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 28 10:30:21.741812 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:21.744374 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-3882ba5a-fb3a-4e27-b465-08d3fc338889 tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:21.745426 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-3882ba5a-fb3a-4e27-b465-08d3fc338889 tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.262137 Jul 28 10:30:21.746555 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 43/76] 10.222.0.46 () {58 vars in 1167 bytes} [Thu Jul 28 10:30:21 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 265 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:21.756271 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4e7840fe-86f2-4fd1-9cf3-0cb1c35f2dd4 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:21.757438 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:21.757438 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:21.789603 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-4e7840fe-86f2-4fd1-9cf3-0cb1c35f2dd4 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.037352 Jul 28 10:30:21.790234 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 44/77] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:30:21 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 10:30:22.056740 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-42fbbb03-f4f2-44bc-b7f2-6d4321b092b1 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Calling method '.version_select at 0x7fa94bfe7160>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:22.060847 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:22.060847 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:22.062663 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-42fbbb03-f4f2-44bc-b7f2-6d4321b092b1 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:22.063684 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-42fbbb03-f4f2-44bc-b7f2-6d4321b092b1 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:22.065774 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-42fbbb03-f4f2-44bc-b7f2-6d4321b092b1 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:22.066444 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-42fbbb03-f4f2-44bc-b7f2-6d4321b092b1 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:22.096315 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-42fbbb03-f4f2-44bc-b7f2-6d4321b092b1 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.304856 Jul 28 10:30:22.096922 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 45/78] 10.222.0.46 () {58 vars in 1128 bytes} [Thu Jul 28 10:30:21 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:22.105964 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6541b004-e684-46ef-bf8f-db062dca41bb tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] Calling method '.version_select at 0x7fa95803d5e0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:22.107198 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:22.107198 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:22.108586 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-6541b004-e684-46ef-bf8f-db062dca41bb tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '04e0e5a7067b4f799bcb1f9d378d88e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2aa532803a4e9588871fc423daf7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:22.110663 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6541b004-e684-46ef-bf8f-db062dca41bb tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] Request method failure captured: Jul 28 10:30:22.110663 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 28 10:30:22.110663 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:22.110663 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:22.110663 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:22.110663 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:30:22.110663 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:22.110663 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:22.110663 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:22.110663 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:22.110663 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mU6iNdK0LGjuEQX9woowofIpuXSCOg5ULcU23VSAxqpoS3QHfJ2pYQ0gMxbjgHfzfGy-kx91tbccDHRwhHHW4g8dQW63GJJyT3FDh-fvw4_3iiCa1L3gZhhon9QMD0JKgK2Z7KmemgNx797F0ul6iJvYtuP_L5SVdTaIdbnX7OYylw Jul 28 10:30:22.110663 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:22.110663 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:22.110663 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:22.110663 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:22.110663 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:22.110663 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:22.110663 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 9a2aa532803a4e9588871fc423daf7dd Jul 28 10:30:22.110663 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1384940952 Jul 28 10:30:22.110663 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:30:22.110663 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:30:22.112141 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9a2aa532803a4e9588871fc423daf7dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9a2aa532803a4e9588871fc423daf7dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9a2aa532803a4e9588871fc423daf7dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9a2aa532803a4e9588871fc423daf7dd", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:22.112141 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1384940952 Jul 28 10:30:22.112141 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 9a2aa532803a4e9588871fc423daf7dd Jul 28 10:30:22.112141 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1384940952 Jul 28 10:30:22.112141 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-HypervisorAdminNegativeTestJSON-1384940952-project Jul 28 10:30:22.112141 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:22.112141 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:22.112141 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 04e0e5a7067b4f799bcb1f9d378d88e4 Jul 28 10:30:22.112141 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1384940952-project Jul 28 10:30:22.112141 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:30:22.112141 n-d-850468-6 devstack@n-api.service[119464]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 28 10:30:22.112141 n-d-850468-6 devstack@n-api.service[119464]: action_args: {} Jul 28 10:30:22.112141 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:22.112861 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:22.112861 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:22.112861 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:22.112861 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:22.112861 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:22.112861 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:30:22.112861 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:30:22.112861 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:22.112861 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:22.112861 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 28 10:30:22.112861 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 28 10:30:22.112861 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 28 10:30:22.112861 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 28 10:30:22.112861 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:30:22.112861 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:30:22.112861 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:30:22.112861 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:30:22.112861 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:22.112861 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:22.114968 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:22.114968 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:22.114968 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:30:22.114968 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:30:22.114968 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:30:22.114968 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:30:22.114968 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:30:22.114968 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:30:22.114968 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 28 10:30:22.114968 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:22.114968 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:22.114968 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:22.114968 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:22.114968 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:22.114968 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:22.114968 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:30:22.114968 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:30:22.114968 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 28 10:30:22.114968 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:22.115901 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6541b004-e684-46ef-bf8f-db062dca41bb tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:22.115901 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-6541b004-e684-46ef-bf8f-db062dca41bb tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.014184 Jul 28 10:30:22.115901 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 46/79] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:22 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:22.118526 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-45aebf6e-35c9-428b-bcbe-d04309ba9fb9 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1812953689"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:22.121456 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:22.121456 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:22.122414 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.aggregate [None req-45aebf6e-35c9-428b-bcbe-d04309ba9fb9 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Generated uuid 05b65a9c-70ff-47d5-98c5-22a66c0a3763 for aggregate {{(pid=119464) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 10:30:22.159591 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-45aebf6e-35c9-428b-bcbe-d04309ba9fb9 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.045278 Jul 28 10:30:22.161164 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 47/80] 10.222.0.46 () {60 vars in 1164 bytes} [Thu Jul 28 10:30:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:22.302008 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-2a563126-99de-4cb3-bdad-f6d2b4af9c73 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fd361365-e1d0-4dfe-a96e-7955db1eb655" status: 204 len: 0 microversion: 2.1 time: 1.251580 Jul 28 10:30:22.302863 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 34/81] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:30:21 2022] DELETE /compute/v2.1/servers/fd361365-e1d0-4dfe-a96e-7955db1eb655 => generated 0 bytes in 1256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:30:22.309971 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3f56f84f-68b0-4d64-937b-185d5112e850 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:22.310691 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3f56f84f-68b0-4d64-937b-185d5112e850 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: bde8bb05-4dc9-47d5-a97c-51184776c21f] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:22.318617 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3f56f84f-68b0-4d64-937b-185d5112e850 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:22.318617 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3f56f84f-68b0-4d64-937b-185d5112e850 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:22.319214 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3f56f84f-68b0-4d64-937b-185d5112e850 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:22.319663 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3f56f84f-68b0-4d64-937b-185d5112e850 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:22.353188 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3f56f84f-68b0-4d64-937b-185d5112e850 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:22.353755 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3f56f84f-68b0-4d64-937b-185d5112e850 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:22.354403 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-3f56f84f-68b0-4d64-937b-185d5112e850 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lazy-loading 'fault' on Instance uuid bde8bb05-4dc9-47d5-a97c-51184776c21f {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:30:22.383775 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7fd793d9-8e50-452c-8582-d05521979776 tempest-FlavorsV261TestJSON-2069243781 tempest-FlavorsV261TestJSON-2069243781-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-117986859", "id": 869700896, "os-flavor-access:is_public": "True"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:22.387334 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:22.387334 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:22.390963 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:DELETE=7,nova_api:SELECT=84,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:22.406316 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-3f56f84f-68b0-4d64-937b-185d5112e850 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:22.410984 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7fd793d9-8e50-452c-8582-d05521979776 tempest-FlavorsV261TestJSON-2069243781 tempest-FlavorsV261TestJSON-2069243781-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.247354 Jul 28 10:30:22.411334 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 48/82] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Jul 28 10:30:22 2022] POST /compute/v2.1/flavors => generated 464 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:30:22.416046 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-3f56f84f-68b0-4d64-937b-185d5112e850 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:22.417570 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-3f56f84f-68b0-4d64-937b-185d5112e850 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:22.418198 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-018736bd-0fe3-4a93-8486-7916ed6b7e0c tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Calling method '.version_select at 0x7fa95803dc10>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:22.418726 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3f56f84f-68b0-4d64-937b-185d5112e850 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] 10.222.0.46 "GET /compute/v2.1/servers/bde8bb05-4dc9-47d5-a97c-51184776c21f" status: 200 len: 1334 microversion: 2.25 time: 0.114725 Jul 28 10:30:22.419618 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 35/83] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:30:22 2022] GET /compute/v2.1/servers/bde8bb05-4dc9-47d5-a97c-51184776c21f => generated 1334 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:30:22.421144 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:22.421144 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:22.422639 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-018736bd-0fe3-4a93-8486-7916ed6b7e0c tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:22.423234 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-018736bd-0fe3-4a93-8486-7916ed6b7e0c tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:22.424175 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-018736bd-0fe3-4a93-8486-7916ed6b7e0c tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:22.424384 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c6f575fb-e5b2-4173-9877-a9226e82b706 tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] Calling method '.version_select at 0x7fa95829dee0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:22.424921 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-018736bd-0fe3-4a93-8486-7916ed6b7e0c tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:22.425258 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:22.425258 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:22.426440 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-c6f575fb-e5b2-4173-9877-a9226e82b706 tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '04e0e5a7067b4f799bcb1f9d378d88e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2aa532803a4e9588871fc423daf7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:22.428619 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c6f575fb-e5b2-4173-9877-a9226e82b706 tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] Request method failure captured: Jul 28 10:30:22.428619 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 28 10:30:22.428619 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:30:22.428619 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:30:22.428619 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:30:22.428619 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:30:22.428619 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:30:22.428619 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:30:22.428619 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:30:22.428619 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:22.428619 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mU6iNdK0LGjuEQX9woowofIpuXSCOg5ULcU23VSAxqpoS3QHfJ2pYQ0gMxbjgHfzfGy-kx91tbccDHRwhHHW4g8dQW63GJJyT3FDh-fvw4_3iiCa1L3gZhhon9QMD0JKgK2Z7KmemgNx797F0ul6iJvYtuP_L5SVdTaIdbnX7OYylw Jul 28 10:30:22.428619 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:30:22.428619 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:30:22.428619 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:30:22.428619 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:30:22.428619 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:30:22.428619 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:30:22.428619 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 9a2aa532803a4e9588871fc423daf7dd Jul 28 10:30:22.428619 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1384940952 Jul 28 10:30:22.428619 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:30:22.428619 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:30:22.430212 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9a2aa532803a4e9588871fc423daf7dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9a2aa532803a4e9588871fc423daf7dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9a2aa532803a4e9588871fc423daf7dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9a2aa532803a4e9588871fc423daf7dd", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:22.430212 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1384940952 Jul 28 10:30:22.430212 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 9a2aa532803a4e9588871fc423daf7dd Jul 28 10:30:22.430212 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1384940952 Jul 28 10:30:22.430212 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-HypervisorAdminNegativeTestJSON-1384940952-project Jul 28 10:30:22.430212 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:30:22.430212 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:30:22.430212 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 04e0e5a7067b4f799bcb1f9d378d88e4 Jul 28 10:30:22.430212 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1384940952-project Jul 28 10:30:22.430212 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:30:22.430212 n-d-850468-6 devstack@n-api.service[119463]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 28 10:30:22.430212 n-d-850468-6 devstack@n-api.service[119463]: action_args: {} Jul 28 10:30:22.430212 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:22.431179 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:22.431179 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:22.431179 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:22.431179 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:22.431179 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:22.431179 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:30:22.431179 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:30:22.431179 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:22.431179 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:22.431179 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 28 10:30:22.431179 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 28 10:30:22.431179 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:30:22.431179 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:30:22.431179 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:30:22.431179 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:30:22.431179 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:22.431179 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:22.431179 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:22.431179 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:22.432141 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:30:22.432141 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:30:22.432141 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:30:22.432141 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:30:22.432141 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:30:22.432141 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:30:22.432141 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 28 10:30:22.432141 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:22.432141 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:22.432141 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:22.432141 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:22.432141 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:22.432141 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:22.432141 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:30:22.432141 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:30:22.432141 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 28 10:30:22.432141 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:22.432981 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c6f575fb-e5b2-4173-9877-a9226e82b706 tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:22.432981 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c6f575fb-e5b2-4173-9877-a9226e82b706 tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.009171 Jul 28 10:30:22.432981 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 36/84] 10.222.0.46 () {58 vars in 1179 bytes} [Thu Jul 28 10:30:22 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:22.434881 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-35c61cef-4607-4d3b-ae86-fc24ee523271 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850468-6"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:22.437492 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:22.437492 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:22.449804 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-35c61cef-4607-4d3b-ae86-fc24ee523271 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:22.450325 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-35c61cef-4607-4d3b-ae86-fc24ee523271 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:22.458702 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-018736bd-0fe3-4a93-8486-7916ed6b7e0c tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.045955 Jul 28 10:30:22.459310 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 49/85] 10.222.0.46 () {58 vars in 1139 bytes} [Thu Jul 28 10:30:22 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:22.464948 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1848e232-7bb4-4834-9832-f893cb7aadf6 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:22.465575 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-1848e232-7bb4-4834-9832-f893cb7aadf6 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: fd361365-e1d0-4dfe-a96e-7955db1eb655] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:22.472903 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1848e232-7bb4-4834-9832-f893cb7aadf6 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:22.473301 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1848e232-7bb4-4834-9832-f893cb7aadf6 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:22.474321 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1848e232-7bb4-4834-9832-f893cb7aadf6 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:22.474786 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1848e232-7bb4-4834-9832-f893cb7aadf6 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:22.498769 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-1848e232-7bb4-4834-9832-f893cb7aadf6 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] HTTP exception thrown: Instance fd361365-e1d0-4dfe-a96e-7955db1eb655 could not be found. Jul 28 10:30:22.500936 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1848e232-7bb4-4834-9832-f893cb7aadf6 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Request method failure captured: Jul 28 10:30:22.500936 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/fd361365-e1d0-4dfe-a96e-7955db1eb655 HTTP/1.1 Jul 28 10:30:22.500936 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:22.500936 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:22.500936 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:22.500936 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:30:22.500936 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:22.500936 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:22.500936 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:22.500936 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:22.500936 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mU2cSa2Yi0QC4V65UWKxv6AW8hI3UjqYB3eaUm2n8ScTGHUoNIokdV-8UajOinP8Lnl1NBHFa33eSp0e_7OFv6f2OCMQHdqlou-YfFvt7q5r-_McZ5FLYOfY3ImL5Cizn-6HVe2ABo40M2Gc4shakDeSgLln8WXPNXPg-KKldxy3ck Jul 28 10:30:22.500936 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:22.500936 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:22.500936 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:22.500936 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:22.500936 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:22.500936 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:22.500936 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: ad5b53a76f3a4ed1bdbf8d475dff9f83 Jul 28 10:30:22.500936 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1044450029 Jul 28 10:30:22.500936 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:30:22.500936 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:30:22.502118 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ad5b53a76f3a4ed1bdbf8d475dff9f83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ad5b53a76f3a4ed1bdbf8d475dff9f83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ad5b53a76f3a4ed1bdbf8d475dff9f83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ad5b53a76f3a4ed1bdbf8d475dff9f83", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:22.502118 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-DeleteServersAdminTestJSON-1044450029 Jul 28 10:30:22.502118 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: ad5b53a76f3a4ed1bdbf8d475dff9f83 Jul 28 10:30:22.502118 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1044450029 Jul 28 10:30:22.502118 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-DeleteServersAdminTestJSON-1044450029-project Jul 28 10:30:22.502118 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:22.502118 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:22.502118 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: d4a3a77b4a3e4afbab66d34833cdcb0c Jul 28 10:30:22.502118 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-DeleteServersAdminTestJSON-1044450029-project Jul 28 10:30:22.502118 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:22.502118 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance fd361365-e1d0-4dfe-a96e-7955db1eb655 could not be found. Jul 28 10:30:22.502118 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'fd361365-e1d0-4dfe-a96e-7955db1eb655'} Jul 28 10:30:22.503468 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:22.503468 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:22.503468 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:30:22.503468 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:30:22.503468 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:30:22.503468 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:30:22.503468 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:30:22.503468 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:30:22.503468 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:30:22.503468 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:30:22.503468 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd361365-e1d0-4dfe-a96e-7955db1eb655 could not be found. Jul 28 10:30:22.503468 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:22.503468 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:22.503468 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:22.503468 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:22.503468 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:22.503468 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:22.503468 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:22.503468 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:22.503468 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:22.515000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:22.515000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:30:22.515000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:30:22.515000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:30:22.515000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:30:22.515000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:30:22.515000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:30:22.515000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd361365-e1d0-4dfe-a96e-7955db1eb655 could not be found. Jul 28 10:30:22.515000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:22.515000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:22.515000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:22.515000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:22.515000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:22.515000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:22.515000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:22.515000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:22.515000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd361365-e1d0-4dfe-a96e-7955db1eb655 could not be found. Jul 28 10:30:22.515000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:22.516247 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1848e232-7bb4-4834-9832-f893cb7aadf6 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Returning 404 to user: Instance fd361365-e1d0-4dfe-a96e-7955db1eb655 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:22.516247 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1848e232-7bb4-4834-9832-f893cb7aadf6 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] 10.222.0.46 "GET /compute/v2.1/servers/fd361365-e1d0-4dfe-a96e-7955db1eb655" status: 404 len: 111 microversion: 2.1 time: 0.042813 Jul 28 10:30:22.516247 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 50/86] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:30:22 2022] GET /compute/v2.1/servers/fd361365-e1d0-4dfe-a96e-7955db1eb655 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:22.613166 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-35c61cef-4607-4d3b-ae86-fc24ee523271 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 242 microversion: 2.1 time: 0.181539 Jul 28 10:30:22.613770 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 37/87] 10.222.0.46 () {60 vars in 1191 bytes} [Thu Jul 28 10:30:22 2022] POST /compute/v2.1/os-aggregates/8/action => generated 242 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:22.621807 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4bc731fd-731d-42a7-8183-0e8b80dafa54 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:22.622376 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-4bc731fd-731d-42a7-8183-0e8b80dafa54 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: bde8bb05-4dc9-47d5-a97c-51184776c21f] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:22.629347 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4bc731fd-731d-42a7-8183-0e8b80dafa54 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:22.629794 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4bc731fd-731d-42a7-8183-0e8b80dafa54 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:22.630628 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4bc731fd-731d-42a7-8183-0e8b80dafa54 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:22.631070 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4bc731fd-731d-42a7-8183-0e8b80dafa54 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:22.656989 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-4bc731fd-731d-42a7-8183-0e8b80dafa54 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: bde8bb05-4dc9-47d5-a97c-51184776c21f] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:30:22.701280 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-27b7fd80-9113-4486-97b1-9dc96293d608 tempest-FlavorsV261TestJSON-527787721 tempest-FlavorsV261TestJSON-527787721-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:22.715250 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-27b7fd80-9113-4486-97b1-9dc96293d608 tempest-FlavorsV261TestJSON-527787721 tempest-FlavorsV261TestJSON-527787721-project] 10.222.0.46 "GET /compute/v2.1/flavors/869700896" status: 200 len: 464 microversion: 2.61 time: 0.209523 Jul 28 10:30:22.715945 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 51/88] 10.222.0.46 () {60 vars in 1196 bytes} [Thu Jul 28 10:30:22 2022] GET /compute/v2.1/flavors/869700896 => generated 464 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:30:22.724028 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-4bc731fd-731d-42a7-8183-0e8b80dafa54 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: bde8bb05-4dc9-47d5-a97c-51184776c21f] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:30:22.724028 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4bc731fd-731d-42a7-8183-0e8b80dafa54 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:22.724028 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4bc731fd-731d-42a7-8183-0e8b80dafa54 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:22.724028 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-4bc731fd-731d-42a7-8183-0e8b80dafa54 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: bde8bb05-4dc9-47d5-a97c-51184776c21f] instance's host None is down, deleting from database Jul 28 10:30:22.728196 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-4bc731fd-731d-42a7-8183-0e8b80dafa54 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: bde8bb05-4dc9-47d5-a97c-51184776c21f] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:30:22.770843 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-4bc731fd-731d-42a7-8183-0e8b80dafa54 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: bde8bb05-4dc9-47d5-a97c-51184776c21f] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:30:22.779273 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-4bc731fd-731d-42a7-8183-0e8b80dafa54 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: bde8bb05-4dc9-47d5-a97c-51184776c21f] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:30:22.910615 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-121e8a71-8898-44a9-9245-8549cc533431 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] Calling method '.version_select at 0x7fa95803d0d0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:22.911480 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:22.911480 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:22.913056 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-121e8a71-8898-44a9-9245-8549cc533431 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:22.913543 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-121e8a71-8898-44a9-9245-8549cc533431 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:22.916902 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=72,nova_cell0:UPDATE=22,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:22.931036 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-121e8a71-8898-44a9-9245-8549cc533431 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:22.931819 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-121e8a71-8898-44a9-9245-8549cc533431 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:22.943262 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-121e8a71-8898-44a9-9245-8549cc533431 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:22.943759 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-121e8a71-8898-44a9-9245-8549cc533431 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:22.951153 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-121e8a71-8898-44a9-9245-8549cc533431 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.233781 Jul 28 10:30:22.951737 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 52/89] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:22 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:22.951864 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-4bc731fd-731d-42a7-8183-0e8b80dafa54 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bde8bb05-4dc9-47d5-a97c-51184776c21f" status: 204 len: 0 microversion: 2.25 time: 0.336913 Jul 28 10:30:22.952735 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 38/90] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:30:22 2022] DELETE /compute/v2.1/servers/bde8bb05-4dc9-47d5-a97c-51184776c21f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:30:22.957519 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6e1936f6-492c-4e79-abd7-35e6a4dd2d79 tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850468-6"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:22.960125 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:22.960125 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:22.960590 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b377e908-12ac-4d84-8ae0-b5dfd73f732d tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Calling method '.version_select at 0x7fa9583bcb80>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:22.961186 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-6e1936f6-492c-4e79-abd7-35e6a4dd2d79 tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '2409deb675254c8492a2846e0b412b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b6e6a2a1a14fc68b2b68160dcc4fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:22.962927 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6e1936f6-492c-4e79-abd7-35e6a4dd2d79 tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Request method failure captured: Jul 28 10:30:22.962927 n-d-850468-6 devstack@n-api.service[119463]: request: POST /compute/v2.1/os-aggregates/8/action HTTP/1.1 Jul 28 10:30:22.962927 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:30:22.962927 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:30:22.962927 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:30:22.962927 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 42 Jul 28 10:30:22.962927 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:30:22.962927 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:30:22.962927 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:30:22.962927 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:22.962927 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mUnnfwbbgEOZuTyUOrQC1OG4JPY2VBaSE6jueEG1VMO2NkmEr7V54P067GU_ND2qYgL2I6H3JhVBbn6i34O3cEjvIXgzm41lDv-e2YAXj0PKOpa9aVBfniDm_-ZMX65gjq-HbKuwPHruoDgD02OEZXN34MeHuTFc7uhfJYnmbZtm2Y Jul 28 10:30:22.962927 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:30:22.962927 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:30:22.962927 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:30:22.962927 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:30:22.962927 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:30:22.962927 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:30:22.962927 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 66b6e6a2a1a14fc68b2b68160dcc4fa3 Jul 28 10:30:22.962927 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-807240337 Jul 28 10:30:22.962927 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:30:22.962927 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:30:22.964022 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/66b6e6a2a1a14fc68b2b68160dcc4fa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66b6e6a2a1a14fc68b2b68160dcc4fa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66b6e6a2a1a14fc68b2b68160dcc4fa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_66b6e6a2a1a14fc68b2b68160dcc4fa3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:22.964022 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-807240337 Jul 28 10:30:22.964022 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 66b6e6a2a1a14fc68b2b68160dcc4fa3 Jul 28 10:30:22.964022 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-807240337 Jul 28 10:30:22.964022 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-AggregatesAdminNegativeTestJSON-807240337-project Jul 28 10:30:22.964022 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:30:22.964022 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:30:22.964022 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 2409deb675254c8492a2846e0b412b73 Jul 28 10:30:22.964022 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-807240337-project Jul 28 10:30:22.964022 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:30:22.964022 n-d-850468-6 devstack@n-api.service[119463]: {"remove_host": {"host": "n-h2-850468-6"}} Jul 28 10:30:22.964022 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:30:22.964022 n-d-850468-6 devstack@n-api.service[119463]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 28 10:30:22.964737 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '8', 'body': {'remove_host': {'host': 'n-h2-850468-6'}}} Jul 28 10:30:22.964737 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:22.964737 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:22.964737 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:22.964737 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:22.964737 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:22.964737 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:22.964737 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:22.964737 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:22.964737 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:22.964737 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:22.964737 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 28 10:30:22.964737 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 28 10:30:22.964737 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:30:22.964737 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:30:22.964737 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:30:22.964737 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:30:22.964737 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:22.964737 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:22.965689 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:22.965689 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:22.965689 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:30:22.965689 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:30:22.965689 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:30:22.965689 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:30:22.965689 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:30:22.965689 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:30:22.965689 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 28 10:30:22.965689 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:22.965689 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:22.965689 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:22.965689 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:22.965689 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:22.965689 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:22.965689 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:30:22.965689 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:30:22.965689 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 28 10:30:22.965689 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:22.966706 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:22.966706 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:22.966825 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6e1936f6-492c-4e79-abd7-35e6a4dd2d79 tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:22.966825 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6e1936f6-492c-4e79-abd7-35e6a4dd2d79 tempest-AggregatesAdminNegativeTestJSON-807240337 tempest-AggregatesAdminNegativeTestJSON-807240337-project] 10.222.0.46 "POST /compute/v2.1/os-aggregates/8/action" status: 403 len: 121 microversion: 2.1 time: 0.010805 Jul 28 10:30:22.966956 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b377e908-12ac-4d84-8ae0-b5dfd73f732d tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:22.967024 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 39/91] 10.222.0.46 () {60 vars in 1191 bytes} [Thu Jul 28 10:30:22 2022] POST /compute/v2.1/os-aggregates/8/action => generated 121 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:22.967088 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b377e908-12ac-4d84-8ae0-b5dfd73f732d tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:22.967088 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b377e908-12ac-4d84-8ae0-b5dfd73f732d tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:22.967088 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b377e908-12ac-4d84-8ae0-b5dfd73f732d tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:22.972762 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1746863361", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:22.989923 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b377e908-12ac-4d84-8ae0-b5dfd73f732d tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.036943 Jul 28 10:30:22.990525 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 53/92] 10.222.0.46 () {58 vars in 1145 bytes} [Thu Jul 28 10:30:22 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:30:22.996083 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4b68164e-82ba-4f3f-952e-410299cb9271 tempest-FlavorsV261TestJSON-2069243781 tempest-FlavorsV261TestJSON-2069243781-project-admin] Action: 'update', calling method: .version_select at 0x7fa95a4c7430>, body: {"flavor": {"description": "new"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:23.008113 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:23.008113 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:23.026122 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] validate_networks() for None {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:30:23.044464 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-4b68164e-82ba-4f3f-952e-410299cb9271 tempest-FlavorsV261TestJSON-2069243781 tempest-FlavorsV261TestJSON-2069243781-project-admin] 10.222.0.46 "PUT /compute/v2.1/flavors/869700896" status: 200 len: 465 microversion: 2.61 time: 0.052892 Jul 28 10:30:23.045826 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 54/93] 10.222.0.46 () {62 vars in 1216 bytes} [Thu Jul 28 10:30:22 2022] PUT /compute/v2.1/flavors/869700896 => generated 465 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:30:23.161670 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-3fef3641-12e0-4298-a53c-94624c27a62d tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-658850425", "id": 2111545190, "os-flavor-access:is_public": "False"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:23.165155 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:23.165155 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:23.180995 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-3fef3641-12e0-4298-a53c-94624c27a62d tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.134194 Jul 28 10:30:23.181840 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 55/94] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:23 2022] POST /compute/v2.1/flavors => generated 438 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:23.190453 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1d323036-c3ac-49ee-bb05-f815ff808bcf tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:23.191096 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-1d323036-c3ac-49ee-bb05-f815ff808bcf tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: bde8bb05-4dc9-47d5-a97c-51184776c21f] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:23.198349 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1d323036-c3ac-49ee-bb05-f815ff808bcf tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:23.198887 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1d323036-c3ac-49ee-bb05-f815ff808bcf tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:23.199709 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1d323036-c3ac-49ee-bb05-f815ff808bcf tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:23.200138 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1d323036-c3ac-49ee-bb05-f815ff808bcf tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:23.214997 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-1d323036-c3ac-49ee-bb05-f815ff808bcf tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] HTTP exception thrown: Instance bde8bb05-4dc9-47d5-a97c-51184776c21f could not be found. Jul 28 10:30:23.216545 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1d323036-c3ac-49ee-bb05-f815ff808bcf tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Request method failure captured: Jul 28 10:30:23.216545 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/bde8bb05-4dc9-47d5-a97c-51184776c21f HTTP/1.1 Jul 28 10:30:23.216545 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:23.216545 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:23.216545 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:23.216545 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:30:23.216545 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:23.216545 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:23.216545 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:23.216545 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:23.216545 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mUsDviFxmY2HLnGTreQtLgTrjcwl5_NhXA8w3Wifn-1kTLdQ48tKyZ79DQ9rEyzANfG20a4jdfnSWv4KS8pqkIbvf6DmNC9lXwT2Ni0Wut_Q1LjpGOxZtZ60egcXO8jPUx_e7sWdhLEkb8L4vGtXp4V7Pb0IXhzCJLNSEOBzCN4Avg Jul 28 10:30:23.216545 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:23.216545 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:23.216545 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:23.216545 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:23.216545 n-d-850468-6 devstack@n-api.service[119464]: X-Openstack-Nova-Api-Version: 2.25 Jul 28 10:30:23.216545 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:23.216545 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:23.216545 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 07e2042b56704e9fb5195d43d8116494 Jul 28 10:30:23.216545 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-131348017 Jul 28 10:30:23.216545 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:30:23.216545 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:30:23.218021 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/07e2042b56704e9fb5195d43d8116494"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/07e2042b56704e9fb5195d43d8116494"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/07e2042b56704e9fb5195d43d8116494"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_07e2042b56704e9fb5195d43d8116494", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:23.218021 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-131348017 Jul 28 10:30:23.218021 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 07e2042b56704e9fb5195d43d8116494 Jul 28 10:30:23.218021 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-131348017 Jul 28 10:30:23.218021 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-LiveAutoBlockMigrationV225Test-131348017-project Jul 28 10:30:23.218021 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:23.218021 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:23.218021 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 5a46f399714c4124a253c57a26f77a0b Jul 28 10:30:23.218021 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-131348017-project Jul 28 10:30:23.218021 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:23.218021 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance bde8bb05-4dc9-47d5-a97c-51184776c21f could not be found. Jul 28 10:30:23.218021 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'bde8bb05-4dc9-47d5-a97c-51184776c21f'} Jul 28 10:30:23.218878 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:23.218878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:23.218878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:30:23.218878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:30:23.218878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:30:23.218878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:30:23.218878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:30:23.218878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:30:23.218878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:30:23.218878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:30:23.218878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bde8bb05-4dc9-47d5-a97c-51184776c21f could not be found. Jul 28 10:30:23.218878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.218878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:23.218878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.218878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:23.218878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:23.218878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:23.218878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:23.218878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:23.218878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:23.220107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:23.220107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:30:23.220107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:30:23.220107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:30:23.220107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:30:23.220107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:30:23.220107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:30:23.220107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bde8bb05-4dc9-47d5-a97c-51184776c21f could not be found. Jul 28 10:30:23.220107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.220107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:23.220107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.220107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:23.220107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:23.220107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:23.220107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:23.220107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:23.220107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bde8bb05-4dc9-47d5-a97c-51184776c21f could not be found. Jul 28 10:30:23.220107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.221034 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1d323036-c3ac-49ee-bb05-f815ff808bcf tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Returning 404 to user: Instance bde8bb05-4dc9-47d5-a97c-51184776c21f could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:23.221034 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1d323036-c3ac-49ee-bb05-f815ff808bcf tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] 10.222.0.46 "GET /compute/v2.1/servers/bde8bb05-4dc9-47d5-a97c-51184776c21f" status: 404 len: 111 microversion: 2.25 time: 0.035364 Jul 28 10:30:23.221034 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 56/95] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:30:23 2022] GET /compute/v2.1/servers/bde8bb05-4dc9-47d5-a97c-51184776c21f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:30:23.229229 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0aa435c5-bfd0-4a17-8673-9160dad57b8f tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] Calling method '.version_select at 0x7fa94bffc9d0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:23.229229 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:23.229229 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:23.229229 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-0aa435c5-bfd0-4a17-8673-9160dad57b8f tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '04e0e5a7067b4f799bcb1f9d378d88e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2aa532803a4e9588871fc423daf7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:23.229229 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0aa435c5-bfd0-4a17-8673-9160dad57b8f tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] Request method failure captured: Jul 28 10:30:23.229229 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 28 10:30:23.229229 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:23.229229 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:23.229229 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:23.229229 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:30:23.229972 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:23.229972 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:23.229972 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:23.229972 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:23.229972 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mU6iNdK0LGjuEQX9woowofIpuXSCOg5ULcU23VSAxqpoS3QHfJ2pYQ0gMxbjgHfzfGy-kx91tbccDHRwhHHW4g8dQW63GJJyT3FDh-fvw4_3iiCa1L3gZhhon9QMD0JKgK2Z7KmemgNx797F0ul6iJvYtuP_L5SVdTaIdbnX7OYylw Jul 28 10:30:23.229972 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:23.229972 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:23.229972 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:23.229972 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:23.229972 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:23.229972 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:23.229972 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 9a2aa532803a4e9588871fc423daf7dd Jul 28 10:30:23.229972 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1384940952 Jul 28 10:30:23.229972 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:30:23.229972 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:30:23.229972 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9a2aa532803a4e9588871fc423daf7dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9a2aa532803a4e9588871fc423daf7dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9a2aa532803a4e9588871fc423daf7dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9a2aa532803a4e9588871fc423daf7dd", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:23.229972 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1384940952 Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 9a2aa532803a4e9588871fc423daf7dd Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1384940952 Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-HypervisorAdminNegativeTestJSON-1384940952-project Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 04e0e5a7067b4f799bcb1f9d378d88e4 Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1384940952-project Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '1'} Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:30:23.230864 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:30:23.233574 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:30:23.233574 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:30:23.233574 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:23.233574 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:23.233574 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:23.233574 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:23.233574 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:30:23.233574 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:30:23.233574 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:30:23.233574 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:30:23.233574 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:30:23.233574 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:30:23.233574 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 28 10:30:23.233574 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.233574 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:23.233574 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.233574 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:23.233574 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:23.233574 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:23.233574 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:30:23.237338 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:30:23.237338 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 28 10:30:23.237338 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.237338 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0aa435c5-bfd0-4a17-8673-9160dad57b8f tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:23.237338 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0aa435c5-bfd0-4a17-8673-9160dad57b8f tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.010865 Jul 28 10:30:23.237338 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 57/96] 10.222.0.46 () {58 vars in 1173 bytes} [Thu Jul 28 10:30:23 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:23.237338 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a915c75d-ece8-4fdb-9222-31edb7d0b650 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850468-6"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:23.244755 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:23.244755 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:23.262002 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a915c75d-ece8-4fdb-9222-31edb7d0b650 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:23.262716 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a915c75d-ece8-4fdb-9222-31edb7d0b650 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:23.363100 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:30:23.363626 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:30:23.364178 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:30:23.364724 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:30:23.365281 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:30:23.375903 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:23.376429 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:23.377295 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:23.377813 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:23.389427 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a915c75d-ece8-4fdb-9222-31edb7d0b650 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.156324 Jul 28 10:30:23.390234 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 58/97] 10.222.0.46 () {60 vars in 1191 bytes} [Thu Jul 28 10:30:23 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:23.394813 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9e713b14-57e3-49be-a7d9-8191a939e284 tempest-FlavorsV261TestJSON-527787721 tempest-FlavorsV261TestJSON-527787721-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:23.400713 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Getting quotas for project ad5b53a76f3a4ed1bdbf8d475dff9f83. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:30:23.406861 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Getting quotas for user d4a3a77b4a3e4afbab66d34833cdcb0c and project ad5b53a76f3a4ed1bdbf8d475dff9f83. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:30:23.428674 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9e713b14-57e3-49be-a7d9-8191a939e284 tempest-FlavorsV261TestJSON-527787721 tempest-FlavorsV261TestJSON-527787721-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 6246 microversion: 2.61 time: 0.037444 Jul 28 10:30:23.429152 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 59/98] 10.222.0.46 () {60 vars in 1187 bytes} [Thu Jul 28 10:30:23 2022] GET /compute/v2.1/flavors/detail => generated 6246 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:30:23.430162 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:30:23.432687 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: f94f5e3f-aa7d-4f6a-913a-41698d9f7541] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:30:23.434100 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1c25dd49-6d6f-4a9e-bef3-c0d01e908705 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "646fc7da0f744baf8b0467c97ec82ccf"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:23.436480 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:23.436480 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:23.480722 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-423e25be-3949-483e-8264-86765f5c8b35 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514835 Jul 28 10:30:23.481276 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 40/99] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:30:23.497648 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-03598d2d-1bc4-4346-b0b1-dc25885652d5 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] Calling method '.version_select at 0x7fa9582c2040>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:23.500037 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:23.500037 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:23.501572 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-03598d2d-1bc4-4346-b0b1-dc25885652d5 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] HTTP exception thrown: Hypervisor with ID 'f6dab8be-ed95-4603-8e39-8958344ec705' could not be found. Jul 28 10:30:23.504592 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-03598d2d-1bc4-4346-b0b1-dc25885652d5 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] Request method failure captured: Jul 28 10:30:23.504592 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/os-hypervisors/f6dab8be-ed95-4603-8e39-8958344ec705/uptime HTTP/1.1 Jul 28 10:30:23.504592 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:30:23.504592 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:30:23.504592 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:30:23.504592 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:30:23.504592 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:30:23.504592 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:30:23.504592 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:30:23.504592 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:23.504592 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mU9B6bHF7R9Bdk3ZXoG9AsvxeirLfL9Ph7L2aiXqhTO37OBOnIwQWTvR3K0QSIG-S8JeUcj4xZhqkwySR7hvsTyKMJ_br0a9KPIXIDvUB_4K0hV5uMvxrJftXTCD6Uc0LmSDsQWgGxDW5p1yqD-7PbuBn-ApgbKRmExJWBUf4miqto Jul 28 10:30:23.504592 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:30:23.504592 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:30:23.504592 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:30:23.504592 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:30:23.504592 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:30:23.504592 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:30:23.504592 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: fa9aeb693c554143a1ce5615536321d5 Jul 28 10:30:23.504592 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-358842774 Jul 28 10:30:23.504592 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member,admin Jul 28 10:30:23.504592 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member,admin Jul 28 10:30:23.506248 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fa9aeb693c554143a1ce5615536321d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fa9aeb693c554143a1ce5615536321d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fa9aeb693c554143a1ce5615536321d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fa9aeb693c554143a1ce5615536321d5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:23.506248 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-358842774 Jul 28 10:30:23.506248 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: fa9aeb693c554143a1ce5615536321d5 Jul 28 10:30:23.506248 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-358842774 Jul 28 10:30:23.506248 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin Jul 28 10:30:23.506248 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:30:23.506248 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:30:23.506248 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: b2083c41286444dcad6123e9a20ecc8f Jul 28 10:30:23.506248 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin Jul 28 10:30:23.506248 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:30:23.506248 n-d-850468-6 devstack@n-api.service[119463]: exception: Hypervisor with ID 'f6dab8be-ed95-4603-8e39-8958344ec705' could not be found. Jul 28 10:30:23.506248 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'f6dab8be-ed95-4603-8e39-8958344ec705'} Jul 28 10:30:23.506928 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:23.506928 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:23.506928 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 28 10:30:23.506928 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 28 10:30:23.506928 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'f6dab8be-ed95-4603-8e39-8958344ec705' Jul 28 10:30:23.506928 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.506928 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:23.506928 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.506928 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:23.506928 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 28 10:30:23.506928 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 28 10:30:23.506928 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 28 10:30:23.506928 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 28 10:30:23.506928 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 28 10:30:23.506928 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.506928 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:23.506928 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.506928 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:23.506928 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 28 10:30:23.506928 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 28 10:30:23.506928 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 28 10:30:23.506928 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 28 10:30:23.508850 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 28 10:30:23.508850 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.508850 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:23.508850 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.508850 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:23.508850 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:23.508850 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:23.508850 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:23.508850 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:23.508850 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:30:23.508850 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:30:23.508850 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:23.508850 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:23.508850 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 28 10:30:23.508850 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 28 10:30:23.508850 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 28 10:30:23.508850 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 10:30:23.508850 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'f6dab8be-ed95-4603-8e39-8958344ec705' could not be found. Jul 28 10:30:23.508850 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.508850 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:23.508850 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.510311 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:23.510311 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:23.510311 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:23.510311 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:23.510311 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:23.510311 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'f6dab8be-ed95-4603-8e39-8958344ec705' could not be found. Jul 28 10:30:23.510311 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.510311 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-03598d2d-1bc4-4346-b0b1-dc25885652d5 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] Returning 404 to user: Hypervisor with ID 'f6dab8be-ed95-4603-8e39-8958344ec705' could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:23.510311 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-03598d2d-1bc4-4346-b0b1-dc25885652d5 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/f6dab8be-ed95-4603-8e39-8958344ec705/uptime" status: 404 len: 123 microversion: 2.1 time: 0.018264 Jul 28 10:30:23.510311 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 41/100] 10.222.0.46 () {58 vars in 1278 bytes} [Thu Jul 28 10:30:23 2022] GET /compute/v2.1/os-hypervisors/f6dab8be-ed95-4603-8e39-8958344ec705/uptime => generated 123 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:23.512661 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-108041916", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "1c87581d-6ea4-480a-85dd-94af3087f3e2"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:23.526170 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1c25dd49-6d6f-4a9e-bef3-c0d01e908705 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/2111545190/action" status: 200 len: 97 microversion: 2.1 time: 0.095511 Jul 28 10:30:23.527106 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 60/101] 10.222.0.46 () {60 vars in 1200 bytes} [Thu Jul 28 10:30:23 2022] POST /compute/v2.1/flavors/2111545190/action => generated 97 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:30:23.538780 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d0d1541e-ed69-42c3-bb3b-09ddafcb79cf tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:23.540569 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:23.540569 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:23.569794 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-d0d1541e-ed69-42c3-bb3b-09ddafcb79cf tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.041493 Jul 28 10:30:23.571154 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 61/102] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:30:23 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 10:30:23.580627 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2f368d1f-21b9-473e-ac31-d4374833b4c8 tempest-FlavorsV261TestJSON-527787721 tempest-FlavorsV261TestJSON-527787721-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:23.598478 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] validate_networks() for [('1c87581d-6ea4-480a-85dd-94af3087f3e2', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:30:23.602518 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-2f368d1f-21b9-473e-ac31-d4374833b4c8 tempest-FlavorsV261TestJSON-527787721 tempest-FlavorsV261TestJSON-527787721-project] 10.222.0.46 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.61 time: 0.025712 Jul 28 10:30:23.603095 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 62/103] 10.222.0.46 () {60 vars in 1166 bytes} [Thu Jul 28 10:30:23 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:30:23.609436 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d2b9577e-177e-4e5f-b34d-cb70d9512344 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:23.610361 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-d2b9577e-177e-4e5f-b34d-cb70d9512344 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: f94f5e3f-aa7d-4f6a-913a-41698d9f7541] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:23.674964 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-d2b9577e-177e-4e5f-b34d-cb70d9512344 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a3a77b4a3e4afbab66d34833cdcb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5b53a76f3a4ed1bdbf8d475dff9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:23.684746 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-d2b9577e-177e-4e5f-b34d-cb70d9512344 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] 10.222.0.46 "GET /compute/v2.1/servers/f94f5e3f-aa7d-4f6a-913a-41698d9f7541" status: 200 len: 1220 microversion: 2.1 time: 0.080340 Jul 28 10:30:23.685322 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 63/104] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:30:23 2022] GET /compute/v2.1/servers/f94f5e3f-aa7d-4f6a-913a-41698d9f7541 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:23.698575 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-16dbea6f-e682-478e-990e-5a6ab2f2a656 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] Calling method '.version_select at 0x7fa94bfe7ca0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:23.699388 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:23.699388 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:23.700576 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-16dbea6f-e682-478e-990e-5a6ab2f2a656 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:23.701029 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-16dbea6f-e682-478e-990e-5a6ab2f2a656 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:23.716379 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-16dbea6f-e682-478e-990e-5a6ab2f2a656 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:23.716833 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-16dbea6f-e682-478e-990e-5a6ab2f2a656 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:23.728681 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-16dbea6f-e682-478e-990e-5a6ab2f2a656 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:23.728867 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-16dbea6f-e682-478e-990e-5a6ab2f2a656 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:23.735397 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-16dbea6f-e682-478e-990e-5a6ab2f2a656 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.048791 Jul 28 10:30:23.736326 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 64/105] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:23.740866 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ab81c317-6d46-4d5d-a1ac-f05fa78475c1 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "646fc7da0f744baf8b0467c97ec82ccf"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:23.744670 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:23.744670 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:23.818826 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-ab81c317-6d46-4d5d-a1ac-f05fa78475c1 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] HTTP exception thrown: Flavor access already exists for flavor 20 and project 646fc7da0f744baf8b0467c97ec82ccf combination. Jul 28 10:30:23.823217 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ab81c317-6d46-4d5d-a1ac-f05fa78475c1 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Request method failure captured: Jul 28 10:30:23.823217 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/flavors/2111545190/action HTTP/1.1 Jul 28 10:30:23.823217 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:23.823217 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:23.823217 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:23.823217 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 67 Jul 28 10:30:23.823217 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:23.823217 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:23.823217 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:23.823217 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:23.823217 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mU-FofhN-B5BYHMNoV1NJ6LQEerxH31GuL7Zwts9iaAIb7t91PkCleGApfzxCyeuiQ8f82VX3-ZD5xbW4IA-4l8GriHqVDyoXulVefvrmIlO__RhI7QUbko1KC8vZZDyelgxd4KHZxds6q7xebRk2PwygnDcRWNwWsdDL0w8IcspfE Jul 28 10:30:23.823217 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:23.823217 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:23.823217 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:23.823217 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:23.823217 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:23.823217 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:23.823217 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: fec9c0d7214f43b7bcc499a91acf51fb Jul 28 10:30:23.823217 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-977534592 Jul 28 10:30:23.823217 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:30:23.823217 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:30:23.825657 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fec9c0d7214f43b7bcc499a91acf51fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fec9c0d7214f43b7bcc499a91acf51fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fec9c0d7214f43b7bcc499a91acf51fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fec9c0d7214f43b7bcc499a91acf51fb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:23.825657 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-977534592 Jul 28 10:30:23.825657 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: fec9c0d7214f43b7bcc499a91acf51fb Jul 28 10:30:23.825657 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-977534592 Jul 28 10:30:23.825657 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin Jul 28 10:30:23.825657 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:23.825657 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:23.825657 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: cf085c6967e64c46a671f94f16354ba9 Jul 28 10:30:23.825657 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin Jul 28 10:30:23.825657 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:30:23.825657 n-d-850468-6 devstack@n-api.service[119464]: {"addTenantAccess": {"tenant": "646fc7da0f744baf8b0467c97ec82ccf"}} Jul 28 10:30:23.825657 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:23.826962 n-d-850468-6 devstack@n-api.service[119464]: exception: Flavor access already exists for flavor 20 and project 646fc7da0f744baf8b0467c97ec82ccf combination. Jul 28 10:30:23.826962 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '2111545190', 'body': {'addTenantAccess': {'tenant': '646fc7da0f744baf8b0467c97ec82ccf'}}} Jul 28 10:30:23.826962 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:23.826962 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:23.826962 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 10:30:23.826962 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 28 10:30:23.826962 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 10:30:23.826962 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 28 10:30:23.826962 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 10:30:23.826962 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 28 10:30:23.826962 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 10:30:23.826962 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 28 10:30:23.826962 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 10:30:23.826962 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 10:30:23.826962 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 10:30:23.826962 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result.read() Jul 28 10:30:23.826962 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 10:30:23.826962 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 28 10:30:23.828829 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 10:30:23.828829 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 28 10:30:23.828829 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 10:30:23.828829 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 28 10:30:23.828829 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 10:30:23.828829 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 28 10:30:23.828829 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '20-646fc7da0f744baf8b0467c97ec82ccf' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 28 10:30:23.828829 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.828829 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 28 10:30:23.828829 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.828829 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:23.828829 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 28 10:30:23.828829 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 28 10:30:23.828829 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 28 10:30:23.828829 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi session.flush() Jul 28 10:30:23.828829 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 10:30:23.828829 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 28 10:30:23.828829 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 10:30:23.828829 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 28 10:30:23.831811 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 10:30:23.831811 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 28 10:30:23.831811 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 10:30:23.831811 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception Jul 28 10:30:23.831811 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 10:30:23.831811 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 28 10:30:23.831811 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 10:30:23.831811 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 28 10:30:23.831811 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 10:30:23.831811 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 28 10:30:23.831811 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 10:30:23.831811 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 28 10:30:23.831811 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 10:30:23.831811 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 28 10:30:23.831811 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 10:30:23.831811 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 10:30:23.831811 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 10:30:23.831811 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 28 10:30:23.836748 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 10:30:23.836748 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 28 10:30:23.836748 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 10:30:23.836748 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 28 10:30:23.836748 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 10:30:23.836748 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 10:30:23.836748 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 10:30:23.836748 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception Jul 28 10:30:23.836748 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 10:30:23.836748 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 28 10:30:23.836748 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 10:30:23.836748 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 28 10:30:23.836748 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 10:30:23.836748 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 28 10:30:23.836748 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 10:30:23.836748 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 28 10:30:23.836748 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 10:30:23.836748 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 10:30:23.841154 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 10:30:23.841154 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result.read() Jul 28 10:30:23.841154 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 10:30:23.841154 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 28 10:30:23.841154 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 10:30:23.841154 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 28 10:30:23.841154 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 10:30:23.841154 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 28 10:30:23.841154 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 10:30:23.841154 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 28 10:30:23.841154 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '20-646fc7da0f744baf8b0467c97ec82ccf' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 28 10:30:23.841154 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 28 10:30:23.841154 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 28, 10, 30, 23, 813434), 'updated_at': None, 'flavor_id': 20, 'project_id': '646fc7da0f744baf8b0467c97ec82ccf'}] Jul 28 10:30:23.841154 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 10:30:23.841154 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.841154 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:23.841154 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.844438 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:23.844438 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 28 10:30:23.844438 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 28 10:30:23.844438 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 28 10:30:23.844438 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 28 10:30:23.844438 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 28 10:30:23.844438 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 28 10:30:23.844438 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 28 10:30:23.844438 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 28 10:30:23.844438 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 28 10:30:23.844438 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 28 10:30:23.844438 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:30:23.844438 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:30:23.844438 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 28 10:30:23.844438 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 28 10:30:23.844438 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 20 and project 646fc7da0f744baf8b0467c97ec82ccf combination. Jul 28 10:30:23.844438 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.844438 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:23.844438 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.848138 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:23.848138 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:23.848138 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:23.848138 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:23.848138 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:23.848138 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:23.848138 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:23.848138 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:23.848138 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:23.848138 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 28 10:30:23.848138 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 28 10:30:23.848138 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 20 and project 646fc7da0f744baf8b0467c97ec82ccf combination. Jul 28 10:30:23.848138 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.848138 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:23.848138 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.848138 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:23.848138 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:23.848138 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:23.848138 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:23.848138 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:23.853081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 20 and project 646fc7da0f744baf8b0467c97ec82ccf combination. Jul 28 10:30:23.853081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.853081 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ab81c317-6d46-4d5d-a1ac-f05fa78475c1 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Returning 409 to user: Flavor access already exists for flavor 20 and project 646fc7da0f744baf8b0467c97ec82ccf combination. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:23.853081 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ab81c317-6d46-4d5d-a1ac-f05fa78475c1 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/2111545190/action" status: 409 len: 152 microversion: 2.1 time: 0.088084 Jul 28 10:30:23.853081 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 65/106] 10.222.0.46 () {60 vars in 1200 bytes} [Thu Jul 28 10:30:23 2022] POST /compute/v2.1/flavors/2111545190/action => generated 152 bytes in 90 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:30:23.853081 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-746af898-64e4-4fbc-b1e1-06aa2ee10f54 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-998264514"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:23.858774 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:23.858774 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:23.858774 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.aggregate [None req-746af898-64e4-4fbc-b1e1-06aa2ee10f54 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Generated uuid 6f2a6a92-9992-4088-aace-4e08134af9dd for aggregate {{(pid=119464) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 10:30:23.868013 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-746af898-64e4-4fbc-b1e1-06aa2ee10f54 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.038927 Jul 28 10:30:23.869237 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 66/107] 10.222.0.46 () {60 vars in 1164 bytes} [Thu Jul 28 10:30:23 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:23.880684 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a8eb3ea6-4c3b-4abc-b548-1020f35428f3 tempest-FlavorsV261TestJSON-2069243781 tempest-FlavorsV261TestJSON-2069243781-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:23.881537 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:23.881537 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:23.901101 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a8eb3ea6-4c3b-4abc-b548-1020f35428f3 tempest-FlavorsV261TestJSON-2069243781 tempest-FlavorsV261TestJSON-2069243781-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/869700896" status: 202 len: 0 microversion: 2.61 time: 0.029716 Jul 28 10:30:23.905927 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 67/108] 10.222.0.46 () {60 vars in 1199 bytes} [Thu Jul 28 10:30:23 2022] DELETE /compute/v2.1/flavors/869700896 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:30:23.906828 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6ac6cf8f-ac65-4d8a-9b98-b8a3e1ecbb35 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Calling method '.version_select at 0x7fa94bffc0d0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:23.909475 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:23.909475 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:23.910684 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6ac6cf8f-ac65-4d8a-9b98-b8a3e1ecbb35 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:23.911130 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6ac6cf8f-ac65-4d8a-9b98-b8a3e1ecbb35 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:23.911919 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6ac6cf8f-ac65-4d8a-9b98-b8a3e1ecbb35 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:23.912349 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6ac6cf8f-ac65-4d8a-9b98-b8a3e1ecbb35 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:23.936560 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-6ac6cf8f-ac65-4d8a-9b98-b8a3e1ecbb35 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.033306 Jul 28 10:30:23.937257 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 68/109] 10.222.0.46 () {58 vars in 1128 bytes} [Thu Jul 28 10:30:23 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:23.941726 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f7e5d0ce-c958-495d-8054-113fb5fd3440 tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] Calling method '.version_select at 0x7fa94bffc5e0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:23.942934 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:23.942934 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:23.944038 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-f7e5d0ce-c958-495d-8054-113fb5fd3440 tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '04e0e5a7067b4f799bcb1f9d378d88e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2aa532803a4e9588871fc423daf7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:23.945690 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f7e5d0ce-c958-495d-8054-113fb5fd3440 tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] Request method failure captured: Jul 28 10:30:23.945690 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 28 10:30:23.945690 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:23.945690 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:23.945690 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:23.945690 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:30:23.945690 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:23.945690 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:23.945690 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:23.945690 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:23.945690 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mU6iNdK0LGjuEQX9woowofIpuXSCOg5ULcU23VSAxqpoS3QHfJ2pYQ0gMxbjgHfzfGy-kx91tbccDHRwhHHW4g8dQW63GJJyT3FDh-fvw4_3iiCa1L3gZhhon9QMD0JKgK2Z7KmemgNx797F0ul6iJvYtuP_L5SVdTaIdbnX7OYylw Jul 28 10:30:23.945690 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:23.945690 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:23.945690 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:23.945690 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:23.945690 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:23.945690 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:23.945690 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 9a2aa532803a4e9588871fc423daf7dd Jul 28 10:30:23.945690 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1384940952 Jul 28 10:30:23.945690 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:30:23.945690 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:30:23.947209 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9a2aa532803a4e9588871fc423daf7dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9a2aa532803a4e9588871fc423daf7dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9a2aa532803a4e9588871fc423daf7dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9a2aa532803a4e9588871fc423daf7dd", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:23.947209 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1384940952 Jul 28 10:30:23.947209 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 9a2aa532803a4e9588871fc423daf7dd Jul 28 10:30:23.947209 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1384940952 Jul 28 10:30:23.947209 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-HypervisorAdminNegativeTestJSON-1384940952-project Jul 28 10:30:23.947209 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:23.947209 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:23.947209 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 04e0e5a7067b4f799bcb1f9d378d88e4 Jul 28 10:30:23.947209 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1384940952-project Jul 28 10:30:23.947209 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:30:23.947209 n-d-850468-6 devstack@n-api.service[119464]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 28 10:30:23.947209 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '1'} Jul 28 10:30:23.947209 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:23.947951 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:23.947951 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:23.947951 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:23.947951 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:23.947951 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:23.947951 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:30:23.947951 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:30:23.947951 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:23.947951 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:23.947951 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 28 10:30:23.947951 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 28 10:30:23.947951 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 28 10:30:23.947951 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 28 10:30:23.947951 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:30:23.947951 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:30:23.947951 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:30:23.947951 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:30:23.947951 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:23.947951 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:23.948902 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:23.948902 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:23.948902 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:30:23.948902 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:30:23.948902 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:30:23.948902 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:30:23.948902 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:30:23.948902 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:30:23.948902 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 28 10:30:23.948902 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.948902 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:23.948902 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.948902 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:23.948902 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:23.948902 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:23.948902 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:30:23.948902 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:30:23.948902 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 28 10:30:23.948902 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:23.949903 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f7e5d0ce-c958-495d-8054-113fb5fd3440 tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:23.949903 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f7e5d0ce-c958-495d-8054-113fb5fd3440 tempest-HypervisorAdminNegativeTestJSON-1384940952 tempest-HypervisorAdminNegativeTestJSON-1384940952-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.009007 Jul 28 10:30:23.949903 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 69/110] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:30:23 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:23.955676 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-10378804-eb9d-4564-9570-2bb350ada2c4 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "646fc7da0f744baf8b0467c97ec82ccf"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:23.958253 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:23.958253 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:24.034381 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-10378804-eb9d-4564-9570-2bb350ada2c4 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/2111545190/action" status: 200 len: 21 microversion: 2.1 time: 0.085650 Jul 28 10:30:24.034974 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 70/111] 10.222.0.46 () {60 vars in 1200 bytes} [Thu Jul 28 10:30:23 2022] POST /compute/v2.1/flavors/2111545190/action => generated 21 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:30:24.040185 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-041d7698-0022-43eb-ab05-a046e3896cc9 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:24.042981 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:24.042981 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:24.050722 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-041d7698-0022-43eb-ab05-a046e3896cc9 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:24.051178 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-041d7698-0022-43eb-ab05-a046e3896cc9 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:24.057117 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-041d7698-0022-43eb-ab05-a046e3896cc9 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:24.057561 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-041d7698-0022-43eb-ab05-a046e3896cc9 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:24.064696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.compute.aggregates [None req-041d7698-0022-43eb-ab05-a046e3896cc9 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Failed to remove host nonexist_host from aggregate 9. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 28 10:30:24.065202 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-041d7698-0022-43eb-ab05-a046e3896cc9 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 9 Jul 28 10:30:24.067105 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-041d7698-0022-43eb-ab05-a046e3896cc9 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Request method failure captured: Jul 28 10:30:24.067105 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Jul 28 10:30:24.067105 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:24.067105 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:24.067105 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:24.067105 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 42 Jul 28 10:30:24.067105 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:24.067105 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:24.067105 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:24.067105 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:24.067105 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mUrvnOKR7s2erMDEF-eWgoTtWeskMcU69AoBqvQ_ggKW-ftZgGFq0vfovDXBWVUghxdR3AJNICypBkFp2gZ25pv8tI_HqVAIgT-bk3pLUGrKlaztDyIl6elwzgiOj9t7pS2mwD6DbypP9_TCjoLU0VdJME_2bI8gUmZmVtSdtD3Uiw Jul 28 10:30:24.067105 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:24.067105 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:24.067105 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:24.067105 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:24.067105 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:24.067105 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:24.067105 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 5b3cdc506169435795c2c4ff25801a89 Jul 28 10:30:24.067105 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:24.067105 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:30:24.067105 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:30:24.068237 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5b3cdc506169435795c2c4ff25801a89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5b3cdc506169435795c2c4ff25801a89", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:24.068237 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:24.068237 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 5b3cdc506169435795c2c4ff25801a89 Jul 28 10:30:24.068237 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-165834071 Jul 28 10:30:24.068237 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin Jul 28 10:30:24.068237 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:24.068237 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:24.068237 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 7eb41802201e494bb70118c7ba700376 Jul 28 10:30:24.068237 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin Jul 28 10:30:24.068237 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:30:24.068237 n-d-850468-6 devstack@n-api.service[119464]: {"remove_host": {"host": "nonexist_host"}} Jul 28 10:30:24.068237 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:24.068237 n-d-850468-6 devstack@n-api.service[119464]: exception: Cannot remove host nonexist_host in aggregate 9 Jul 28 10:30:24.069000 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '9', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 28 10:30:24.069000 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:24.069000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:24.069000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5950, in _get_service_in_cell_by_host Jul 28 10:30:24.069000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 28 10:30:24.069000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:30:24.069000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:30:24.069000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 28 10:30:24.069000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 28 10:30:24.069000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:30:24.069000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:30:24.069000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 28 10:30:24.069000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 28 10:30:24.069000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 28 10:30:24.069000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:24.069000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:24.069000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:24.069000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:24.069000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5956, in _get_service_in_cell_by_host Jul 28 10:30:24.069000 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 28 10:30:24.070155 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6018, in _find_service_in_cell Jul 28 10:30:24.070155 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 28 10:30:24.070155 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 28 10:30:24.070155 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:24.070155 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:24.070155 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:24.070155 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:24.070155 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 28 10:30:24.070155 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 28 10:30:24.070155 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 10:30:24.070155 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 10:30:24.070155 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:24.070155 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:24.070155 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:24.070155 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:24.070155 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 10:30:24.070155 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 10:30:24.070155 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6637, in remove_host_from_aggregate Jul 28 10:30:24.070155 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 28 10:30:24.070155 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5958, in _get_service_in_cell_by_host Jul 28 10:30:24.072386 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 28 10:30:24.072386 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 28 10:30:24.072386 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:24.072386 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:24.072386 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:24.072386 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:24.072386 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:24.072386 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:24.072386 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:24.072386 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:24.072386 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:24.072386 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:24.072386 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:24.072386 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:24.072386 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 28 10:30:24.072386 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 10:30:24.072386 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 9 Jul 28 10:30:24.072386 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:24.072386 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:24.072386 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:24.072386 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:24.073513 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:24.073513 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:24.073513 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:24.073513 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:24.073513 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 9 Jul 28 10:30:24.073513 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:24.073513 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-041d7698-0022-43eb-ab05-a046e3896cc9 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 9 {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:24.073513 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-041d7698-0022-43eb-ab05-a046e3896cc9 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/9/action" status: 404 len: 93 microversion: 2.1 time: 0.032572 Jul 28 10:30:24.073513 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 71/112] 10.222.0.46 () {60 vars in 1191 bytes} [Thu Jul 28 10:30:24 2022] POST /compute/v2.1/os-aggregates/9/action => generated 93 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:30:24.077367 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7ee27102-c966-48dd-9abb-509df9c3a811 tempest-FlavorsV261TestJSON-2069243781 tempest-FlavorsV261TestJSON-2069243781-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:24.078107 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:30:24.078591 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:30:24.079162 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:30:24.079628 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:30:24.080099 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:30:24.089713 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:24.090253 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:24.091103 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:24.091616 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:24.099145 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7ee27102-c966-48dd-9abb-509df9c3a811 tempest-FlavorsV261TestJSON-2069243781 tempest-FlavorsV261TestJSON-2069243781-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.028880 Jul 28 10:30:24.100127 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 72/113] 10.222.0.46 () {60 vars in 1187 bytes} [Thu Jul 28 10:30:24 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:30:24.106477 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2542fef3-c5a9-4575-8980-99b32db69d6f tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Calling method '.version_select at 0x7fa95803d3a0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:24.109176 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:24.109176 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:24.110562 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2542fef3-c5a9-4575-8980-99b32db69d6f tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:24.111149 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2542fef3-c5a9-4575-8980-99b32db69d6f tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:24.112093 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2542fef3-c5a9-4575-8980-99b32db69d6f tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:24.112675 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2542fef3-c5a9-4575-8980-99b32db69d6f tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:24.113209 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Getting quotas for project 07e2042b56704e9fb5195d43d8116494. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:30:24.116143 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=10,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:24.121724 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Getting quotas for user 5a46f399714c4124a253c57a26f77a0b and project 07e2042b56704e9fb5195d43d8116494. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:30:24.135715 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:30:24.138176 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 272dcd8b-8ab1-455d-8091-0109680626fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:30:24.140458 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-2542fef3-c5a9-4575-8980-99b32db69d6f tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.038662 Jul 28 10:30:24.141718 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 73/114] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Jul 28 10:30:24 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:24.151889 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-908ed622-6010-453e-a841-3589241ef427 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] Calling method '.version_select at 0x7fa94bfb3af0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:24.152727 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:24.152727 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:24.154666 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-908ed622-6010-453e-a841-3589241ef427 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] HTTP exception thrown: Hypervisor with ID '765df8c8-1236-404f-ab38-5451464d203f' could not be found. Jul 28 10:30:24.157893 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-908ed622-6010-453e-a841-3589241ef427 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] Request method failure captured: Jul 28 10:30:24.157893 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-hypervisors/765df8c8-1236-404f-ab38-5451464d203f HTTP/1.1 Jul 28 10:30:24.157893 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:24.157893 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:24.157893 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:24.157893 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:30:24.157893 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:24.157893 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:24.157893 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:24.157893 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:24.157893 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mU9B6bHF7R9Bdk3ZXoG9AsvxeirLfL9Ph7L2aiXqhTO37OBOnIwQWTvR3K0QSIG-S8JeUcj4xZhqkwySR7hvsTyKMJ_br0a9KPIXIDvUB_4K0hV5uMvxrJftXTCD6Uc0LmSDsQWgGxDW5p1yqD-7PbuBn-ApgbKRmExJWBUf4miqto Jul 28 10:30:24.157893 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:24.157893 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:24.157893 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:24.157893 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:24.157893 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:24.157893 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:24.157893 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: fa9aeb693c554143a1ce5615536321d5 Jul 28 10:30:24.157893 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-358842774 Jul 28 10:30:24.157893 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:30:24.157893 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:30:24.159328 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fa9aeb693c554143a1ce5615536321d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fa9aeb693c554143a1ce5615536321d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fa9aeb693c554143a1ce5615536321d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fa9aeb693c554143a1ce5615536321d5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:24.159328 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-358842774 Jul 28 10:30:24.159328 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: fa9aeb693c554143a1ce5615536321d5 Jul 28 10:30:24.159328 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-358842774 Jul 28 10:30:24.159328 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin Jul 28 10:30:24.159328 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:24.159328 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:24.159328 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: b2083c41286444dcad6123e9a20ecc8f Jul 28 10:30:24.159328 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin Jul 28 10:30:24.159328 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:30:24.159328 n-d-850468-6 devstack@n-api.service[119464]: exception: Hypervisor with ID '765df8c8-1236-404f-ab38-5451464d203f' could not be found. Jul 28 10:30:24.159328 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '765df8c8-1236-404f-ab38-5451464d203f'} Jul 28 10:30:24.159952 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:24.159952 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:24.159952 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 28 10:30:24.159952 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 28 10:30:24.159952 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '765df8c8-1236-404f-ab38-5451464d203f' Jul 28 10:30:24.159952 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:24.159952 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:24.159952 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:24.159952 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:24.159952 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 28 10:30:24.159952 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 28 10:30:24.159952 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 28 10:30:24.159952 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 28 10:30:24.159952 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 28 10:30:24.159952 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:24.159952 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:24.159952 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:24.159952 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:24.159952 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 28 10:30:24.159952 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 28 10:30:24.159952 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 28 10:30:24.159952 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 28 10:30:24.161052 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 28 10:30:24.161052 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:24.161052 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:24.161052 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:24.161052 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:24.161052 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:24.161052 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:24.161052 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:24.161052 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:24.161052 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:30:24.161052 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:30:24.161052 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:24.161052 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:24.161052 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 28 10:30:24.161052 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 28 10:30:24.161052 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 28 10:30:24.161052 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 28 10:30:24.161052 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 28 10:30:24.161052 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 10:30:24.161052 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '765df8c8-1236-404f-ab38-5451464d203f' could not be found. Jul 28 10:30:24.162064 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:24.162064 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:24.162064 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:24.162064 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:24.162064 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:24.162064 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:24.162064 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:24.162064 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:24.162064 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '765df8c8-1236-404f-ab38-5451464d203f' could not be found. Jul 28 10:30:24.162064 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:24.162064 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-908ed622-6010-453e-a841-3589241ef427 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] Returning 404 to user: Hypervisor with ID '765df8c8-1236-404f-ab38-5451464d203f' could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:24.162064 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-908ed622-6010-453e-a841-3589241ef427 tempest-HypervisorAdminNegativeTestJSON-358842774 tempest-HypervisorAdminNegativeTestJSON-358842774-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/765df8c8-1236-404f-ab38-5451464d203f" status: 404 len: 123 microversion: 2.1 time: 0.017009 Jul 28 10:30:24.162064 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 74/115] 10.222.0.46 () {58 vars in 1257 bytes} [Thu Jul 28 10:30:24 2022] GET /compute/v2.1/os-hypervisors/765df8c8-1236-404f-ab38-5451464d203f => generated 123 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:24.167113 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ce14841e-7824-4698-937f-93a8ea5681ce tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:24.167970 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:24.167970 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:24.177133 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:DELETE=9 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:24.199323 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ce14841e-7824-4698-937f-93a8ea5681ce tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/2111545190" status: 202 len: 0 microversion: 2.1 time: 0.035563 Jul 28 10:30:24.200916 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 75/116] 10.222.0.46 () {58 vars in 1161 bytes} [Thu Jul 28 10:30:24 2022] DELETE /compute/v2.1/flavors/2111545190 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:30:24.206563 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-0b5c8b17-4701-45df-bb82-adbd6ecb092a tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.698961 Jul 28 10:30:24.207210 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 42/117] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Jul 28 10:30:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 10:30:24.207911 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1a07a2ca-60fb-442e-b06c-57f634529b76 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:24.208898 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:24.208898 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:24.219895 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b0d74ff3-6ab0-4037-ac55-aaffd8b03796 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Calling method '.version_select at 0x7fa95829d040>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:24.223490 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:24.223490 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:24.227439 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b0d74ff3-6ab0-4037-ac55-aaffd8b03796 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:24.228179 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b0d74ff3-6ab0-4037-ac55-aaffd8b03796 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:24.231546 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b0d74ff3-6ab0-4037-ac55-aaffd8b03796 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:24.232409 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b0d74ff3-6ab0-4037-ac55-aaffd8b03796 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:24.235573 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1a07a2ca-60fb-442e-b06c-57f634529b76 tempest-AggregatesAdminNegativeTestJSON-165834071 tempest-AggregatesAdminNegativeTestJSON-165834071-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.033340 Jul 28 10:30:24.240036 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 76/118] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:30:24 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 10:30:24.241792 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-43339bea-3a90-49d7-ba70-7574e144a56a tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-741654844"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:24.246360 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:24.246360 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:24.247753 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.aggregate [None req-43339bea-3a90-49d7-ba70-7574e144a56a tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Generated uuid cf2c2029-321f-47d5-85b0-ae8407d4fe5c for aggregate {{(pid=119464) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 10:30:24.271099 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b0d74ff3-6ab0-4037-ac55-aaffd8b03796 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.062847 Jul 28 10:30:24.273371 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 43/119] 10.222.0.46 () {58 vars in 1128 bytes} [Thu Jul 28 10:30:24 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:24.279212 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-43339bea-3a90-49d7-ba70-7574e144a56a tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.041416 Jul 28 10:30:24.280984 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-83c3927c-41e0-441d-8cd6-8be9ec7d0f34 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:24.283713 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 77/120] 10.222.0.46 () {60 vars in 1164 bytes} [Thu Jul 28 10:30:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:24.292630 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ebc5ef6d-573d-4a12-b98b-84f932971e92 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:24.293253 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ebc5ef6d-573d-4a12-b98b-84f932971e92 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 272dcd8b-8ab1-455d-8091-0109680626fb] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:24.308699 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-83c3927c-41e0-441d-8cd6-8be9ec7d0f34 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033217 Jul 28 10:30:24.309291 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 44/121] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:24.329173 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c0d39429-ab33-4a9b-9e8c-2f9d67324edd tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Calling method '.version_select at 0x7fa9582dca60>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:24.330074 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:24.330074 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:24.339836 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c0d39429-ab33-4a9b-9e8c-2f9d67324edd tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:24.339836 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c0d39429-ab33-4a9b-9e8c-2f9d67324edd tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:24.355626 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c0d39429-ab33-4a9b-9e8c-2f9d67324edd tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:24.355873 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c0d39429-ab33-4a9b-9e8c-2f9d67324edd tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:24.390576 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c0d39429-ab33-4a9b-9e8c-2f9d67324edd tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/n-h2-850468-6" status: 200 len: 332 microversion: 2.1 time: 0.067224 Jul 28 10:30:24.391344 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 45/122] 10.222.0.46 () {58 vars in 1170 bytes} [Thu Jul 28 10:30:24 2022] GET /compute/v2.1/os-hosts/n-h2-850468-6 => generated 332 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:24.397836 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a0d8699d-c782-46b7-8ccb-3f9c577699c3 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850468-6"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:24.402368 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:24.402368 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:24.406890 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-ebc5ef6d-573d-4a12-b98b-84f932971e92 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:24.412870 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a0d8699d-c782-46b7-8ccb-3f9c577699c3 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:24.413695 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a0d8699d-c782-46b7-8ccb-3f9c577699c3 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:24.425296 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-ebc5ef6d-573d-4a12-b98b-84f932971e92 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:24.428433 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-ebc5ef6d-573d-4a12-b98b-84f932971e92 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:24.434446 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ebc5ef6d-573d-4a12-b98b-84f932971e92 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] 10.222.0.46 "GET /compute/v2.1/servers/272dcd8b-8ab1-455d-8091-0109680626fb" status: 200 len: 1261 microversion: 2.25 time: 0.149591 Jul 28 10:30:24.437070 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 78/123] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:30:24 2022] GET /compute/v2.1/servers/272dcd8b-8ab1-455d-8091-0109680626fb => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:30:24.443917 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c448cedb-3db2-4090-b212-fec0c2cc939d tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-6461044", "id": 1780198140, "os-flavor-access:is_public": "True"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:24.448565 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:24.448565 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:24.477724 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c448cedb-3db2-4090-b212-fec0c2cc939d tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.039383 Jul 28 10:30:24.478608 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 79/124] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:24 2022] POST /compute/v2.1/flavors => generated 435 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:24.483597 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d8ea80ee-9cc8-4ceb-93d4-ba6d77800d23 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Calling method '.version_select at 0x7fa94bfb3310>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:24.484925 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:24.484925 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:24.494868 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d8ea80ee-9cc8-4ceb-93d4-ba6d77800d23 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:24.495846 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d8ea80ee-9cc8-4ceb-93d4-ba6d77800d23 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:24.515534 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d8ea80ee-9cc8-4ceb-93d4-ba6d77800d23 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:24.516441 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d8ea80ee-9cc8-4ceb-93d4-ba6d77800d23 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:24.555745 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-d8ea80ee-9cc8-4ceb-93d4-ba6d77800d23 tempest-HostsAdminTestJSON-617186106 tempest-HostsAdminTestJSON-617186106-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/n-h1-850468-6" status: 200 len: 332 microversion: 2.1 time: 0.074953 Jul 28 10:30:24.556263 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 80/125] 10.222.0.46 () {58 vars in 1170 bytes} [Thu Jul 28 10:30:24 2022] GET /compute/v2.1/os-hosts/n-h1-850468-6 => generated 332 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:24.562622 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d244cd40-43af-4c5c-b228-fb2e4e73ed7b tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:24.564705 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:24.564705 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:24.574534 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-d244cd40-43af-4c5c-b228-fb2e4e73ed7b tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 28 10:30:24.576389 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d244cd40-43af-4c5c-b228-fb2e4e73ed7b tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Request method failure captured: Jul 28 10:30:24.576389 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/flavors/1780198140/os-flavor-access HTTP/1.1 Jul 28 10:30:24.576389 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:24.576389 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:24.576389 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:24.576389 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:30:24.576389 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:24.576389 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:24.576389 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:24.576389 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:24.576389 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mU-FofhN-B5BYHMNoV1NJ6LQEerxH31GuL7Zwts9iaAIb7t91PkCleGApfzxCyeuiQ8f82VX3-ZD5xbW4IA-4l8GriHqVDyoXulVefvrmIlO__RhI7QUbko1KC8vZZDyelgxd4KHZxds6q7xebRk2PwygnDcRWNwWsdDL0w8IcspfE Jul 28 10:30:24.576389 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:24.576389 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:24.576389 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:24.576389 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:24.576389 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:24.576389 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:24.576389 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: fec9c0d7214f43b7bcc499a91acf51fb Jul 28 10:30:24.576389 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-977534592 Jul 28 10:30:24.576389 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:30:24.576389 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:30:24.577496 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fec9c0d7214f43b7bcc499a91acf51fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fec9c0d7214f43b7bcc499a91acf51fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fec9c0d7214f43b7bcc499a91acf51fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fec9c0d7214f43b7bcc499a91acf51fb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:24.577496 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-977534592 Jul 28 10:30:24.577496 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: fec9c0d7214f43b7bcc499a91acf51fb Jul 28 10:30:24.577496 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-977534592 Jul 28 10:30:24.577496 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin Jul 28 10:30:24.577496 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:24.577496 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:24.577496 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: cf085c6967e64c46a671f94f16354ba9 Jul 28 10:30:24.577496 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin Jul 28 10:30:24.577496 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:24.577496 n-d-850468-6 devstack@n-api.service[119464]: exception: Access list not available for public flavors. Jul 28 10:30:24.577496 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'flavor_id': '1780198140'} Jul 28 10:30:24.578174 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:24.578174 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:24.578174 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:24.578174 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:24.578174 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:24.578174 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:24.578174 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:24.578174 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:24.578174 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 28 10:30:24.578174 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 10:30:24.578174 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 28 10:30:24.578174 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:24.578174 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:24.578174 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:24.578174 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:24.578174 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:24.578174 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:24.578174 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:24.578174 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:24.578174 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 28 10:30:24.578174 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:24.580804 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d244cd40-43af-4c5c-b228-fb2e4e73ed7b tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:24.582256 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-d244cd40-43af-4c5c-b228-fb2e4e73ed7b tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/1780198140/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.024658 Jul 28 10:30:24.583481 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 81/126] 10.222.0.46 () {58 vars in 1209 bytes} [Thu Jul 28 10:30:24 2022] GET /compute/v2.1/flavors/1780198140/os-flavor-access => generated 91 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:30:24.593224 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9d7a6791-97c3-4d8b-a094-73ee4476815c tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:24.594411 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:24.594411 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:24.616727 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9d7a6791-97c3-4d8b-a094-73ee4476815c tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1780198140" status: 202 len: 0 microversion: 2.1 time: 0.027181 Jul 28 10:30:24.618369 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 82/127] 10.222.0.46 () {58 vars in 1161 bytes} [Thu Jul 28 10:30:24 2022] DELETE /compute/v2.1/flavors/1780198140 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:30:24.627003 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a0d8699d-c782-46b7-8ccb-3f9c577699c3 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.233923 Jul 28 10:30:24.627603 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 46/128] 10.222.0.46 () {60 vars in 1194 bytes} [Thu Jul 28 10:30:24 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:24.628047 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c3dd818c-8bad-4f9c-8836-8e1894023db5 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:24.641702 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e059ce85-8911-44bf-bc99-55caf23f88e2 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:24.642870 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:24.642870 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:24.652414 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e059ce85-8911-44bf-bc99-55caf23f88e2 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 242 microversion: 2.1 time: 0.015584 Jul 28 10:30:24.653385 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 47/129] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:30:24 2022] GET /compute/v2.1/os-aggregates/10 => generated 242 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:24.654538 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c3dd818c-8bad-4f9c-8836-8e1894023db5 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030778 Jul 28 10:30:24.655119 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 83/130] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:24.675740 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-15f7ae66-cdf0-4c76-8f96-7efa954dfc03 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850468-6"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:24.678902 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:24.678902 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:24.679729 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5f41c43c-a628-46a2-a397-44d5f09c5d27 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1411205727", "id": 1558096951, "os-flavor-access:is_public": "False"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:24.683838 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:24.683838 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:24.687967 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-15f7ae66-cdf0-4c76-8f96-7efa954dfc03 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:24.688524 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-15f7ae66-cdf0-4c76-8f96-7efa954dfc03 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:24.706687 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-5f41c43c-a628-46a2-a397-44d5f09c5d27 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.032840 Jul 28 10:30:24.707252 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 84/131] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:24 2022] POST /compute/v2.1/flavors => generated 439 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:30:24.716317 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-28a5141e-0334-471c-bfab-8044c5fb1cbb tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:24.716936 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-28a5141e-0334-471c-bfab-8044c5fb1cbb tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: f94f5e3f-aa7d-4f6a-913a-41698d9f7541] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:24.724355 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-28a5141e-0334-471c-bfab-8044c5fb1cbb tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:24.724808 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-28a5141e-0334-471c-bfab-8044c5fb1cbb tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:24.728472 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-28a5141e-0334-471c-bfab-8044c5fb1cbb tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:24.728938 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-28a5141e-0334-471c-bfab-8044c5fb1cbb tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:24.780357 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-28a5141e-0334-471c-bfab-8044c5fb1cbb tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:24.780785 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-28a5141e-0334-471c-bfab-8044c5fb1cbb tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:24.781443 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-28a5141e-0334-471c-bfab-8044c5fb1cbb tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lazy-loading 'fault' on Instance uuid f94f5e3f-aa7d-4f6a-913a-41698d9f7541 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:30:24.846463 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-28a5141e-0334-471c-bfab-8044c5fb1cbb tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a3a77b4a3e4afbab66d34833cdcb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5b53a76f3a4ed1bdbf8d475dff9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:24.856595 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-28a5141e-0334-471c-bfab-8044c5fb1cbb tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] 10.222.0.46 "GET /compute/v2.1/servers/f94f5e3f-aa7d-4f6a-913a-41698d9f7541" status: 200 len: 1293 microversion: 2.1 time: 0.148211 Jul 28 10:30:24.858052 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 85/132] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:30:24 2022] GET /compute/v2.1/servers/f94f5e3f-aa7d-4f6a-913a-41698d9f7541 => generated 1293 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:24.892245 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-15f7ae66-cdf0-4c76-8f96-7efa954dfc03 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.224591 Jul 28 10:30:24.893029 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 48/133] 10.222.0.46 () {60 vars in 1194 bytes} [Thu Jul 28 10:30:24 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:24.911034 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-665ef0ff-4609-4a9d-9f0f-c0b16d45cf16 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:24.911495 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-665ef0ff-4609-4a9d-9f0f-c0b16d45cf16 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: f94f5e3f-aa7d-4f6a-913a-41698d9f7541] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:24.918420 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-665ef0ff-4609-4a9d-9f0f-c0b16d45cf16 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:24.918732 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-665ef0ff-4609-4a9d-9f0f-c0b16d45cf16 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:24.919510 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-665ef0ff-4609-4a9d-9f0f-c0b16d45cf16 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:24.919949 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-665ef0ff-4609-4a9d-9f0f-c0b16d45cf16 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:24.947698 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-665ef0ff-4609-4a9d-9f0f-c0b16d45cf16 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: f94f5e3f-aa7d-4f6a-913a-41698d9f7541] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:30:25.003539 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-665ef0ff-4609-4a9d-9f0f-c0b16d45cf16 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: f94f5e3f-aa7d-4f6a-913a-41698d9f7541] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:30:25.004591 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-665ef0ff-4609-4a9d-9f0f-c0b16d45cf16 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:25.005102 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-665ef0ff-4609-4a9d-9f0f-c0b16d45cf16 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:25.006138 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-665ef0ff-4609-4a9d-9f0f-c0b16d45cf16 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: f94f5e3f-aa7d-4f6a-913a-41698d9f7541] instance's host None is down, deleting from database Jul 28 10:30:25.011425 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-665ef0ff-4609-4a9d-9f0f-c0b16d45cf16 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: f94f5e3f-aa7d-4f6a-913a-41698d9f7541] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:30:25.051717 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-665ef0ff-4609-4a9d-9f0f-c0b16d45cf16 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: f94f5e3f-aa7d-4f6a-913a-41698d9f7541] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:30:25.059278 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-665ef0ff-4609-4a9d-9f0f-c0b16d45cf16 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: f94f5e3f-aa7d-4f6a-913a-41698d9f7541] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:30:25.357960 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-665ef0ff-4609-4a9d-9f0f-c0b16d45cf16 tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f94f5e3f-aa7d-4f6a-913a-41698d9f7541" status: 204 len: 0 microversion: 2.1 time: 0.463862 Jul 28 10:30:25.358635 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 49/134] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:30:24 2022] DELETE /compute/v2.1/servers/f94f5e3f-aa7d-4f6a-913a-41698d9f7541 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:30:25.366421 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4ef7ef24-59cb-4145-911f-51252b25be31 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:25.371705 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:25.371705 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:25.403910 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-277db6bb-a1f7-46d3-8cfc-4d1584444f4f tempest-FlavorsAccessNegativeTestJSON-85209299 tempest-FlavorsAccessNegativeTestJSON-85209299-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "646fc7da0f744baf8b0467c97ec82ccf"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:25.407332 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:25.407332 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:25.409535 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-277db6bb-a1f7-46d3-8cfc-4d1584444f4f tempest-FlavorsAccessNegativeTestJSON-85209299 tempest-FlavorsAccessNegativeTestJSON-85209299-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '130b15a71e0f431c8d8208b9f0f49e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646fc7da0f744baf8b0467c97ec82ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:25.411724 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-277db6bb-a1f7-46d3-8cfc-4d1584444f4f tempest-FlavorsAccessNegativeTestJSON-85209299 tempest-FlavorsAccessNegativeTestJSON-85209299-project] Request method failure captured: Jul 28 10:30:25.411724 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/flavors/1558096951/action HTTP/1.1 Jul 28 10:30:25.411724 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:25.411724 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:25.411724 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:25.411724 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 67 Jul 28 10:30:25.411724 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:25.411724 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:25.411724 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:25.411724 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:25.411724 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mU8cDzUrV5BhnDa4Odsq63w1wK_7cmU-ubw8SN4jobPO4PmHPCDS4Y1idPZBTuQTD8poqa1PC-pLc9MElldulBlmyEml-Hegdu8J65y0-AmeiC0iDKbXMVqjR1qNR1WP3AgPXMDRo7VKil3eJf7V4ogrmoBgYjuDUItflPMKArjdNs Jul 28 10:30:25.411724 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:25.411724 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:25.411724 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:25.411724 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:25.411724 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:25.411724 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:25.411724 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 646fc7da0f744baf8b0467c97ec82ccf Jul 28 10:30:25.411724 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-85209299 Jul 28 10:30:25.411724 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:30:25.411724 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:30:25.412862 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/646fc7da0f744baf8b0467c97ec82ccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/646fc7da0f744baf8b0467c97ec82ccf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/646fc7da0f744baf8b0467c97ec82ccf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_646fc7da0f744baf8b0467c97ec82ccf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:25.412862 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-85209299 Jul 28 10:30:25.412862 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 646fc7da0f744baf8b0467c97ec82ccf Jul 28 10:30:25.412862 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-85209299 Jul 28 10:30:25.412862 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-FlavorsAccessNegativeTestJSON-85209299-project Jul 28 10:30:25.412862 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:25.412862 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:25.412862 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 130b15a71e0f431c8d8208b9f0f49e07 Jul 28 10:30:25.412862 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-85209299-project Jul 28 10:30:25.412862 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:30:25.412862 n-d-850468-6 devstack@n-api.service[119464]: {"addTenantAccess": {"tenant": "646fc7da0f744baf8b0467c97ec82ccf"}} Jul 28 10:30:25.412862 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:25.413525 n-d-850468-6 devstack@n-api.service[119464]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 28 10:30:25.413525 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '1558096951', 'body': {'addTenantAccess': {'tenant': '646fc7da0f744baf8b0467c97ec82ccf'}}} Jul 28 10:30:25.413525 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:25.413525 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:25.413525 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:25.413525 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:25.413525 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:25.413525 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:25.413525 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:25.413525 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:25.413525 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:25.413525 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:25.413525 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 28 10:30:25.413525 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 28 10:30:25.413525 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:30:25.413525 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:30:25.413525 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:30:25.413525 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:30:25.413525 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:25.415245 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:25.415245 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:25.415245 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:25.415245 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:30:25.415245 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:30:25.415245 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:30:25.415245 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:30:25.415245 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:30:25.415245 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:30:25.415245 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 28 10:30:25.415245 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:25.415245 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:25.415245 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:25.415245 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:25.415245 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:25.415245 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:25.415245 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:30:25.415245 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:30:25.415245 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 28 10:30:25.415245 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:25.416261 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-277db6bb-a1f7-46d3-8cfc-4d1584444f4f tempest-FlavorsAccessNegativeTestJSON-85209299 tempest-FlavorsAccessNegativeTestJSON-85209299-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:25.416261 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-277db6bb-a1f7-46d3-8cfc-4d1584444f4f tempest-FlavorsAccessNegativeTestJSON-85209299 tempest-FlavorsAccessNegativeTestJSON-85209299-project] 10.222.0.46 "POST /compute/v2.1/flavors/1558096951/action" status: 403 len: 130 microversion: 2.1 time: 0.554023 Jul 28 10:30:25.419042 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 86/135] 10.222.0.46 () {60 vars in 1200 bytes} [Thu Jul 28 10:30:24 2022] POST /compute/v2.1/flavors/1558096951/action => generated 130 bytes in 560 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:25.422199 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-4ef7ef24-59cb-4145-911f-51252b25be31 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.058008 Jul 28 10:30:25.422802 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 50/136] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Jul 28 10:30:25 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 10:30:25.430498 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-947286ad-56f7-4021-9a5b-ccf444f803ad tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:25.431143 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-947286ad-56f7-4021-9a5b-ccf444f803ad tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] [instance: f94f5e3f-aa7d-4f6a-913a-41698d9f7541] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:25.444006 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-76952258-b347-4abd-a323-916fec63616e tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:25.445302 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-947286ad-56f7-4021-9a5b-ccf444f803ad tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:25.446227 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-947286ad-56f7-4021-9a5b-ccf444f803ad tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:25.446587 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-947286ad-56f7-4021-9a5b-ccf444f803ad tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:25.447090 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-947286ad-56f7-4021-9a5b-ccf444f803ad tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:25.450481 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:25.450481 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:25.468232 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-947286ad-56f7-4021-9a5b-ccf444f803ad tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] HTTP exception thrown: Instance f94f5e3f-aa7d-4f6a-913a-41698d9f7541 could not be found. Jul 28 10:30:25.470476 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-947286ad-56f7-4021-9a5b-ccf444f803ad tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Request method failure captured: Jul 28 10:30:25.470476 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/f94f5e3f-aa7d-4f6a-913a-41698d9f7541 HTTP/1.1 Jul 28 10:30:25.470476 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:25.470476 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:25.470476 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:25.470476 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:30:25.470476 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:25.470476 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:25.470476 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:25.470476 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:25.470476 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mU2cSa2Yi0QC4V65UWKxv6AW8hI3UjqYB3eaUm2n8ScTGHUoNIokdV-8UajOinP8Lnl1NBHFa33eSp0e_7OFv6f2OCMQHdqlou-YfFvt7q5r-_McZ5FLYOfY3ImL5Cizn-6HVe2ABo40M2Gc4shakDeSgLln8WXPNXPg-KKldxy3ck Jul 28 10:30:25.470476 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:25.470476 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:25.470476 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:25.470476 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:25.470476 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:25.470476 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:25.470476 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: ad5b53a76f3a4ed1bdbf8d475dff9f83 Jul 28 10:30:25.470476 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1044450029 Jul 28 10:30:25.470476 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:30:25.470476 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:30:25.471873 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ad5b53a76f3a4ed1bdbf8d475dff9f83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ad5b53a76f3a4ed1bdbf8d475dff9f83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ad5b53a76f3a4ed1bdbf8d475dff9f83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ad5b53a76f3a4ed1bdbf8d475dff9f83", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:25.471873 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-DeleteServersAdminTestJSON-1044450029 Jul 28 10:30:25.471873 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: ad5b53a76f3a4ed1bdbf8d475dff9f83 Jul 28 10:30:25.471873 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1044450029 Jul 28 10:30:25.471873 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-DeleteServersAdminTestJSON-1044450029-project Jul 28 10:30:25.471873 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:25.471873 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:25.471873 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: d4a3a77b4a3e4afbab66d34833cdcb0c Jul 28 10:30:25.471873 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-DeleteServersAdminTestJSON-1044450029-project Jul 28 10:30:25.471873 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:25.471873 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance f94f5e3f-aa7d-4f6a-913a-41698d9f7541 could not be found. Jul 28 10:30:25.471873 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'f94f5e3f-aa7d-4f6a-913a-41698d9f7541'} Jul 28 10:30:25.472588 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:25.472588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:25.472588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:30:25.472588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:30:25.472588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:30:25.472588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:30:25.472588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:30:25.472588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:30:25.472588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:30:25.472588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:30:25.472588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f94f5e3f-aa7d-4f6a-913a-41698d9f7541 could not be found. Jul 28 10:30:25.472588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:25.472588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:25.472588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:25.472588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:25.472588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:25.472588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:25.472588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:25.472588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:25.472588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:25.473597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:25.473597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:30:25.473597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:30:25.473597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:30:25.473597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:30:25.473597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:30:25.473597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:30:25.473597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f94f5e3f-aa7d-4f6a-913a-41698d9f7541 could not be found. Jul 28 10:30:25.473597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:25.473597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:25.473597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:25.473597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:25.473597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:25.473597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:25.473597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:25.473597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:25.473597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f94f5e3f-aa7d-4f6a-913a-41698d9f7541 could not be found. Jul 28 10:30:25.473597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:25.474603 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-947286ad-56f7-4021-9a5b-ccf444f803ad tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] Returning 404 to user: Instance f94f5e3f-aa7d-4f6a-913a-41698d9f7541 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:25.474603 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-947286ad-56f7-4021-9a5b-ccf444f803ad tempest-DeleteServersAdminTestJSON-1044450029 tempest-DeleteServersAdminTestJSON-1044450029-project] 10.222.0.46 "GET /compute/v2.1/servers/f94f5e3f-aa7d-4f6a-913a-41698d9f7541" status: 404 len: 111 microversion: 2.1 time: 0.051900 Jul 28 10:30:25.474603 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 87/137] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:30:25 2022] GET /compute/v2.1/servers/f94f5e3f-aa7d-4f6a-913a-41698d9f7541 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:25.503532 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-706cb1fd-ae7e-48b3-b106-464b779b8a1a tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-303447381"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:25.505220 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-76952258-b347-4abd-a323-916fec63616e tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1558096951" status: 202 len: 0 microversion: 2.1 time: 0.077817 Jul 28 10:30:25.506533 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 51/138] 10.222.0.46 () {58 vars in 1161 bytes} [Thu Jul 28 10:30:25 2022] DELETE /compute/v2.1/flavors/1558096951 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:30:25.518814 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:25.518814 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:25.519805 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-14a8ddce-2317-4c48-87ec-605f859b61d6 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:25.520312 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.aggregate [None req-706cb1fd-ae7e-48b3-b106-464b779b8a1a tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Generated uuid bbe49917-8d9a-489e-9e8c-7abdfe3ec66e for aggregate {{(pid=119464) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 10:30:25.520835 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-14a8ddce-2317-4c48-87ec-605f859b61d6 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 272dcd8b-8ab1-455d-8091-0109680626fb] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:25.532375 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-14a8ddce-2317-4c48-87ec-605f859b61d6 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:25.534272 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-14a8ddce-2317-4c48-87ec-605f859b61d6 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:25.535846 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-14a8ddce-2317-4c48-87ec-605f859b61d6 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:25.537497 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-14a8ddce-2317-4c48-87ec-605f859b61d6 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:25.565336 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-706cb1fd-ae7e-48b3-b106-464b779b8a1a tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.088536 Jul 28 10:30:25.567893 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 88/139] 10.222.0.46 () {60 vars in 1164 bytes} [Thu Jul 28 10:30:25 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:25.581481 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ea1d87c5-c843-4c9e-a817-d33ccf1e33c9 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:25.626867 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ea1d87c5-c843-4c9e-a817-d33ccf1e33c9 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057836 Jul 28 10:30:25.627634 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-14a8ddce-2317-4c48-87ec-605f859b61d6 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:25.628093 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 89/140] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:25.628203 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-14a8ddce-2317-4c48-87ec-605f859b61d6 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:25.628612 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-14a8ddce-2317-4c48-87ec-605f859b61d6 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lazy-loading 'fault' on Instance uuid 272dcd8b-8ab1-455d-8091-0109680626fb {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:30:25.644293 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-eb71fc46-340d-48d0-880d-322fa7fa973b tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850468-6"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:25.653851 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:25.653851 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:25.674108 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-eb71fc46-340d-48d0-880d-322fa7fa973b tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:25.675319 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-eb71fc46-340d-48d0-880d-322fa7fa973b tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:25.756552 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-14a8ddce-2317-4c48-87ec-605f859b61d6 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:25.774781 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-14a8ddce-2317-4c48-87ec-605f859b61d6 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:25.776849 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-14a8ddce-2317-4c48-87ec-605f859b61d6 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:25.778907 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-14a8ddce-2317-4c48-87ec-605f859b61d6 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] 10.222.0.46 "GET /compute/v2.1/servers/272dcd8b-8ab1-455d-8091-0109680626fb" status: 200 len: 1334 microversion: 2.25 time: 0.268915 Jul 28 10:30:25.786674 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 52/141] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:30:25 2022] GET /compute/v2.1/servers/272dcd8b-8ab1-455d-8091-0109680626fb => generated 1334 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:30:25.813531 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-79a1127c-7a7f-4cb8-b440-fd0dbfa35026 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1032387049", "id": 662464725, "os-flavor-access:is_public": "False"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:25.816420 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:25.816420 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:25.843414 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-eb71fc46-340d-48d0-880d-322fa7fa973b tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.214095 Jul 28 10:30:25.850000 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 90/142] 10.222.0.46 () {60 vars in 1194 bytes} [Thu Jul 28 10:30:25 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:25.850000 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fc3728dc-bd8d-4aaf-a3e4-bf289ad9039e tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:25.850000 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-fc3728dc-bd8d-4aaf-a3e4-bf289ad9039e tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 272dcd8b-8ab1-455d-8091-0109680626fb] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:25.852947 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-79a1127c-7a7f-4cb8-b440-fd0dbfa35026 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.063619 Jul 28 10:30:25.857924 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 53/143] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:25 2022] POST /compute/v2.1/flavors => generated 436 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:25.865479 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fc3728dc-bd8d-4aaf-a3e4-bf289ad9039e tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:25.866271 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fc3728dc-bd8d-4aaf-a3e4-bf289ad9039e tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:25.868718 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fc3728dc-bd8d-4aaf-a3e4-bf289ad9039e tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:25.869515 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fc3728dc-bd8d-4aaf-a3e4-bf289ad9039e tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:25.880909 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5ab43233-c7c5-4b9a-b47f-bb09cdd61d30 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:25.881559 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:25.881559 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:25.896615 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-5ab43233-c7c5-4b9a-b47f-bb09cdd61d30 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.040627 Jul 28 10:30:25.897724 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 54/144] 10.222.0.46 () {58 vars in 1143 bytes} [Thu Jul 28 10:30:25 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:25.903270 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-52d6837b-bb69-4390-bdf2-f5d360e7da0b tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "646fc7da0f744baf8b0467c97ec82ccf"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:25.906826 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:25.906826 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:25.919817 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-fc3728dc-bd8d-4aaf-a3e4-bf289ad9039e tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 272dcd8b-8ab1-455d-8091-0109680626fb] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:30:25.981298 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=81,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:26.059147 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-fc3728dc-bd8d-4aaf-a3e4-bf289ad9039e tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 272dcd8b-8ab1-455d-8091-0109680626fb] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:30:26.060030 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fc3728dc-bd8d-4aaf-a3e4-bf289ad9039e tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:26.060535 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fc3728dc-bd8d-4aaf-a3e4-bf289ad9039e tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:26.060938 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-fc3728dc-bd8d-4aaf-a3e4-bf289ad9039e tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 272dcd8b-8ab1-455d-8091-0109680626fb] instance's host None is down, deleting from database Jul 28 10:30:26.065515 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-fc3728dc-bd8d-4aaf-a3e4-bf289ad9039e tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 272dcd8b-8ab1-455d-8091-0109680626fb] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:30:26.144073 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-fc3728dc-bd8d-4aaf-a3e4-bf289ad9039e tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 272dcd8b-8ab1-455d-8091-0109680626fb] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:30:26.153936 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-fc3728dc-bd8d-4aaf-a3e4-bf289ad9039e tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 272dcd8b-8ab1-455d-8091-0109680626fb] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:30:26.446490 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-fc3728dc-bd8d-4aaf-a3e4-bf289ad9039e tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] 10.222.0.46 "DELETE /compute/v2.1/servers/272dcd8b-8ab1-455d-8091-0109680626fb" status: 204 len: 0 microversion: 2.25 time: 0.600789 Jul 28 10:30:26.447113 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 91/145] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:30:25 2022] DELETE /compute/v2.1/servers/272dcd8b-8ab1-455d-8091-0109680626fb => generated 0 bytes in 602 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:30:26.455953 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-24f90286-91d2-4996-b0b5-0778acbea1b3 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850468-6"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:26.458919 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:26.458919 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:26.474577 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-24f90286-91d2-4996-b0b5-0778acbea1b3 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:26.475510 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-24f90286-91d2-4996-b0b5-0778acbea1b3 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:26.642637 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-24f90286-91d2-4996-b0b5-0778acbea1b3 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.194290 Jul 28 10:30:26.651142 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 92/146] 10.222.0.46 () {60 vars in 1194 bytes} [Thu Jul 28 10:30:26 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:26.656551 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c2564c46-5bb0-4acf-8666-d4ff77d6bf0b tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:26.657499 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c2564c46-5bb0-4acf-8666-d4ff77d6bf0b tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 272dcd8b-8ab1-455d-8091-0109680626fb] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:26.664715 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2564c46-5bb0-4acf-8666-d4ff77d6bf0b tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:26.665370 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2564c46-5bb0-4acf-8666-d4ff77d6bf0b tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:26.666097 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2564c46-5bb0-4acf-8666-d4ff77d6bf0b tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:26.666528 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2564c46-5bb0-4acf-8666-d4ff77d6bf0b tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:26.683316 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-c2564c46-5bb0-4acf-8666-d4ff77d6bf0b tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] HTTP exception thrown: Instance 272dcd8b-8ab1-455d-8091-0109680626fb could not be found. Jul 28 10:30:26.685088 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c2564c46-5bb0-4acf-8666-d4ff77d6bf0b tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Request method failure captured: Jul 28 10:30:26.685088 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/272dcd8b-8ab1-455d-8091-0109680626fb HTTP/1.1 Jul 28 10:30:26.685088 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:26.685088 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:26.685088 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:26.685088 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:30:26.685088 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:26.685088 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:26.685088 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:26.685088 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:26.685088 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mUsDviFxmY2HLnGTreQtLgTrjcwl5_NhXA8w3Wifn-1kTLdQ48tKyZ79DQ9rEyzANfG20a4jdfnSWv4KS8pqkIbvf6DmNC9lXwT2Ni0Wut_Q1LjpGOxZtZ60egcXO8jPUx_e7sWdhLEkb8L4vGtXp4V7Pb0IXhzCJLNSEOBzCN4Avg Jul 28 10:30:26.685088 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:26.685088 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:26.685088 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:26.685088 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:26.685088 n-d-850468-6 devstack@n-api.service[119464]: X-Openstack-Nova-Api-Version: 2.25 Jul 28 10:30:26.685088 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:26.685088 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:26.685088 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 07e2042b56704e9fb5195d43d8116494 Jul 28 10:30:26.685088 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-131348017 Jul 28 10:30:26.685088 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:30:26.685088 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:30:26.686678 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/07e2042b56704e9fb5195d43d8116494"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/07e2042b56704e9fb5195d43d8116494"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/07e2042b56704e9fb5195d43d8116494"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_07e2042b56704e9fb5195d43d8116494", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:26.686678 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-131348017 Jul 28 10:30:26.686678 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 07e2042b56704e9fb5195d43d8116494 Jul 28 10:30:26.686678 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-131348017 Jul 28 10:30:26.686678 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-LiveAutoBlockMigrationV225Test-131348017-project Jul 28 10:30:26.686678 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:26.686678 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:26.686678 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 5a46f399714c4124a253c57a26f77a0b Jul 28 10:30:26.686678 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-131348017-project Jul 28 10:30:26.686678 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:26.686678 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 272dcd8b-8ab1-455d-8091-0109680626fb could not be found. Jul 28 10:30:26.686678 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '272dcd8b-8ab1-455d-8091-0109680626fb'} Jul 28 10:30:26.687480 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:26.687480 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:26.687480 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:30:26.687480 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:30:26.687480 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:30:26.687480 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:30:26.687480 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:30:26.687480 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:30:26.687480 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:30:26.687480 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:30:26.687480 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 272dcd8b-8ab1-455d-8091-0109680626fb could not be found. Jul 28 10:30:26.687480 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:26.687480 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:26.687480 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:26.687480 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:26.687480 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:26.687480 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:26.687480 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:26.687480 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:26.687480 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:26.688491 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:26.688491 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:30:26.688491 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:30:26.688491 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:30:26.688491 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:30:26.688491 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:30:26.688491 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:30:26.688491 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 272dcd8b-8ab1-455d-8091-0109680626fb could not be found. Jul 28 10:30:26.688491 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:26.688491 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:26.688491 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:26.688491 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:26.688491 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:26.688491 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:26.688491 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:26.688491 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:26.688491 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 272dcd8b-8ab1-455d-8091-0109680626fb could not be found. Jul 28 10:30:26.688491 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:26.689393 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c2564c46-5bb0-4acf-8666-d4ff77d6bf0b tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Returning 404 to user: Instance 272dcd8b-8ab1-455d-8091-0109680626fb could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:26.689393 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c2564c46-5bb0-4acf-8666-d4ff77d6bf0b tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] 10.222.0.46 "GET /compute/v2.1/servers/272dcd8b-8ab1-455d-8091-0109680626fb" status: 404 len: 111 microversion: 2.25 time: 0.034084 Jul 28 10:30:26.689393 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 93/147] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:30:26 2022] GET /compute/v2.1/servers/272dcd8b-8ab1-455d-8091-0109680626fb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:30:26.693449 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0215f07b-fe50-4b4c-83bf-73fdb43560b4 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:26.694251 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:26.694251 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:26.712445 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-52d6837b-bb69-4390-bdf2-f5d360e7da0b tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/662464725/action" status: 200 len: 96 microversion: 2.1 time: 0.812756 Jul 28 10:30:26.718720 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 55/148] 10.222.0.46 () {60 vars in 1197 bytes} [Thu Jul 28 10:30:25 2022] POST /compute/v2.1/flavors/662464725/action => generated 96 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:30:26.724961 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b51b7dee-7ab4-422a-a7dd-b631dd24d32c tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Action: 'create', calling method: .version_select at 0x7fa9581d9280>, body: {"keypair": {"name": "tempest-keypair-1697056807", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRL4psrUAN5wdQ6DPsoGR+2HysAW4AuvQg295dfd5w2XICMGgbepz0UpDLqindO8HaJx2Z5Lft3CxWicy2nAhgmZ7WS/cNuZ3JxkBh8WudIcHWsc5WbgL9HJJ3MtOtG5w=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:26.729181 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0215f07b-fe50-4b4c-83bf-73fdb43560b4 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.040464 Jul 28 10:30:26.729814 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 94/149] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Jul 28 10:30:26 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 10:30:26.735761 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b9f5eb5b-3f35-48a9-8852-19a48697966c tempest-FlavorsAccessNegativeTestJSON-85209299 tempest-FlavorsAccessNegativeTestJSON-85209299-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "646fc7da0f744baf8b0467c97ec82ccf"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:26.749095 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:26.749095 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:26.749095 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-b9f5eb5b-3f35-48a9-8852-19a48697966c tempest-FlavorsAccessNegativeTestJSON-85209299 tempest-FlavorsAccessNegativeTestJSON-85209299-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '130b15a71e0f431c8d8208b9f0f49e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646fc7da0f744baf8b0467c97ec82ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:26.750393 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b9f5eb5b-3f35-48a9-8852-19a48697966c tempest-FlavorsAccessNegativeTestJSON-85209299 tempest-FlavorsAccessNegativeTestJSON-85209299-project] Request method failure captured: Jul 28 10:30:26.750393 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/flavors/662464725/action HTTP/1.1 Jul 28 10:30:26.750393 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:26.750393 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:26.750393 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:26.750393 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 70 Jul 28 10:30:26.750393 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:26.750393 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:26.750393 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:26.750393 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:26.750393 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mU8cDzUrV5BhnDa4Odsq63w1wK_7cmU-ubw8SN4jobPO4PmHPCDS4Y1idPZBTuQTD8poqa1PC-pLc9MElldulBlmyEml-Hegdu8J65y0-AmeiC0iDKbXMVqjR1qNR1WP3AgPXMDRo7VKil3eJf7V4ogrmoBgYjuDUItflPMKArjdNs Jul 28 10:30:26.750393 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:26.750393 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:26.750393 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:26.750393 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:26.750393 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:26.750393 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:26.750393 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 646fc7da0f744baf8b0467c97ec82ccf Jul 28 10:30:26.750393 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-85209299 Jul 28 10:30:26.750393 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:30:26.750393 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:30:26.751527 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/646fc7da0f744baf8b0467c97ec82ccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/646fc7da0f744baf8b0467c97ec82ccf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/646fc7da0f744baf8b0467c97ec82ccf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_646fc7da0f744baf8b0467c97ec82ccf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:26.751527 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-85209299 Jul 28 10:30:26.751527 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 646fc7da0f744baf8b0467c97ec82ccf Jul 28 10:30:26.751527 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-85209299 Jul 28 10:30:26.751527 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-FlavorsAccessNegativeTestJSON-85209299-project Jul 28 10:30:26.751527 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:26.751527 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:26.751527 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 130b15a71e0f431c8d8208b9f0f49e07 Jul 28 10:30:26.751527 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-85209299-project Jul 28 10:30:26.751527 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:30:26.751527 n-d-850468-6 devstack@n-api.service[119464]: {"removeTenantAccess": {"tenant": "646fc7da0f744baf8b0467c97ec82ccf"}} Jul 28 10:30:26.751527 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:26.752336 n-d-850468-6 devstack@n-api.service[119464]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 28 10:30:26.752336 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '662464725', 'body': {'removeTenantAccess': {'tenant': '646fc7da0f744baf8b0467c97ec82ccf'}}} Jul 28 10:30:26.752336 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:26.752336 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:26.752336 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:26.752336 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:26.752336 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:26.752336 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:26.752336 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:26.752336 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:26.752336 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:26.752336 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:26.752336 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 28 10:30:26.752336 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi context.can( Jul 28 10:30:26.752336 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:30:26.752336 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:30:26.752336 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:30:26.752336 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:30:26.752336 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:26.752336 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:26.757230 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:26.757230 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:26.757230 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:30:26.757230 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:30:26.757230 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:30:26.757230 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:30:26.757230 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:30:26.757230 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:30:26.757230 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 28 10:30:26.757230 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:26.757230 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:26.757230 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:26.757230 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:26.757230 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:26.757230 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:26.757230 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:30:26.757230 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:30:26.757230 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 28 10:30:26.757230 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:26.758771 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b9f5eb5b-3f35-48a9-8852-19a48697966c tempest-FlavorsAccessNegativeTestJSON-85209299 tempest-FlavorsAccessNegativeTestJSON-85209299-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:26.758771 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b9f5eb5b-3f35-48a9-8852-19a48697966c tempest-FlavorsAccessNegativeTestJSON-85209299 tempest-FlavorsAccessNegativeTestJSON-85209299-project] 10.222.0.46 "POST /compute/v2.1/flavors/662464725/action" status: 403 len: 133 microversion: 2.1 time: 0.021180 Jul 28 10:30:26.758771 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 95/150] 10.222.0.46 () {60 vars in 1197 bytes} [Thu Jul 28 10:30:26 2022] POST /compute/v2.1/flavors/662464725/action => generated 133 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:26.759706 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9630046a-7e6f-4de5-8cc9-ad3b0d227929 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1539262015"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:26.762165 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:26.762165 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:26.763204 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.aggregate [None req-9630046a-7e6f-4de5-8cc9-ad3b0d227929 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Generated uuid ca40ba10-e11c-4b27-8e93-86b409e92d1a for aggregate {{(pid=119464) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 10:30:26.772827 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-b51b7dee-7ab4-422a-a7dd-b631dd24d32c tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Getting quotas for project 07e2042b56704e9fb5195d43d8116494. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:30:26.779025 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-b51b7dee-7ab4-422a-a7dd-b631dd24d32c tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Getting quotas for user 5a46f399714c4124a253c57a26f77a0b and project 07e2042b56704e9fb5195d43d8116494. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:30:26.790666 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9630046a-7e6f-4de5-8cc9-ad3b0d227929 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.036122 Jul 28 10:30:26.792512 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 96/151] 10.222.0.46 () {60 vars in 1164 bytes} [Thu Jul 28 10:30:26 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:26.807280 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-90070cbc-738e-4759-b7dd-558684789ab5 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "646fc7da0f744baf8b0467c97ec82ccf"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:26.816133 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:26.816133 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:26.829274 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b51b7dee-7ab4-422a-a7dd-b631dd24d32c tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.108292 Jul 28 10:30:26.830193 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 56/152] 10.222.0.46 () {62 vars in 1200 bytes} [Thu Jul 28 10:30:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 10:30:26.846193 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-39e44cc3-7bc0-41b3-9cd9-5b4379d94443 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850468-6"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:26.852040 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:26.852040 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:26.875017 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-39e44cc3-7bc0-41b3-9cd9-5b4379d94443 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:26.875994 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-39e44cc3-7bc0-41b3-9cd9-5b4379d94443 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:27.085105 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-39e44cc3-7bc0-41b3-9cd9-5b4379d94443 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 243 microversion: 2.1 time: 0.253656 Jul 28 10:30:27.086387 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 57/153] 10.222.0.46 () {60 vars in 1194 bytes} [Thu Jul 28 10:30:26 2022] POST /compute/v2.1/os-aggregates/12/action => generated 243 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:27.099244 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-56c62639-cdde-4946-9d9b-e610f1b325df tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850468-6"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:27.102757 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:27.102757 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:27.114184 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-56c62639-cdde-4946-9d9b-e610f1b325df tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:27.114753 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-56c62639-cdde-4946-9d9b-e610f1b325df tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:27.374047 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-56c62639-cdde-4946-9d9b-e610f1b325df tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 228 microversion: 2.1 time: 0.278696 Jul 28 10:30:27.375739 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 58/154] 10.222.0.46 () {60 vars in 1194 bytes} [Thu Jul 28 10:30:27 2022] POST /compute/v2.1/os-aggregates/12/action => generated 228 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:27.390652 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-65eebfbf-7f47-4e25-8918-cc85718ce298 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:27.392514 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:27.392514 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:27.411094 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:27.452863 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-65eebfbf-7f47-4e25-8918-cc85718ce298 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.067790 Jul 28 10:30:27.458972 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 59/155] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Jul 28 10:30:27 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 10:30:27.472363 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-61245d30-2158-4288-8979-2c252ff3fe1f tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1493999813"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:27.478783 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:27.478783 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:27.487208 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.aggregate [None req-61245d30-2158-4288-8979-2c252ff3fe1f tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Generated uuid 96439ebd-3b0f-4c1b-b0de-f350c62d2030 for aggregate {{(pid=119463) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 10:30:27.538002 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-61245d30-2158-4288-8979-2c252ff3fe1f tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.071807 Jul 28 10:30:27.543529 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 60/156] 10.222.0.46 () {60 vars in 1164 bytes} [Thu Jul 28 10:30:27 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:27.584885 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c2236df5-cbae-4a01-9645-710f80d2975a tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:27.586739 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:27.586739 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:27.684280 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c2236df5-cbae-4a01-9645-710f80d2975a tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.135735 Jul 28 10:30:27.685977 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 61/157] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Jul 28 10:30:27 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 28 10:30:27.704020 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a2fa8d41-97c1-456e-bae7-156582e1c3f3 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:27.706104 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:27.706104 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:27.721662 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-a2fa8d41-97c1-456e-bae7-156582e1c3f3 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Jul 28 10:30:27.731280 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a2fa8d41-97c1-456e-bae7-156582e1c3f3 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Request method failure captured: Jul 28 10:30:27.731280 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Jul 28 10:30:27.731280 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:30:27.731280 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:30:27.731280 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:30:27.731280 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:30:27.731280 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:30:27.731280 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:30:27.731280 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:30:27.731280 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:27.731280 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mUs_C9MmsEu-QDGxVBeFfz3PXfSFfDsZ_kJzyu0LTDGWPLLy-h00SA_0kXty7SAc3tgdM5hyXUC7pry4fEzdXvhwQhMTGqKCY6WgbJntIoi16_U3W8qw_-hxQm2nAbD52p20pTAZIZhzwEwC-KTUZsimSq4KhUHEUbD6-40zLBCc4M Jul 28 10:30:27.731280 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:30:27.731280 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:30:27.731280 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:30:27.731280 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:30:27.731280 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:30:27.731280 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:30:27.731280 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: e7253cb3229b4a3a8e1b907ea9a03921 Jul 28 10:30:27.731280 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-AggregatesAdminTestJSON-1786621531 Jul 28 10:30:27.731280 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member,admin Jul 28 10:30:27.731280 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member,admin Jul 28 10:30:27.732564 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e7253cb3229b4a3a8e1b907ea9a03921"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7253cb3229b4a3a8e1b907ea9a03921"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7253cb3229b4a3a8e1b907ea9a03921"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e7253cb3229b4a3a8e1b907ea9a03921", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:27.732564 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-AggregatesAdminTestJSON-1786621531 Jul 28 10:30:27.732564 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: e7253cb3229b4a3a8e1b907ea9a03921 Jul 28 10:30:27.732564 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1786621531 Jul 28 10:30:27.732564 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-AggregatesAdminTestJSON-1786621531-project-admin Jul 28 10:30:27.732564 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:30:27.732564 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:30:27.732564 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 28d5691b771b4345b7944357c1bf4f53 Jul 28 10:30:27.732564 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-AggregatesAdminTestJSON-1786621531-project-admin Jul 28 10:30:27.732564 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:30:27.732564 n-d-850468-6 devstack@n-api.service[119463]: exception: Aggregate 13 could not be found. Jul 28 10:30:27.732564 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '13'} Jul 28 10:30:27.732564 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:27.733252 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:27.733252 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 28 10:30:27.733252 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 28 10:30:27.733252 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6418, in get_aggregate Jul 28 10:30:27.733252 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 28 10:30:27.733252 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:30:27.733252 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:30:27.733252 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 28 10:30:27.733252 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 28 10:30:27.733252 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:30:27.733252 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:30:27.733252 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 28 10:30:27.733252 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 28 10:30:27.733252 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Jul 28 10:30:27.733252 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:27.733252 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:27.733252 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:27.733252 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:27.733252 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:27.734279 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:27.734279 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:27.734279 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:27.734279 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:27.734279 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:27.734279 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 28 10:30:27.734279 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:30:27.734279 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Jul 28 10:30:27.734279 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:27.734279 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:27.734279 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:27.734279 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:27.734279 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:27.734279 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:27.734279 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:27.734279 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:27.734279 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Jul 28 10:30:27.734279 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:27.737698 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a2fa8d41-97c1-456e-bae7-156582e1c3f3 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:27.738919 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a2fa8d41-97c1-456e-bae7-156582e1c3f3 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.047049 Jul 28 10:30:27.741955 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 62/158] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:30:27 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:30:27.756960 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-54bec37d-e683-440d-9974-d8bcceb068f7 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:27.759027 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:27.759027 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:27.782290 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-54bec37d-e683-440d-9974-d8bcceb068f7 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Jul 28 10:30:27.784872 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-54bec37d-e683-440d-9974-d8bcceb068f7 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Request method failure captured: Jul 28 10:30:27.784872 n-d-850468-6 devstack@n-api.service[119463]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Jul 28 10:30:27.784872 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:30:27.784872 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:30:27.784872 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:30:27.784872 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:30:27.784872 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:30:27.784872 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:30:27.784872 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:30:27.784872 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:27.784872 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mUs_C9MmsEu-QDGxVBeFfz3PXfSFfDsZ_kJzyu0LTDGWPLLy-h00SA_0kXty7SAc3tgdM5hyXUC7pry4fEzdXvhwQhMTGqKCY6WgbJntIoi16_U3W8qw_-hxQm2nAbD52p20pTAZIZhzwEwC-KTUZsimSq4KhUHEUbD6-40zLBCc4M Jul 28 10:30:27.784872 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:30:27.784872 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:30:27.784872 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:30:27.784872 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:30:27.784872 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:30:27.784872 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:30:27.784872 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: e7253cb3229b4a3a8e1b907ea9a03921 Jul 28 10:30:27.784872 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-AggregatesAdminTestJSON-1786621531 Jul 28 10:30:27.784872 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member,admin Jul 28 10:30:27.784872 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member,admin Jul 28 10:30:27.786336 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e7253cb3229b4a3a8e1b907ea9a03921"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7253cb3229b4a3a8e1b907ea9a03921"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7253cb3229b4a3a8e1b907ea9a03921"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e7253cb3229b4a3a8e1b907ea9a03921", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:27.786336 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-AggregatesAdminTestJSON-1786621531 Jul 28 10:30:27.786336 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: e7253cb3229b4a3a8e1b907ea9a03921 Jul 28 10:30:27.786336 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1786621531 Jul 28 10:30:27.786336 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-AggregatesAdminTestJSON-1786621531-project-admin Jul 28 10:30:27.786336 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:30:27.786336 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:30:27.786336 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 28d5691b771b4345b7944357c1bf4f53 Jul 28 10:30:27.786336 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-AggregatesAdminTestJSON-1786621531-project-admin Jul 28 10:30:27.786336 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:30:27.786336 n-d-850468-6 devstack@n-api.service[119463]: exception: Aggregate 13 could not be found. Jul 28 10:30:27.786336 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '13'} Jul 28 10:30:27.786336 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:27.790647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:27.790647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 28 10:30:27.790647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 28 10:30:27.790647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 10:30:27.790647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 10:30:27.790647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:27.790647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:27.790647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:27.790647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:27.790647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 10:30:27.790647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 10:30:27.790647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6471, in delete_aggregate Jul 28 10:30:27.790647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 28 10:30:27.790647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:30:27.790647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:30:27.790647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 28 10:30:27.790647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 28 10:30:27.790647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:30:27.790647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:30:27.791926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 28 10:30:27.791926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 28 10:30:27.791926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Jul 28 10:30:27.791926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:27.791926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:27.791926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:27.791926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:27.791926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:27.791926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:27.791926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:27.791926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:27.791926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:27.791926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:27.791926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 28 10:30:27.791926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:30:27.791926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Jul 28 10:30:27.791926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:27.791926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:27.791926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:27.791926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:27.791926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:27.793442 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:27.793442 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:27.793442 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:27.793442 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Jul 28 10:30:27.793442 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:27.795208 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-54bec37d-e683-440d-9974-d8bcceb068f7 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:27.796609 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-54bec37d-e683-440d-9974-d8bcceb068f7 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.050008 Jul 28 10:30:27.797805 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 63/159] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Jul 28 10:30:27 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 28 10:30:27.812031 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b479544c-6b25-4748-9aec-5373e0a76980 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1941789596", "name": "tempest-test_aggregate-2119470265"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:27.819079 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:27.819079 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:27.822072 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.aggregate [None req-b479544c-6b25-4748-9aec-5373e0a76980 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Generated uuid 1214d756-bcb9-4cc9-88d0-ae022db92dcf for aggregate {{(pid=119463) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 10:30:27.891903 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b479544c-6b25-4748-9aec-5373e0a76980 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.087200 Jul 28 10:30:27.897375 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 64/160] 10.222.0.46 () {60 vars in 1165 bytes} [Thu Jul 28 10:30:27 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:27.914917 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-75bdd58c-03db-4776-81e9-bc29a27b3d53 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:27.919437 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:27.919437 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:27.975615 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-75bdd58c-03db-4776-81e9-bc29a27b3d53 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.072840 Jul 28 10:30:27.977117 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 65/161] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Jul 28 10:30:27 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 10:30:27.986461 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b5bf57c4-575d-4c3e-9369-b769ca87dd76 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:27.987538 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:27.987538 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:28.000489 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-b5bf57c4-575d-4c3e-9369-b769ca87dd76 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 28 10:30:28.002762 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b5bf57c4-575d-4c3e-9369-b769ca87dd76 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Request method failure captured: Jul 28 10:30:28.002762 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 28 10:30:28.002762 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:30:28.002762 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:30:28.002762 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:30:28.002762 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:30:28.002762 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:30:28.002762 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:30:28.002762 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:30:28.002762 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:28.002762 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mUs_C9MmsEu-QDGxVBeFfz3PXfSFfDsZ_kJzyu0LTDGWPLLy-h00SA_0kXty7SAc3tgdM5hyXUC7pry4fEzdXvhwQhMTGqKCY6WgbJntIoi16_U3W8qw_-hxQm2nAbD52p20pTAZIZhzwEwC-KTUZsimSq4KhUHEUbD6-40zLBCc4M Jul 28 10:30:28.002762 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:30:28.002762 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:30:28.002762 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:30:28.002762 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:30:28.002762 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:30:28.002762 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:30:28.002762 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: e7253cb3229b4a3a8e1b907ea9a03921 Jul 28 10:30:28.002762 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-AggregatesAdminTestJSON-1786621531 Jul 28 10:30:28.002762 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member,admin Jul 28 10:30:28.002762 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member,admin Jul 28 10:30:28.004033 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e7253cb3229b4a3a8e1b907ea9a03921"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7253cb3229b4a3a8e1b907ea9a03921"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7253cb3229b4a3a8e1b907ea9a03921"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e7253cb3229b4a3a8e1b907ea9a03921", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:28.004033 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-AggregatesAdminTestJSON-1786621531 Jul 28 10:30:28.004033 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: e7253cb3229b4a3a8e1b907ea9a03921 Jul 28 10:30:28.004033 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1786621531 Jul 28 10:30:28.004033 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-AggregatesAdminTestJSON-1786621531-project-admin Jul 28 10:30:28.004033 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:30:28.004033 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:30:28.004033 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 28d5691b771b4345b7944357c1bf4f53 Jul 28 10:30:28.004033 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-AggregatesAdminTestJSON-1786621531-project-admin Jul 28 10:30:28.004033 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:30:28.004033 n-d-850468-6 devstack@n-api.service[119463]: exception: Aggregate 14 could not be found. Jul 28 10:30:28.004033 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '14'} Jul 28 10:30:28.004033 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:28.004701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:28.004701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 28 10:30:28.004701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 28 10:30:28.004701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6418, in get_aggregate Jul 28 10:30:28.004701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 28 10:30:28.004701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:30:28.004701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:30:28.004701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 28 10:30:28.004701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 28 10:30:28.004701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:30:28.004701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:30:28.004701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 28 10:30:28.004701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 28 10:30:28.004701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 28 10:30:28.004701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:28.004701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:28.004701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:28.004701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:28.004701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:28.005691 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:28.005691 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:28.005691 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:28.005691 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:28.005691 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:28.005691 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 28 10:30:28.005691 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:30:28.005691 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 28 10:30:28.005691 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:28.005691 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:28.005691 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:28.005691 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:28.005691 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:28.005691 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:28.005691 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:28.005691 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:28.005691 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 28 10:30:28.005691 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:28.006691 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b5bf57c4-575d-4c3e-9369-b769ca87dd76 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:28.006691 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b5bf57c4-575d-4c3e-9369-b769ca87dd76 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.023064 Jul 28 10:30:28.006691 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 66/162] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:30:27 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:30:28.019521 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8b057ce6-7ead-46dc-a431-581f11620ab0 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:28.020327 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:28.020327 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:28.051935 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-8b057ce6-7ead-46dc-a431-581f11620ab0 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 28 10:30:28.056787 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8b057ce6-7ead-46dc-a431-581f11620ab0 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Request method failure captured: Jul 28 10:30:28.056787 n-d-850468-6 devstack@n-api.service[119463]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 28 10:30:28.056787 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:30:28.056787 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:30:28.056787 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:30:28.056787 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:30:28.056787 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:30:28.056787 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:30:28.056787 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:30:28.056787 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:28.056787 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mUs_C9MmsEu-QDGxVBeFfz3PXfSFfDsZ_kJzyu0LTDGWPLLy-h00SA_0kXty7SAc3tgdM5hyXUC7pry4fEzdXvhwQhMTGqKCY6WgbJntIoi16_U3W8qw_-hxQm2nAbD52p20pTAZIZhzwEwC-KTUZsimSq4KhUHEUbD6-40zLBCc4M Jul 28 10:30:28.056787 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:30:28.056787 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:30:28.056787 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:30:28.056787 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:30:28.056787 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:30:28.056787 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:30:28.056787 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: e7253cb3229b4a3a8e1b907ea9a03921 Jul 28 10:30:28.056787 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-AggregatesAdminTestJSON-1786621531 Jul 28 10:30:28.056787 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member,admin Jul 28 10:30:28.056787 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member,admin Jul 28 10:30:28.058184 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e7253cb3229b4a3a8e1b907ea9a03921"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7253cb3229b4a3a8e1b907ea9a03921"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7253cb3229b4a3a8e1b907ea9a03921"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e7253cb3229b4a3a8e1b907ea9a03921", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:28.058184 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-AggregatesAdminTestJSON-1786621531 Jul 28 10:30:28.058184 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: e7253cb3229b4a3a8e1b907ea9a03921 Jul 28 10:30:28.058184 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1786621531 Jul 28 10:30:28.058184 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-AggregatesAdminTestJSON-1786621531-project-admin Jul 28 10:30:28.058184 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:30:28.058184 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:30:28.058184 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 28d5691b771b4345b7944357c1bf4f53 Jul 28 10:30:28.058184 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-AggregatesAdminTestJSON-1786621531-project-admin Jul 28 10:30:28.058184 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:30:28.058184 n-d-850468-6 devstack@n-api.service[119463]: exception: Aggregate 14 could not be found. Jul 28 10:30:28.058184 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '14'} Jul 28 10:30:28.058184 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:28.059016 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:28.059016 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 28 10:30:28.059016 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 28 10:30:28.059016 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 10:30:28.059016 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 10:30:28.059016 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:28.059016 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:28.059016 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:28.059016 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:28.059016 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 10:30:28.059016 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 10:30:28.059016 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6471, in delete_aggregate Jul 28 10:30:28.059016 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 28 10:30:28.059016 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:30:28.059016 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:30:28.059016 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 28 10:30:28.059016 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 28 10:30:28.059016 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:30:28.059016 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:30:28.060325 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 28 10:30:28.060325 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 28 10:30:28.060325 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 28 10:30:28.060325 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:28.060325 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:28.060325 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:28.060325 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:28.060325 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:28.060325 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:28.060325 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:28.060325 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:28.060325 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:28.060325 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:28.060325 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 28 10:30:28.060325 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:30:28.060325 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 28 10:30:28.060325 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:28.060325 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:28.060325 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:28.060325 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:28.060325 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:28.063570 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:28.063570 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:28.063570 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:28.063570 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 28 10:30:28.063570 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:28.063570 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8b057ce6-7ead-46dc-a431-581f11620ab0 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:28.063570 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-8b057ce6-7ead-46dc-a431-581f11620ab0 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.044366 Jul 28 10:30:28.064361 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 67/163] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Jul 28 10:30:28 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:30:28.075185 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-9b539b9b-5bc7-408d-9945-8a8bcbcf60ad tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-164397406"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:28.077734 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:28.077734 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:28.078905 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.aggregate [None req-9b539b9b-5bc7-408d-9945-8a8bcbcf60ad tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Generated uuid c8d491fa-85af-439b-9bd8-b22146ed4096 for aggregate {{(pid=119463) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 10:30:28.158967 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-9b539b9b-5bc7-408d-9945-8a8bcbcf60ad tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.091296 Jul 28 10:30:28.171522 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 68/164] 10.222.0.46 () {60 vars in 1164 bytes} [Thu Jul 28 10:30:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:28.184658 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ed18b0a9-286b-488e-b64f-fc3cf2b0786d tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:28.185759 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:28.185759 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:28.206490 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ed18b0a9-286b-488e-b64f-fc3cf2b0786d tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 227 microversion: 2.1 time: 0.033317 Jul 28 10:30:28.216090 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 69/165] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:30:28 2022] GET /compute/v2.1/os-aggregates/15 => generated 227 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:28.258284 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b08eb415-65ae-4b15-bde6-fb321239a84b tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:28.265123 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:28.265123 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:28.327678 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b08eb415-65ae-4b15-bde6-fb321239a84b tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 265 microversion: 2.1 time: 0.110144 Jul 28 10:30:28.329107 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 70/166] 10.222.0.46 () {60 vars in 1194 bytes} [Thu Jul 28 10:30:28 2022] POST /compute/v2.1/os-aggregates/15/action => generated 265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:28.346649 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6c49275c-2ab4-496f-a948-5152454ec82c tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:28.365678 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:28.365678 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:28.392532 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6c49275c-2ab4-496f-a948-5152454ec82c tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 241 microversion: 2.1 time: 0.054997 Jul 28 10:30:28.400641 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 71/167] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:30:28 2022] GET /compute/v2.1/os-aggregates/15 => generated 241 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:28.412540 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-dc8e94a9-55fe-4e41-89e1-53d06fb7599a tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:28.415854 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:28.415854 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:28.472792 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-dc8e94a9-55fe-4e41-89e1-53d06fb7599a tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.070877 Jul 28 10:30:28.478076 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 72/168] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Jul 28 10:30:28 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 10:30:28.478258 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-90070cbc-738e-4759-b7dd-558684789ab5 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/662464725/action" status: 200 len: 21 microversion: 2.1 time: 1.681175 Jul 28 10:30:28.478258 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 97/169] 10.222.0.46 () {60 vars in 1197 bytes} [Thu Jul 28 10:30:26 2022] POST /compute/v2.1/flavors/662464725/action => generated 21 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:30:28.490694 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6a1408f9-babd-4e37-b877-b86a66d4c27c tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2014048069", "availability_zone": "tempest-test_az-1513657594"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:28.495040 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b655b3aa-0248-4936-9805-b54df83a959c tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:28.499459 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:28.499459 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:28.500679 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:28.500679 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:28.509517 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.aggregate [None req-6a1408f9-babd-4e37-b877-b86a66d4c27c tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Generated uuid 940a9d21-e734-49ae-bb1f-5754cb9a6752 for aggregate {{(pid=119463) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 10:30:28.540935 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=12,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:28.569587 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b655b3aa-0248-4936-9805-b54df83a959c tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/662464725" status: 202 len: 0 microversion: 2.1 time: 0.085600 Jul 28 10:30:28.578120 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 98/170] 10.222.0.46 () {58 vars in 1158 bytes} [Thu Jul 28 10:30:28 2022] DELETE /compute/v2.1/flavors/662464725 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:30:28.604897 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6a1408f9-babd-4e37-b877-b86a66d4c27c tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.122514 Jul 28 10:30:28.605364 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-23350224-acc5-4f50-a7da-aece45d4b4f7 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:28.607641 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 73/171] 10.222.0.46 () {60 vars in 1165 bytes} [Thu Jul 28 10:30:28 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:28.636028 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-54856dfb-066d-461d-8250-7f6937b0de3e tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2014048069_new", "availability_zone": "tempest-test_az-1513657594_new"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:28.681278 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-23350224-acc5-4f50-a7da-aece45d4b4f7 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.100916 Jul 28 10:30:28.685271 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 99/172] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:28.720845 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-76ba0b74-883c-4cf4-833c-671fa4d27747 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-279400662", "id": 1966080862, "os-flavor-access:is_public": "False"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:28.724399 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:28.724399 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:28.771797 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-76ba0b74-883c-4cf4-833c-671fa4d27747 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.055124 Jul 28 10:30:28.773829 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 100/173] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:28 2022] POST /compute/v2.1/flavors => generated 438 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:30:28.792536 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c4d9c56f-a330-445e-b9aa-d438bdb2d28c tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7468b5ca4ddb4dbfbec7d68cdd4bb94c"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:28.983531 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:28.983531 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:29.027962 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-54856dfb-066d-461d-8250-7f6937b0de3e tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:29.028641 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-54856dfb-066d-461d-8250-7f6937b0de3e tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:29.077617 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-54856dfb-066d-461d-8250-7f6937b0de3e tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 337 microversion: 2.1 time: 0.456802 Jul 28 10:30:29.079283 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 74/174] 10.222.0.46 () {60 vars in 1173 bytes} [Thu Jul 28 10:30:28 2022] PUT /compute/v2.1/os-aggregates/16 => generated 337 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:29.095934 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2e0a931d-bd58-4ff4-8378-0bc0d57f7af9 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:29.098031 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:29.098031 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:29.114811 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-2e0a931d-bd58-4ff4-8378-0bc0d57f7af9 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.027347 Jul 28 10:30:29.119245 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 75/175] 10.222.0.46 () {58 vars in 1143 bytes} [Thu Jul 28 10:30:29 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:30:29.135451 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-25e26da9-13ce-4011-beff-7482a1e90398 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:29.137318 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:29.137318 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:29.181463 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-25e26da9-13ce-4011-beff-7482a1e90398 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.054284 Jul 28 10:30:29.187962 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 76/176] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Jul 28 10:30:29 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 10:30:29.195865 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-fe4a90ca-ca82-45cd-85ec-d1274910dab8 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-865095200"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:29.209565 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:29.209565 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:29.217524 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.aggregate [None req-fe4a90ca-ca82-45cd-85ec-d1274910dab8 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Generated uuid c8dd9b15-0498-4dfa-9b86-bb021532e991 for aggregate {{(pid=119463) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 10:30:29.276498 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-fe4a90ca-ca82-45cd-85ec-d1274910dab8 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.086277 Jul 28 10:30:29.277122 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 77/177] 10.222.0.46 () {60 vars in 1164 bytes} [Thu Jul 28 10:30:29 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:29.292286 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-649bd96d-26c7-4bba-b5b0-fabe676d1db8 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:29.293054 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:29.293054 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:29.314296 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-649bd96d-26c7-4bba-b5b0-fabe676d1db8 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.028255 Jul 28 10:30:29.314986 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 78/178] 10.222.0.46 () {58 vars in 1143 bytes} [Thu Jul 28 10:30:29 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:29.333143 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-43d9dd4f-bf73-4b81-a3dc-13c5ac985728 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:29.334285 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:29.334285 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:29.392936 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-43d9dd4f-bf73-4b81-a3dc-13c5ac985728 tempest-AggregatesAdminTestJSON-1786621531 tempest-AggregatesAdminTestJSON-1786621531-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.066355 Jul 28 10:30:29.399196 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 79/179] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Jul 28 10:30:29 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 28 10:30:30.282210 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-c4d9c56f-a330-445e-b9aa-d438bdb2d28c tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] HTTP exception thrown: Flavor access not found for 24 / 7468b5ca4ddb4dbfbec7d68cdd4bb94c combination. Jul 28 10:30:30.284654 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c4d9c56f-a330-445e-b9aa-d438bdb2d28c tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Request method failure captured: Jul 28 10:30:30.284654 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/flavors/1966080862/action HTTP/1.1 Jul 28 10:30:30.284654 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:30.284654 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:30.284654 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:30.284654 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 70 Jul 28 10:30:30.284654 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:30.284654 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:30.284654 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:30.284654 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:30.284654 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mU-FofhN-B5BYHMNoV1NJ6LQEerxH31GuL7Zwts9iaAIb7t91PkCleGApfzxCyeuiQ8f82VX3-ZD5xbW4IA-4l8GriHqVDyoXulVefvrmIlO__RhI7QUbko1KC8vZZDyelgxd4KHZxds6q7xebRk2PwygnDcRWNwWsdDL0w8IcspfE Jul 28 10:30:30.284654 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:30.284654 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:30.284654 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:30.284654 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:30.284654 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:30.284654 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:30.284654 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: fec9c0d7214f43b7bcc499a91acf51fb Jul 28 10:30:30.284654 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-977534592 Jul 28 10:30:30.284654 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:30:30.284654 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:30:30.285992 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fec9c0d7214f43b7bcc499a91acf51fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fec9c0d7214f43b7bcc499a91acf51fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fec9c0d7214f43b7bcc499a91acf51fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fec9c0d7214f43b7bcc499a91acf51fb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:30.285992 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-977534592 Jul 28 10:30:30.285992 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: fec9c0d7214f43b7bcc499a91acf51fb Jul 28 10:30:30.285992 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-977534592 Jul 28 10:30:30.285992 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin Jul 28 10:30:30.285992 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:30.285992 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:30.285992 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: cf085c6967e64c46a671f94f16354ba9 Jul 28 10:30:30.285992 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin Jul 28 10:30:30.285992 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:30:30.285992 n-d-850468-6 devstack@n-api.service[119464]: {"removeTenantAccess": {"tenant": "7468b5ca4ddb4dbfbec7d68cdd4bb94c"}} Jul 28 10:30:30.285992 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:30.286696 n-d-850468-6 devstack@n-api.service[119464]: exception: Flavor access not found for 24 / 7468b5ca4ddb4dbfbec7d68cdd4bb94c combination. Jul 28 10:30:30.286696 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '1966080862', 'body': {'removeTenantAccess': {'tenant': '7468b5ca4ddb4dbfbec7d68cdd4bb94c'}}} Jul 28 10:30:30.286696 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:30.286696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:30.286696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 28 10:30:30.286696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 28 10:30:30.286696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 28 10:30:30.286696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 28 10:30:30.286696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 28 10:30:30.286696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 28 10:30:30.286696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 28 10:30:30.286696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 28 10:30:30.286696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 28 10:30:30.286696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 28 10:30:30.286696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:30:30.286696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:30:30.286696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 28 10:30:30.286696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 28 10:30:30.287956 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 24 / 7468b5ca4ddb4dbfbec7d68cdd4bb94c combination. Jul 28 10:30:30.287956 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:30.287956 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:30.287956 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:30.287956 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:30.287956 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:30.287956 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:30.287956 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:30.287956 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:30.287956 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:30.287956 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:30.287956 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:30.287956 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:30.287956 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 28 10:30:30.287956 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:30:30.287956 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 24 / 7468b5ca4ddb4dbfbec7d68cdd4bb94c combination. Jul 28 10:30:30.287956 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:30.287956 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:30.287956 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:30.287956 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:30.289369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:30.289369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:30.289369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:30.289369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:30.289369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 24 / 7468b5ca4ddb4dbfbec7d68cdd4bb94c combination. Jul 28 10:30:30.289369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:30.289369 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c4d9c56f-a330-445e-b9aa-d438bdb2d28c tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Returning 404 to user: Flavor access not found for 24 / 7468b5ca4ddb4dbfbec7d68cdd4bb94c combination. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:30.289369 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c4d9c56f-a330-445e-b9aa-d438bdb2d28c tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1966080862/action" status: 404 len: 124 microversion: 2.1 time: 1.500082 Jul 28 10:30:30.289369 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 101/180] 10.222.0.46 () {60 vars in 1200 bytes} [Thu Jul 28 10:30:28 2022] POST /compute/v2.1/flavors/1966080862/action => generated 124 bytes in 1501 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:30:30.298291 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0860ed30-094d-4cba-ab34-9ebf521edda3 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:30.299020 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:30.299020 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:30.341377 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-0860ed30-094d-4cba-ab34-9ebf521edda3 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1966080862" status: 202 len: 0 microversion: 2.1 time: 0.047964 Jul 28 10:30:30.343607 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 80/181] 10.222.0.46 () {58 vars in 1161 bytes} [Thu Jul 28 10:30:30 2022] DELETE /compute/v2.1/flavors/1966080862 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:30:30.352171 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-efa53b9e-eeca-4707-8a60-79c2aba293c0 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:30.390206 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-efa53b9e-eeca-4707-8a60-79c2aba293c0 tempest-FlavorsAccessNegativeTestJSON-977534592 tempest-FlavorsAccessNegativeTestJSON-977534592-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042170 Jul 28 10:30:30.394470 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 102/182] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:30.644319 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-405427801", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "1c87581d-6ea4-480a-85dd-94af3087f3e2"}], "security_groups": [{"name": "tempest-securitygroup--138401951"}], "key_name": "tempest-keypair-1697056807", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:30.664535 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=15,nova_api:INSERT=8,nova_api:UPDATE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:30.849219 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] validate_networks() for [('1c87581d-6ea4-480a-85dd-94af3087f3e2', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:30:31.471017 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:30:31.473652 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:30:31.474359 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:30:31.474779 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:30:31.475359 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:30:31.490751 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:31.491539 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:31.493493 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:31.494394 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:31.531540 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Getting quotas for project 07e2042b56704e9fb5195d43d8116494. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:30:31.542117 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Getting quotas for user 5a46f399714c4124a253c57a26f77a0b and project 07e2042b56704e9fb5195d43d8116494. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:30:31.567883 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:30:31.576800 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3eeee074-4c34-444d-a53c-5d676482565c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:30:31.664167 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-738091e6-234e-476e-9c88-3d0f05d159c3 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.017098 Jul 28 10:30:31.670015 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 81/183] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Jul 28 10:30:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 28 10:30:31.681753 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-45e8470f-2615-4557-a122-64b71e8ab00b tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:31.682453 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-45e8470f-2615-4557-a122-64b71e8ab00b tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3eeee074-4c34-444d-a53c-5d676482565c] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:31.821018 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-45e8470f-2615-4557-a122-64b71e8ab00b tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:31.841576 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-45e8470f-2615-4557-a122-64b71e8ab00b tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:31.844432 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-45e8470f-2615-4557-a122-64b71e8ab00b tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:31.846736 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-45e8470f-2615-4557-a122-64b71e8ab00b tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] 10.222.0.46 "GET /compute/v2.1/servers/3eeee074-4c34-444d-a53c-5d676482565c" status: 200 len: 1285 microversion: 2.25 time: 0.171321 Jul 28 10:30:31.848208 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 103/184] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:30:31 2022] GET /compute/v2.1/servers/3eeee074-4c34-444d-a53c-5d676482565c => generated 1285 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:30:32.871963 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-52bc6436-06eb-4f23-89cd-70646c98851f tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:32.873084 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-52bc6436-06eb-4f23-89cd-70646c98851f tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3eeee074-4c34-444d-a53c-5d676482565c] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:32.884325 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-52bc6436-06eb-4f23-89cd-70646c98851f tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:32.885097 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-52bc6436-06eb-4f23-89cd-70646c98851f tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:32.886008 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-52bc6436-06eb-4f23-89cd-70646c98851f tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:32.886658 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-52bc6436-06eb-4f23-89cd-70646c98851f tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:32.929844 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-52bc6436-06eb-4f23-89cd-70646c98851f tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:32.930711 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-52bc6436-06eb-4f23-89cd-70646c98851f tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:32.931428 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-52bc6436-06eb-4f23-89cd-70646c98851f tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lazy-loading 'fault' on Instance uuid 3eeee074-4c34-444d-a53c-5d676482565c {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:30:32.986887 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-52bc6436-06eb-4f23-89cd-70646c98851f tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:32.998599 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-52bc6436-06eb-4f23-89cd-70646c98851f tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:33.000709 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-52bc6436-06eb-4f23-89cd-70646c98851f tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:33.002116 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-52bc6436-06eb-4f23-89cd-70646c98851f tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] 10.222.0.46 "GET /compute/v2.1/servers/3eeee074-4c34-444d-a53c-5d676482565c" status: 200 len: 1358 microversion: 2.25 time: 0.135202 Jul 28 10:30:33.015183 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 82/185] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:30:32 2022] GET /compute/v2.1/servers/3eeee074-4c34-444d-a53c-5d676482565c => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:30:33.029553 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9751dd7e-f2ef-4260-9ba4-5007f01c2d25 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:33.030210 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-9751dd7e-f2ef-4260-9ba4-5007f01c2d25 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3eeee074-4c34-444d-a53c-5d676482565c] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:33.045897 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9751dd7e-f2ef-4260-9ba4-5007f01c2d25 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:33.047530 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9751dd7e-f2ef-4260-9ba4-5007f01c2d25 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:33.049205 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9751dd7e-f2ef-4260-9ba4-5007f01c2d25 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:33.050267 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9751dd7e-f2ef-4260-9ba4-5007f01c2d25 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:33.105016 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-9751dd7e-f2ef-4260-9ba4-5007f01c2d25 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3eeee074-4c34-444d-a53c-5d676482565c] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:30:33.196292 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-9751dd7e-f2ef-4260-9ba4-5007f01c2d25 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3eeee074-4c34-444d-a53c-5d676482565c] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:30:33.197519 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9751dd7e-f2ef-4260-9ba4-5007f01c2d25 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:33.198174 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9751dd7e-f2ef-4260-9ba4-5007f01c2d25 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:33.199974 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-9751dd7e-f2ef-4260-9ba4-5007f01c2d25 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3eeee074-4c34-444d-a53c-5d676482565c] instance's host None is down, deleting from database Jul 28 10:30:33.204776 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-9751dd7e-f2ef-4260-9ba4-5007f01c2d25 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3eeee074-4c34-444d-a53c-5d676482565c] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:30:33.254034 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-9751dd7e-f2ef-4260-9ba4-5007f01c2d25 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3eeee074-4c34-444d-a53c-5d676482565c] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:30:33.263251 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-9751dd7e-f2ef-4260-9ba4-5007f01c2d25 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3eeee074-4c34-444d-a53c-5d676482565c] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:30:33.512998 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9751dd7e-f2ef-4260-9ba4-5007f01c2d25 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3eeee074-4c34-444d-a53c-5d676482565c" status: 204 len: 0 microversion: 2.25 time: 0.488342 Jul 28 10:30:33.514661 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 104/186] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:30:33 2022] DELETE /compute/v2.1/servers/3eeee074-4c34-444d-a53c-5d676482565c => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:30:33.522626 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ba714795-0c56-4c4f-8b6b-381a629d8b06 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:33.525792 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ba714795-0c56-4c4f-8b6b-381a629d8b06 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3eeee074-4c34-444d-a53c-5d676482565c] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:33.531690 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ba714795-0c56-4c4f-8b6b-381a629d8b06 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:33.532133 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ba714795-0c56-4c4f-8b6b-381a629d8b06 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:33.533173 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ba714795-0c56-4c4f-8b6b-381a629d8b06 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:33.533744 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ba714795-0c56-4c4f-8b6b-381a629d8b06 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:33.561141 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-ba714795-0c56-4c4f-8b6b-381a629d8b06 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] HTTP exception thrown: Instance 3eeee074-4c34-444d-a53c-5d676482565c could not be found. Jul 28 10:30:33.573660 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ba714795-0c56-4c4f-8b6b-381a629d8b06 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Request method failure captured: Jul 28 10:30:33.573660 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/3eeee074-4c34-444d-a53c-5d676482565c HTTP/1.1 Jul 28 10:30:33.573660 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:30:33.573660 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:30:33.573660 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:30:33.573660 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:30:33.573660 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:30:33.573660 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:30:33.573660 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:30:33.573660 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:33.573660 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mUsDviFxmY2HLnGTreQtLgTrjcwl5_NhXA8w3Wifn-1kTLdQ48tKyZ79DQ9rEyzANfG20a4jdfnSWv4KS8pqkIbvf6DmNC9lXwT2Ni0Wut_Q1LjpGOxZtZ60egcXO8jPUx_e7sWdhLEkb8L4vGtXp4V7Pb0IXhzCJLNSEOBzCN4Avg Jul 28 10:30:33.573660 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:30:33.573660 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:30:33.573660 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:30:33.573660 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:30:33.573660 n-d-850468-6 devstack@n-api.service[119463]: X-Openstack-Nova-Api-Version: 2.25 Jul 28 10:30:33.573660 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:30:33.573660 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:30:33.573660 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 07e2042b56704e9fb5195d43d8116494 Jul 28 10:30:33.573660 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-131348017 Jul 28 10:30:33.573660 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:30:33.573660 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:30:33.575923 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/07e2042b56704e9fb5195d43d8116494"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/07e2042b56704e9fb5195d43d8116494"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/07e2042b56704e9fb5195d43d8116494"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_07e2042b56704e9fb5195d43d8116494", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:33.575923 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-131348017 Jul 28 10:30:33.575923 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 07e2042b56704e9fb5195d43d8116494 Jul 28 10:30:33.575923 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-131348017 Jul 28 10:30:33.575923 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-LiveAutoBlockMigrationV225Test-131348017-project Jul 28 10:30:33.575923 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:30:33.575923 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:30:33.575923 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 5a46f399714c4124a253c57a26f77a0b Jul 28 10:30:33.575923 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-131348017-project Jul 28 10:30:33.575923 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:30:33.575923 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 3eeee074-4c34-444d-a53c-5d676482565c could not be found. Jul 28 10:30:33.575923 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '3eeee074-4c34-444d-a53c-5d676482565c'} Jul 28 10:30:33.577217 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:33.577217 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:33.577217 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:30:33.577217 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:30:33.577217 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:30:33.577217 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:30:33.577217 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:30:33.577217 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:30:33.577217 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:30:33.577217 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:30:33.577217 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eeee074-4c34-444d-a53c-5d676482565c could not be found. Jul 28 10:30:33.577217 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:33.577217 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:33.577217 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:33.577217 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:33.577217 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:33.577217 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:33.577217 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:33.577217 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:33.577217 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:33.579057 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:33.579057 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:30:33.579057 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:30:33.579057 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:30:33.579057 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:30:33.579057 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:30:33.579057 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:30:33.579057 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eeee074-4c34-444d-a53c-5d676482565c could not be found. Jul 28 10:30:33.579057 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:33.579057 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:33.579057 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:33.579057 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:33.579057 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:33.579057 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:33.579057 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:33.579057 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:33.579057 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eeee074-4c34-444d-a53c-5d676482565c could not be found. Jul 28 10:30:33.579057 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:30:33.582423 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ba714795-0c56-4c4f-8b6b-381a629d8b06 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Returning 404 to user: Instance 3eeee074-4c34-444d-a53c-5d676482565c could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:33.584989 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ba714795-0c56-4c4f-8b6b-381a629d8b06 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] 10.222.0.46 "GET /compute/v2.1/servers/3eeee074-4c34-444d-a53c-5d676482565c" status: 404 len: 111 microversion: 2.25 time: 0.064987 Jul 28 10:30:33.586834 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 83/187] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:30:33 2022] GET /compute/v2.1/servers/3eeee074-4c34-444d-a53c-5d676482565c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:30:37.271163 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9751dd7e-f2ef-4260-9ba4-5007f01c2d25 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:37.272163 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9751dd7e-f2ef-4260-9ba4-5007f01c2d25 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] 10.222.0.46 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001691 Jul 28 10:30:37.272484 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 105/188] 10.222.0.46 () {56 vars in 886 bytes} [Thu Jul 28 10:30:37 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 28 10:30:40.097815 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-fb085d5d-a879-4f4b-9a69-df72873590cf tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:40.100747 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:40.100747 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:40.104302 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fb085d5d-a879-4f4b-9a69-df72873590cf tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:40.104757 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fb085d5d-a879-4f4b-9a69-df72873590cf tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:40.107874 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fb085d5d-a879-4f4b-9a69-df72873590cf tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:40.109516 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fb085d5d-a879-4f4b-9a69-df72873590cf tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:40.124145 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=43 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:40.178426 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-fb085d5d-a879-4f4b-9a69-df72873590cf tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 1.780433 Jul 28 10:30:40.191674 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 84/189] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 10:30:38 2022] GET /compute/v2.1/os-services => generated 944 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:40.206768 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-29008c74-d697-47a6-b802-fc8c64807e28 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:40.209425 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:40.209425 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:40.212481 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-29008c74-d697-47a6-b802-fc8c64807e28 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:40.213142 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-29008c74-d697-47a6-b802-fc8c64807e28 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:40.216411 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-29008c74-d697-47a6-b802-fc8c64807e28 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:40.222064 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-29008c74-d697-47a6-b802-fc8c64807e28 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:40.223219 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=72 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:40.552619 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-29008c74-d697-47a6-b802-fc8c64807e28 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.347272 Jul 28 10:30:40.556126 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 106/190] 10.222.0.46 () {58 vars in 1170 bytes} [Thu Jul 28 10:30:40 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:40.568990 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3288ee94-05a5-4e5c-85fb-fc96b017a782 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:40.572081 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:40.572081 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:40.573923 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3288ee94-05a5-4e5c-85fb-fc96b017a782 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:40.575602 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3288ee94-05a5-4e5c-85fb-fc96b017a782 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:40.576964 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3288ee94-05a5-4e5c-85fb-fc96b017a782 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:40.577970 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3288ee94-05a5-4e5c-85fb-fc96b017a782 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:40.649526 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3288ee94-05a5-4e5c-85fb-fc96b017a782 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.082396 Jul 28 10:30:40.655821 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 85/191] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 10:30:40 2022] GET /compute/v2.1/os-services => generated 944 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:40.670573 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5bfee764-3d15-46ed-a87a-7f77beb2d151 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:40.674272 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:40.674272 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:40.677743 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5bfee764-3d15-46ed-a87a-7f77beb2d151 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:40.678238 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5bfee764-3d15-46ed-a87a-7f77beb2d151 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:40.680237 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5bfee764-3d15-46ed-a87a-7f77beb2d151 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:40.681196 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5bfee764-3d15-46ed-a87a-7f77beb2d151 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:40.765766 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-5bfee764-3d15-46ed-a87a-7f77beb2d151 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?host=n-d-850468-6&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.102323 Jul 28 10:30:40.775092 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 107/192] 10.222.0.46 () {58 vars in 1194 bytes} [Thu Jul 28 10:30:40 2022] GET /compute/v2.1/os-services?host=n-d-850468-6&binary=xxx => generated 16 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:30:40.805773 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-90f24287-8234-4862-85d1-359c8d613903 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:40.813362 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:40.813362 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:40.817556 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-90f24287-8234-4862-85d1-359c8d613903 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:40.818053 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-90f24287-8234-4862-85d1-359c8d613903 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:40.818890 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-90f24287-8234-4862-85d1-359c8d613903 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:40.819452 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-90f24287-8234-4862-85d1-359c8d613903 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:40.884957 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-90f24287-8234-4862-85d1-359c8d613903 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.105969 Jul 28 10:30:40.892474 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 108/193] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 10:30:40 2022] GET /compute/v2.1/os-services => generated 944 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:40.904290 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-3887e60d-845f-4c02-99bd-943cab4245b3 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:40.906979 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:40.906979 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:40.927737 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3887e60d-845f-4c02-99bd-943cab4245b3 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:40.933570 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3887e60d-845f-4c02-99bd-943cab4245b3 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:40.934854 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3887e60d-845f-4c02-99bd-943cab4245b3 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:40.938703 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3887e60d-845f-4c02-99bd-943cab4245b3 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:41.048152 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-3887e60d-845f-4c02-99bd-943cab4245b3 tempest-ServicesAdminNegativeTestJSON-1854086972 tempest-ServicesAdminNegativeTestJSON-1854086972-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.152106 Jul 28 10:30:41.056444 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 109/194] 10.222.0.46 () {58 vars in 1198 bytes} [Thu Jul 28 10:30:40 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:30:41.553475 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=28 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:41.574496 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f16ddd47-fd58-4feb-87ed-6a6f0ccd5db4 tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] Action: 'update', calling method: .version_select at 0x7fa9582c2790>, body: {"quota_set": {"ram": "5120"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:41.735398 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2dc50f60-fff1-47f3-ad70-d2ef4483b097 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-923055345", "id": 1539133325, "os-flavor-access:is_public": "True"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:41.739201 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:41.739201 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:41.780848 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-2dc50f60-fff1-47f3-ad70-d2ef4483b097 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.727952 Jul 28 10:30:41.781456 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 110/195] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:41 2022] POST /compute/v2.1/flavors => generated 429 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:41.833828 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=22 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:42.028369 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-270ac9ab-5fdc-4ea2-b222-8f9f34b916c0 tempest-ServicesAdminNegativeTestJSON-1753758883 tempest-ServicesAdminNegativeTestJSON-1753758883-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:42.034156 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:42.034156 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:42.042877 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-270ac9ab-5fdc-4ea2-b222-8f9f34b916c0 tempest-ServicesAdminNegativeTestJSON-1753758883 tempest-ServicesAdminNegativeTestJSON-1753758883-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '4e09a6afebf445119f21933010e55a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc520d1802f495996f2ae0be8aadc90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:42.052071 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-270ac9ab-5fdc-4ea2-b222-8f9f34b916c0 tempest-ServicesAdminNegativeTestJSON-1753758883 tempest-ServicesAdminNegativeTestJSON-1753758883-project] Request method failure captured: Jul 28 10:30:42.052071 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 28 10:30:42.052071 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:42.052071 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:42.052071 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:42.052071 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:30:42.052071 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:42.052071 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:42.052071 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:42.052071 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:42.052071 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mVJGN-JxPl_C7hGAGAARw14qJjF3ktA1xI5hIsEI2xHsHZqB84G4y5-jcy4JaMy8dulm2F-x5mQBhI1Rany2UmQ0GivEG5t0nXJAHhAbNPJSvcq5PNa1_M-Yf_gcQfIMQ3Lv-QlCqbS0K313vcsVhbeqGkwGn8GA-t0PHt7BNfuMD0 Jul 28 10:30:42.052071 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:42.052071 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:42.052071 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:42.052071 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:42.052071 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:42.052071 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:42.052071 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 0dc520d1802f495996f2ae0be8aadc90 Jul 28 10:30:42.052071 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1753758883 Jul 28 10:30:42.052071 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:30:42.052071 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:30:42.053328 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0dc520d1802f495996f2ae0be8aadc90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0dc520d1802f495996f2ae0be8aadc90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0dc520d1802f495996f2ae0be8aadc90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0dc520d1802f495996f2ae0be8aadc90", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:42.053328 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1753758883 Jul 28 10:30:42.053328 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 0dc520d1802f495996f2ae0be8aadc90 Jul 28 10:30:42.053328 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1753758883 Jul 28 10:30:42.053328 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ServicesAdminNegativeTestJSON-1753758883-project Jul 28 10:30:42.053328 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:42.053328 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:42.053328 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 4e09a6afebf445119f21933010e55a44 Jul 28 10:30:42.053328 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1753758883-project Jul 28 10:30:42.053328 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:42.053328 n-d-850468-6 devstack@n-api.service[119464]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 28 10:30:42.053328 n-d-850468-6 devstack@n-api.service[119464]: action_args: {} Jul 28 10:30:42.054088 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:42.054088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:42.054088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:42.054088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:42.054088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:42.054088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:42.054088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 10:30:42.054088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:42.054088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 10:30:42.054088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:42.054088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:42.054088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:42.054088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 28 10:30:42.054088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 28 10:30:42.054088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:30:42.054088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:30:42.054088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:30:42.054088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:30:42.054088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:30:42.055132 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:30:42.055132 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:30:42.055132 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:30:42.055132 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:30:42.055132 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:30:42.055132 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:30:42.055132 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:30:42.055132 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:30:42.055132 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:30:42.055132 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 28 10:30:42.055132 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:42.055132 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:42.055132 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:42.055132 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:42.055132 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:42.055132 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:42.055132 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:30:42.055132 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:30:42.055132 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 28 10:30:42.055132 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:42.057276 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-270ac9ab-5fdc-4ea2-b222-8f9f34b916c0 tempest-ServicesAdminNegativeTestJSON-1753758883 tempest-ServicesAdminNegativeTestJSON-1753758883-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:42.057276 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-270ac9ab-5fdc-4ea2-b222-8f9f34b916c0 tempest-ServicesAdminNegativeTestJSON-1753758883 tempest-ServicesAdminNegativeTestJSON-1753758883-project] 10.222.0.46 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.271043 Jul 28 10:30:42.060240 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 111/196] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 10:30:41 2022] GET /compute/v2.1/os-services => generated 112 bytes in 278 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:42.075238 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-142a3d5d-bd98-47ea-a1af-4f20dad5bc03 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:42.081368 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:42.081368 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:42.154935 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-142a3d5d-bd98-47ea-a1af-4f20dad5bc03 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1539133325" status: 202 len: 0 microversion: 2.1 time: 0.086196 Jul 28 10:30:42.160060 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 112/197] 10.222.0.46 () {58 vars in 1161 bytes} [Thu Jul 28 10:30:42 2022] DELETE /compute/v2.1/flavors/1539133325 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:30:42.190653 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-35209d5e-ec85-47ad-9482-b1d759bfb0d8 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:42.222430 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-35209d5e-ec85-47ad-9482-b1d759bfb0d8 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043431 Jul 28 10:30:42.223425 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 113/198] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:42.244555 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-11889824-5f22-4d55-b999-17daabff27f3 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1562657053", "id": 1610818796, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:42.285834 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-11889824-5f22-4d55-b999-17daabff27f3 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.044765 Jul 28 10:30:42.287704 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 114/199] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:42 2022] POST /compute/v2.1/flavors => generated 417 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:42.310010 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-bacbf7b8-7014-4e09-9576-9964532ec1d3 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:42.339656 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-bacbf7b8-7014-4e09-9576-9964532ec1d3 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.043058 Jul 28 10:30:42.343587 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 115/200] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:42 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:42.360213 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a38e95e2-6401-4d4e-9e85-a4123f6afdd7 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:42.398190 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a38e95e2-6401-4d4e-9e85-a4123f6afdd7 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1610818796" status: 202 len: 0 microversion: 2.1 time: 0.040787 Jul 28 10:30:42.399575 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 116/201] 10.222.0.46 () {58 vars in 1161 bytes} [Thu Jul 28 10:30:42 2022] DELETE /compute/v2.1/flavors/1610818796 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:30:42.411583 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a1f0f37f-af89-4627-9577-8702c56c43ac tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:42.486024 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a1f0f37f-af89-4627-9577-8702c56c43ac tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073488 Jul 28 10:30:42.498539 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 117/202] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:42.518993 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f9ca014d-bc7f-49ed-956d-0f2288f688cf tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-314969844", "id": 1827242834, "os-flavor-access:is_public": "True"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:42.559073 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f9ca014d-bc7f-49ed-956d-0f2288f688cf tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.045346 Jul 28 10:30:42.562507 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 118/203] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:42 2022] POST /compute/v2.1/flavors => generated 428 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:42.593623 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-53ac2af4-7d81-437f-a979-7aaea8eaa02a tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:42.652694 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-53ac2af4-7d81-437f-a979-7aaea8eaa02a tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1827242834" status: 202 len: 0 microversion: 2.1 time: 0.072180 Jul 28 10:30:42.653294 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 119/204] 10.222.0.46 () {58 vars in 1161 bytes} [Thu Jul 28 10:30:42 2022] DELETE /compute/v2.1/flavors/1827242834 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:30:42.662757 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-053c0f16-0dff-4ae4-bd5c-76959c3fbd82 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:42.716568 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-053c0f16-0dff-4ae4-bd5c-76959c3fbd82 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058686 Jul 28 10:30:42.722777 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 120/205] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:42.741997 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-79b11445-91b6-40ec-900a-3842c3228f12 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-12306527", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:42.771949 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-79b11445-91b6-40ec-900a-3842c3228f12 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 505 microversion: 2.1 time: 0.034975 Jul 28 10:30:42.773595 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 121/206] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:42 2022] POST /compute/v2.1/flavors => generated 505 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:42.793244 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f16ddd47-fd58-4feb-87ed-6a6f0ccd5db4 tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:42.794457 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f16ddd47-fd58-4feb-87ed-6a6f0ccd5db4 tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:42.797912 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f16ddd47-fd58-4feb-87ed-6a6f0ccd5db4 tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:42.798315 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1da147e3-b1df-451f-8305-f83b789cb614 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:42.799808 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f16ddd47-fd58-4feb-87ed-6a6f0ccd5db4 tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:42.854772 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1da147e3-b1df-451f-8305-f83b789cb614 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/3dc40aff-0645-4726-a861-526760ddcb0f" status: 202 len: 0 microversion: 2.1 time: 0.071320 Jul 28 10:30:42.859394 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 122/207] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:30:42 2022] DELETE /compute/v2.1/flavors/3dc40aff-0645-4726-a861-526760ddcb0f => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:30:42.871268 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-72d344ba-c015-47f8-9aaa-21e66fea77c8 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:42.914251 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f16ddd47-fd58-4feb-87ed-6a6f0ccd5db4 tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/86d9d076e87b40998ebbf29f5100babc" status: 200 len: 240 microversion: 2.36 time: 2.201313 Jul 28 10:30:42.916090 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 86/208] 10.222.0.46 () {62 vars in 1303 bytes} [Thu Jul 28 10:30:40 2022] PUT /compute/v2.1/os-quota-sets/86d9d076e87b40998ebbf29f5100babc => generated 240 bytes in 2204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:30:42.932047 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-72d344ba-c015-47f8-9aaa-21e66fea77c8 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069470 Jul 28 10:30:42.941890 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 123/209] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:42.949997 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ef7a2fa4-e55a-4acd-92ff-18f55db71f16 tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] Calling method '.version_select at 0x7fa9580f4dc0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:42.956827 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-32dc1190-a48f-4476-b3d9-1e6b703d8f36 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-525334390", "id": "4eb53ba6-c11a-4ef8-80b8-01a0387faa91", "os-flavor-access:is_public": "True"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:42.964040 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=14,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:42.988392 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-32dc1190-a48f-4476-b3d9-1e6b703d8f36 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.035626 Jul 28 10:30:42.988970 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 124/210] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:42 2022] POST /compute/v2.1/flavors => generated 506 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:43.009939 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-cb3e6152-48a6-43e6-b1f3-7911f995bb26 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:43.042558 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-cb3e6152-48a6-43e6-b1f3-7911f995bb26 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/4eb53ba6-c11a-4ef8-80b8-01a0387faa91" status: 202 len: 0 microversion: 2.1 time: 0.038671 Jul 28 10:30:43.045825 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 125/211] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:30:43 2022] DELETE /compute/v2.1/flavors/4eb53ba6-c11a-4ef8-80b8-01a0387faa91 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:30:43.061377 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f1730c1f-66ac-44c1-b411-dfd50c9f7e6e tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:43.107558 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f1730c1f-66ac-44c1-b411-dfd50c9f7e6e tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055186 Jul 28 10:30:43.118213 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 126/212] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:43.152350 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1206a6bb-ecf9-4c7d-ba80-4da584e3041a tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1598904019", "id": 359949734, "os-flavor-access:is_public": "True"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:43.218831 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1206a6bb-ecf9-4c7d-ba80-4da584e3041a tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.078691 Jul 28 10:30:43.219913 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 127/213] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:43 2022] POST /compute/v2.1/flavors => generated 411 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:43.236718 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-442bc525-6f26-4fe0-9ab6-39f020bd3007 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:43.247865 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-442bc525-6f26-4fe0-9ab6-39f020bd3007 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/359949734" status: 200 len: 411 microversion: 2.1 time: 0.019280 Jul 28 10:30:43.248751 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 128/214] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Jul 28 10:30:43 2022] GET /compute/v2.1/flavors/359949734 => generated 411 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:43.927836 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9afb60c9-f009-4747-99f9-9bb0111f7271 tempest-FlavorsAdminTestJSON-139556164 tempest-FlavorsAdminTestJSON-139556164-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:43.983650 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9afb60c9-f009-4747-99f9-9bb0111f7271 tempest-FlavorsAdminTestJSON-139556164 tempest-FlavorsAdminTestJSON-139556164-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.715807 Jul 28 10:30:43.984274 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 129/215] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:43 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:44.001940 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ef7a2fa4-e55a-4acd-92ff-18f55db71f16 tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:44.002531 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ef7a2fa4-e55a-4acd-92ff-18f55db71f16 tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:44.003081 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ef7a2fa4-e55a-4acd-92ff-18f55db71f16 tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:44.003517 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ef7a2fa4-e55a-4acd-92ff-18f55db71f16 tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:44.004929 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-172c84d4-ca28-431b-908d-d4efef792016 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:44.033625 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-172c84d4-ca28-431b-908d-d4efef792016 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/359949734" status: 202 len: 0 microversion: 2.1 time: 0.032832 Jul 28 10:30:44.033879 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ef7a2fa4-e55a-4acd-92ff-18f55db71f16 tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/86d9d076e87b40998ebbf29f5100babc/detail" status: 200 len: 672 microversion: 2.36 time: 1.110545 Jul 28 10:30:44.039039 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 130/216] 10.222.0.46 () {58 vars in 1158 bytes} [Thu Jul 28 10:30:43 2022] DELETE /compute/v2.1/flavors/359949734 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:30:44.045094 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 87/217] 10.222.0.46 () {60 vars in 1304 bytes} [Thu Jul 28 10:30:42 2022] GET /compute/v2.1/os-quota-sets/86d9d076e87b40998ebbf29f5100babc/detail => generated 672 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:30:44.050270 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d1394e5d-0bdb-415e-abdf-b8a65df72883 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:44.098133 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-d1394e5d-0bdb-415e-abdf-b8a65df72883 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052192 Jul 28 10:30:44.114384 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 131/218] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:44.118098 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-da74433f-da76-4583-bb14-c9fe31ab42f6 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1802572811", "id": 347502619, "os-flavor-access:is_public": "False"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:44.123964 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:44.123964 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:44.163714 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-da74433f-da76-4583-bb14-c9fe31ab42f6 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.048661 Jul 28 10:30:44.169368 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 88/219] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:44 2022] POST /compute/v2.1/flavors => generated 427 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:30:44.185284 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6b8bbe21-b6c1-4f39-8386-5dc736b6d28f tempest-FlavorsAdminTestJSON-139556164 tempest-FlavorsAdminTestJSON-139556164-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "347502619"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:44.236496 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-6b8bbe21-b6c1-4f39-8386-5dc736b6d28f tempest-FlavorsAdminTestJSON-139556164 tempest-FlavorsAdminTestJSON-139556164-project] HTTP exception thrown: Flavor 347502619 could not be found. Jul 28 10:30:44.239029 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6b8bbe21-b6c1-4f39-8386-5dc736b6d28f tempest-FlavorsAdminTestJSON-139556164 tempest-FlavorsAdminTestJSON-139556164-project] Request method failure captured: Jul 28 10:30:44.239029 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 10:30:44.239029 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:44.239029 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:44.239029 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:44.239029 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 106 Jul 28 10:30:44.239029 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:44.239029 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:44.239029 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:44.239029 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:44.239029 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mVKuRjrSLlRtww7ZXxotnglodZLf6ZhrqXvFTbnD0IkNnTel-SFH_9MnZiq2yVfuDYMLunCTr4fQMGLlmFsIVZGB21a1DBcIaGk3nrkXeIYwjVZCSn4GhHOHww4ZA-f1uAXMakTOuWRWbWMVLi0e7k5QktsU80_YIP0E6y7MkzcZ3g Jul 28 10:30:44.239029 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:44.239029 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:44.239029 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:44.239029 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:44.239029 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:44.239029 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:44.239029 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 0562b1ebd97a4174a6c3aff590d423a8 Jul 28 10:30:44.239029 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-FlavorsAdminTestJSON-139556164 Jul 28 10:30:44.239029 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:30:44.239029 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:30:44.240351 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0562b1ebd97a4174a6c3aff590d423a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0562b1ebd97a4174a6c3aff590d423a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0562b1ebd97a4174a6c3aff590d423a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0562b1ebd97a4174a6c3aff590d423a8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:44.240351 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-FlavorsAdminTestJSON-139556164 Jul 28 10:30:44.240351 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 0562b1ebd97a4174a6c3aff590d423a8 Jul 28 10:30:44.240351 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-139556164 Jul 28 10:30:44.240351 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-FlavorsAdminTestJSON-139556164-project Jul 28 10:30:44.240351 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:44.240351 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:44.240351 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 93867868d95342d8bc81e0b8a31c0363 Jul 28 10:30:44.240351 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-FlavorsAdminTestJSON-139556164-project Jul 28 10:30:44.240351 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:30:44.240351 n-d-850468-6 devstack@n-api.service[119464]: {"server": {"name": "test", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "347502619"}} Jul 28 10:30:44.240351 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:44.240351 n-d-850468-6 devstack@n-api.service[119464]: exception: Flavor 347502619 could not be found. Jul 28 10:30:44.241179 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'eff4a889-87b7-4a4c-be7a-77433dc25faf', 'flavorRef': '347502619'}}} Jul 28 10:30:44.241179 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:44.241179 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:44.241179 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 28 10:30:44.241179 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 28 10:30:44.241179 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 10:30:44.241179 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 10:30:44.241179 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:30:44.241179 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:30:44.241179 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 10:30:44.241179 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 10:30:44.241179 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 10:30:44.241179 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:44.241179 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 10:30:44.241179 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 10:30:44.241179 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 347502619 could not be found. Jul 28 10:30:44.241179 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:44.241179 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:44.241179 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:44.241179 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:44.242562 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:44.242562 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:44.242562 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:44.242562 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:44.242562 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:44.242562 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:44.242562 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:44.242562 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:44.242562 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:44.242562 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:44.242562 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:44.242562 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:44.242562 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 10:30:44.242562 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 28 10:30:44.242562 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 28 10:30:44.242562 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 347502619 could not be found. Jul 28 10:30:44.242562 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:44.242562 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:44.242562 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:44.242562 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:44.242562 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:44.243742 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:44.243742 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:44.243742 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:44.243742 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 347502619 could not be found. Jul 28 10:30:44.243742 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:44.243742 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6b8bbe21-b6c1-4f39-8386-5dc736b6d28f tempest-FlavorsAdminTestJSON-139556164 tempest-FlavorsAdminTestJSON-139556164-project] Returning 400 to user: Flavor 347502619 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:44.243742 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-6b8bbe21-b6c1-4f39-8386-5dc736b6d28f tempest-FlavorsAdminTestJSON-139556164 tempest-FlavorsAdminTestJSON-139556164-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.065459 Jul 28 10:30:44.243742 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 132/220] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:44 2022] POST /compute/v2.1/servers => generated 80 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 10:30:44.250316 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a715d65c-9c87-4de8-a223-e440070d8a4b tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:44.251101 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:44.251101 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:44.291218 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a715d65c-9c87-4de8-a223-e440070d8a4b tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/347502619" status: 202 len: 0 microversion: 2.1 time: 0.044756 Jul 28 10:30:44.291907 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 89/221] 10.222.0.46 () {58 vars in 1158 bytes} [Thu Jul 28 10:30:44 2022] DELETE /compute/v2.1/flavors/347502619 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:30:44.300591 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e8d70646-d768-4a25-87aa-7ab3bdeffcd2 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:44.337021 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e8d70646-d768-4a25-87aa-7ab3bdeffcd2 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040059 Jul 28 10:30:44.352704 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 133/222] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:44.357103 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4d1ed09c-ef1d-4c69-9722-b7e2756607c2 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1789185537", "id": 44968030, "os-flavor-access:is_public": "False"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:44.386143 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-4d1ed09c-ef1d-4c69-9722-b7e2756607c2 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.032681 Jul 28 10:30:44.386931 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 90/223] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:44 2022] POST /compute/v2.1/flavors => generated 409 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:44.403415 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-37a81500-5f9b-456b-91e2-0177ec70e93c tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1671466316", "id": 988058364, "os-flavor-access:is_public": "True"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:44.436768 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-37a81500-5f9b-456b-91e2-0177ec70e93c tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.041787 Jul 28 10:30:44.452412 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2627d592-c48c-4fcf-869b-80b9046c2862 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:44.456089 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 134/224] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:44 2022] POST /compute/v2.1/flavors => generated 411 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:30:44.477245 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-2627d592-c48c-4fcf-869b-80b9046c2862 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 412 microversion: 2.1 time: 0.030153 Jul 28 10:30:44.478197 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 91/225] 10.222.0.46 () {58 vars in 1169 bytes} [Thu Jul 28 10:30:44 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 412 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:44.500118 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c847aa6b-c749-4055-90d9-b9d64745cdd7 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:44.521328 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c847aa6b-c749-4055-90d9-b9d64745cdd7 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 412 microversion: 2.1 time: 0.024853 Jul 28 10:30:44.525913 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 135/226] 10.222.0.46 () {58 vars in 1177 bytes} [Thu Jul 28 10:30:44 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 412 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:44.535925 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-9698300c-d173-4f27-9b3f-d7e044a17d64 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:44.561145 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-9698300c-d173-4f27-9b3f-d7e044a17d64 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 412 microversion: 2.1 time: 0.028666 Jul 28 10:30:44.562086 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 92/227] 10.222.0.46 () {58 vars in 1171 bytes} [Thu Jul 28 10:30:44 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 412 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:44.575534 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-38cfe405-ae75-4c3a-8bb9-45fa51e84a26 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:44.587816 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-38cfe405-ae75-4c3a-8bb9-45fa51e84a26 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 412 microversion: 2.1 time: 0.016047 Jul 28 10:30:44.588418 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 93/228] 10.222.0.46 () {58 vars in 1169 bytes} [Thu Jul 28 10:30:44 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 412 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:30:44.618615 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6710e85c-a20c-4dde-b3a4-45539641a1bb tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:44.668176 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6710e85c-a20c-4dde-b3a4-45539641a1bb tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.062425 Jul 28 10:30:44.669221 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 94/229] 10.222.0.46 () {58 vars in 1169 bytes} [Thu Jul 28 10:30:44 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:44.697671 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b667a941-0fa4-4575-8697-9fa97881b4af tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:44.762663 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b667a941-0fa4-4575-8697-9fa97881b4af tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.077381 Jul 28 10:30:44.763302 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 95/230] 10.222.0.46 () {58 vars in 1175 bytes} [Thu Jul 28 10:30:44 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:44.784090 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-fb8c9594-52f7-4455-9d43-25c67812a9bd tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:44.841444 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-fb8c9594-52f7-4455-9d43-25c67812a9bd tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.063202 Jul 28 10:30:44.842950 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 96/231] 10.222.0.46 () {58 vars in 1173 bytes} [Thu Jul 28 10:30:44 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:44.870726 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0ced6281-459e-4309-a353-27a1290b3197 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:44.920305 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-0ced6281-459e-4309-a353-27a1290b3197 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.057676 Jul 28 10:30:44.933952 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 97/232] 10.222.0.46 () {58 vars in 1169 bytes} [Thu Jul 28 10:30:44 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:44.946142 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6e8aa994-4337-444c-9bad-5d4edde049f7 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:44.998578 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6e8aa994-4337-444c-9bad-5d4edde049f7 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/988058364" status: 202 len: 0 microversion: 2.1 time: 0.062711 Jul 28 10:30:45.000941 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 98/233] 10.222.0.46 () {58 vars in 1158 bytes} [Thu Jul 28 10:30:44 2022] DELETE /compute/v2.1/flavors/988058364 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:30:45.012298 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c535392f-5b9f-4ea4-9233-6e80734cda79 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:45.039174 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c535392f-5b9f-4ea4-9233-6e80734cda79 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031656 Jul 28 10:30:45.053102 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 99/234] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:45.061189 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1eca82ce-aa21-46f7-a77d-25d3d404b664 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:45.090520 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-1eca82ce-aa21-46f7-a77d-25d3d404b664 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/44968030" status: 202 len: 0 microversion: 2.1 time: 0.034656 Jul 28 10:30:45.094134 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 100/235] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Jul 28 10:30:45 2022] DELETE /compute/v2.1/flavors/44968030 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:30:45.121670 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-920f7129-dcac-485f-9a83-a8c315fc73c8 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:45.166296 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-920f7129-dcac-485f-9a83-a8c315fc73c8 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070081 Jul 28 10:30:45.170666 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 101/236] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:30:45.191191 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ad7e4367-8d9e-42ba-8f70-6b3fcadaa55d tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1773729177", "id": 142834991, "os-flavor-access:is_public": "False"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:45.220551 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=9 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:45.224566 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ad7e4367-8d9e-42ba-8f70-6b3fcadaa55d tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.037200 Jul 28 10:30:45.233853 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 102/237] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:45 2022] POST /compute/v2.1/flavors => generated 412 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:45.242087 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1330d087-6399-4122-8fa7-9c9a7d677a2b tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:45.273380 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-1330d087-6399-4122-8fa7-9c9a7d677a2b tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037163 Jul 28 10:30:45.274372 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 103/238] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:45.314500 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-06e6314f-5bd1-471d-ba79-0d61270e37a2 tempest-FlavorsAdminTestJSON-139556164 tempest-FlavorsAdminTestJSON-139556164-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:45.347291 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-06e6314f-5bd1-471d-ba79-0d61270e37a2 tempest-FlavorsAdminTestJSON-139556164 tempest-FlavorsAdminTestJSON-139556164-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056566 Jul 28 10:30:45.348088 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 104/239] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:30:45.360428 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c1499441-d326-4a04-bf43-7f1400e363eb tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] Calling method '.version_select at 0x7fa94bf0e790>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:45.369710 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:45.369710 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:45.371236 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ed323d80-8fa5-404a-9e18-effb450a42f6 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:45.373612 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c1499441-d326-4a04-bf43-7f1400e363eb tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:45.375151 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c1499441-d326-4a04-bf43-7f1400e363eb tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:45.414651 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c1499441-d326-4a04-bf43-7f1400e363eb tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:45.415954 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c1499441-d326-4a04-bf43-7f1400e363eb tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:45.436464 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c1499441-d326-4a04-bf43-7f1400e363eb tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:45.437050 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c1499441-d326-4a04-bf43-7f1400e363eb tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:45.442270 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ed323d80-8fa5-404a-9e18-effb450a42f6 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/142834991" status: 202 len: 0 microversion: 2.1 time: 0.078766 Jul 28 10:30:45.443535 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 105/240] 10.222.0.46 () {58 vars in 1158 bytes} [Thu Jul 28 10:30:45 2022] DELETE /compute/v2.1/flavors/142834991 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:30:45.450437 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c1499441-d326-4a04-bf43-7f1400e363eb tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.906135 Jul 28 10:30:45.451336 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 136/241] 10.222.0.46 () {60 vars in 1208 bytes} [Thu Jul 28 10:30:44 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:30:45.454506 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0bded202-abf1-487b-a9cf-67fb5261164e tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] Action: 'update', calling method: .version_select at 0x7fa9595d8940>, body: {"quota_set": {"ram": "2048"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:45.455875 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8de719a9-a304-4c17-be21-4445b3e01c68 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:45.480264 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-8de719a9-a304-4c17-be21-4445b3e01c68 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027828 Jul 28 10:30:45.487753 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 137/242] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:45.506668 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d6514cf3-f49a-4259-99a2-98279c0088eb tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1882292122"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:45.518558 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:45.518558 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:45.532547 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.aggregate [None req-d6514cf3-f49a-4259-99a2-98279c0088eb tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] Generated uuid 20349cc6-9caf-491b-a9cd-63b875cb27b3 for aggregate {{(pid=119464) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 10:30:45.594659 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-d6514cf3-f49a-4259-99a2-98279c0088eb tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.103935 Jul 28 10:30:45.605551 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 138/243] 10.222.0.46 () {62 vars in 1205 bytes} [Thu Jul 28 10:30:45 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:30:45.613997 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e5268d36-e813-4c9c-86ce-828eee974cc6 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-870869640", "id": 838450135, "os-flavor-access:is_public": "True"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:45.619727 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:45.619727 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:45.663054 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e5268d36-e813-4c9c-86ce-828eee974cc6 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.055886 Jul 28 10:30:45.664298 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 139/244] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:45 2022] POST /compute/v2.1/flavors => generated 410 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:45.678676 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-42df9de5-c079-42a4-86e9-b22f79955cf0 tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1497996176"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:45.808871 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:45.808871 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:45.860780 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-42df9de5-c079-42a4-86e9-b22f79955cf0 tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-aggregates/18" status: 200 len: 300 microversion: 2.41 time: 0.194792 Jul 28 10:30:45.862908 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 140/245] 10.222.0.46 () {62 vars in 1213 bytes} [Thu Jul 28 10:30:45 2022] PUT /compute/v2.1/os-aggregates/18 => generated 300 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:30:45.875106 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1b4edc2c-ca8d-4960-a7e9-4f2052309bc2 tempest-FlavorsAdminTestJSON-139556164 tempest-FlavorsAdminTestJSON-139556164-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:45.923163 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1b4edc2c-ca8d-4960-a7e9-4f2052309bc2 tempest-FlavorsAdminTestJSON-139556164 tempest-FlavorsAdminTestJSON-139556164-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.058482 Jul 28 10:30:45.925197 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 141/246] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:45 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:45.940158 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8aef56ef-add3-44b6-8f0b-f5b04275bb6f tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:45.941402 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:45.941402 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:45.949594 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-8aef56ef-add3-44b6-8f0b-f5b04275bb6f tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/18" status: 200 len: 300 microversion: 2.41 time: 0.022358 Jul 28 10:30:45.957808 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 142/247] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jul 28 10:30:45 2022] GET /compute/v2.1/os-aggregates/18 => generated 300 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:30:45.963962 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-94ff7ea2-c725-48fd-827d-18d71069826e tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:45.964703 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:45.964703 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:45.994294 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-94ff7ea2-c725-48fd-827d-18d71069826e tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/838450135" status: 202 len: 0 microversion: 2.1 time: 0.035130 Jul 28 10:30:45.999494 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 143/248] 10.222.0.46 () {58 vars in 1158 bytes} [Thu Jul 28 10:30:45 2022] DELETE /compute/v2.1/flavors/838450135 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:30:46.006396 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-42f15514-2771-4d73-9816-81f810fdfe74 tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850468-6"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:46.010231 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:46.010231 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:46.021063 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-42f15514-2771-4d73-9816-81f810fdfe74 tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:46.021516 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-42f15514-2771-4d73-9816-81f810fdfe74 tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:46.204619 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-42f15514-2771-4d73-9816-81f810fdfe74 tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 315 microversion: 2.41 time: 0.203419 Jul 28 10:30:46.213498 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 144/249] 10.222.0.46 () {62 vars in 1235 bytes} [Thu Jul 28 10:30:45 2022] POST /compute/v2.1/os-aggregates/18/action => generated 315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:30:46.214142 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8df6d91d-15c9-4b77-88f8-72e2c1750df5 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:46.260368 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-8df6d91d-15c9-4b77-88f8-72e2c1750df5 tempest-FlavorsAdminTestJSON-256241415 tempest-FlavorsAdminTestJSON-256241415-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053967 Jul 28 10:30:46.260979 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 145/250] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:30:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:46.274447 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e21beed9-7b8e-4e32-8703-a8e24cc0df05 tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850468-6"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:46.283253 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:46.283253 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:46.302228 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e21beed9-7b8e-4e32-8703-a8e24cc0df05 tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:46.304096 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e21beed9-7b8e-4e32-8703-a8e24cc0df05 tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:46.584832 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e21beed9-7b8e-4e32-8703-a8e24cc0df05 tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 300 microversion: 2.41 time: 0.318859 Jul 28 10:30:46.590623 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 146/251] 10.222.0.46 () {62 vars in 1235 bytes} [Thu Jul 28 10:30:46 2022] POST /compute/v2.1/os-aggregates/18/action => generated 300 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:30:46.605789 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fe5636b5-88ec-4a60-b834-8f749948406f tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:46.608801 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:46.608801 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:46.652331 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-fe5636b5-88ec-4a60-b834-8f749948406f tempest-AggregatesAdminTestV241-159192139 tempest-AggregatesAdminTestV241-159192139-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.41 time: 0.054630 Jul 28 10:30:46.654058 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 147/252] 10.222.0.46 () {60 vars in 1196 bytes} [Thu Jul 28 10:30:46 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:30:46.715555 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0bded202-abf1-487b-a9cf-67fb5261164e tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:46.716037 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0bded202-abf1-487b-a9cf-67fb5261164e tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:46.720028 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0bded202-abf1-487b-a9cf-67fb5261164e tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:46.720524 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0bded202-abf1-487b-a9cf-67fb5261164e tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:46.865651 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0bded202-abf1-487b-a9cf-67fb5261164e tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:46.867366 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0bded202-abf1-487b-a9cf-67fb5261164e tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:46.868564 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0bded202-abf1-487b-a9cf-67fb5261164e tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:46.870557 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0bded202-abf1-487b-a9cf-67fb5261164e tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:47.044497 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-0bded202-abf1-487b-a9cf-67fb5261164e tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/86d9d076e87b40998ebbf29f5100babc?user_id=63933199471648d9a55cdd3d7613c08a" status: 200 len: 240 microversion: 2.36 time: 1.595085 Jul 28 10:30:47.054692 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 106/253] 10.222.0.46 () {62 vars in 1384 bytes} [Thu Jul 28 10:30:45 2022] PUT /compute/v2.1/os-quota-sets/86d9d076e87b40998ebbf29f5100babc?user_id=63933199471648d9a55cdd3d7613c08a => generated 240 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:30:47.062058 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e56eb0f6-095d-46aa-90d4-77327197858a tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] Calling method '.version_select at 0x7fa94bf0eee0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:48.441418 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e56eb0f6-095d-46aa-90d4-77327197858a tempest-QuotasAdminTestV236-1672671143 tempest-QuotasAdminTestV236-1672671143-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/86d9d076e87b40998ebbf29f5100babc?user_id=63933199471648d9a55cdd3d7613c08a" status: 200 len: 282 microversion: 2.36 time: 1.384405 Jul 28 10:30:48.445193 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 148/254] 10.222.0.46 () {60 vars in 1364 bytes} [Thu Jul 28 10:30:47 2022] GET /compute/v2.1/os-quota-sets/86d9d076e87b40998ebbf29f5100babc?user_id=63933199471648d9a55cdd3d7613c08a => generated 282 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:30:49.737634 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-107361703", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:49.919953 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] validate_networks() for None {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:30:50.430545 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:30:50.431042 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:30:50.431572 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:30:50.432035 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:30:50.432856 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:30:50.452585 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:50.453373 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:50.454359 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:50.454947 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:50.497433 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Getting quotas for project 852c30f1dc854287b1e8dc8a5a460f39. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:30:50.506070 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Getting quotas for user d87d4335997942b5a33744c9646fff59 and project 852c30f1dc854287b1e8dc8a5a460f39. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:30:50.532354 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:30:50.534826 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 26b9cefb-2360-4165-af02-01dd9d1581b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:30:50.644157 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-583d1083-7b0d-42c2-a15a-680a9cc41369 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.925987 Jul 28 10:30:50.652967 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 107/255] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:30:50.667637 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-58330630-7c5c-48b7-ba48-3c48c7e5d859 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:50.668683 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-58330630-7c5c-48b7-ba48-3c48c7e5d859 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 26b9cefb-2360-4165-af02-01dd9d1581b7] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:50.693548 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=12,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:50.860945 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-58330630-7c5c-48b7-ba48-3c48c7e5d859 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d4335997942b5a33744c9646fff59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852c30f1dc854287b1e8dc8a5a460f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:50.880019 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-58330630-7c5c-48b7-ba48-3c48c7e5d859 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] 10.222.0.46 "GET /compute/v2.1/servers/26b9cefb-2360-4165-af02-01dd9d1581b7" status: 200 len: 1212 microversion: 2.1 time: 0.219505 Jul 28 10:30:50.883481 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 149/256] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:30:50 2022] GET /compute/v2.1/servers/26b9cefb-2360-4165-af02-01dd9d1581b7 => generated 1212 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:51.905006 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-20674f1e-b570-4060-a8b5-89981085f3d0 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:51.905534 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-20674f1e-b570-4060-a8b5-89981085f3d0 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 26b9cefb-2360-4165-af02-01dd9d1581b7] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:51.922585 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-20674f1e-b570-4060-a8b5-89981085f3d0 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:51.922905 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-20674f1e-b570-4060-a8b5-89981085f3d0 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:51.932276 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-20674f1e-b570-4060-a8b5-89981085f3d0 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:51.937229 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-20674f1e-b570-4060-a8b5-89981085f3d0 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:52.046276 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-20674f1e-b570-4060-a8b5-89981085f3d0 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:52.048779 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-20674f1e-b570-4060-a8b5-89981085f3d0 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:52.049796 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-20674f1e-b570-4060-a8b5-89981085f3d0 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lazy-loading 'fault' on Instance uuid 26b9cefb-2360-4165-af02-01dd9d1581b7 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:30:52.056176 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:UPDATE=23,nova_cell0:DELETE=4,nova_cell0:SELECT=71,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:52.196243 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-20674f1e-b570-4060-a8b5-89981085f3d0 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d4335997942b5a33744c9646fff59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852c30f1dc854287b1e8dc8a5a460f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:52.213849 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-20674f1e-b570-4060-a8b5-89981085f3d0 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] 10.222.0.46 "GET /compute/v2.1/servers/26b9cefb-2360-4165-af02-01dd9d1581b7" status: 200 len: 1285 microversion: 2.1 time: 0.312942 Jul 28 10:30:52.228752 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 108/257] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:30:51 2022] GET /compute/v2.1/servers/26b9cefb-2360-4165-af02-01dd9d1581b7 => generated 1285 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:52.252337 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0215c988-84f6-4ff7-bd69-10c51bddb66b tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:52.252944 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0215c988-84f6-4ff7-bd69-10c51bddb66b tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 26b9cefb-2360-4165-af02-01dd9d1581b7] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:52.266397 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=49,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:30:52.269275 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0215c988-84f6-4ff7-bd69-10c51bddb66b tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:52.273658 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0215c988-84f6-4ff7-bd69-10c51bddb66b tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:52.275085 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0215c988-84f6-4ff7-bd69-10c51bddb66b tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:52.285077 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0215c988-84f6-4ff7-bd69-10c51bddb66b tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:52.362301 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0215c988-84f6-4ff7-bd69-10c51bddb66b tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 26b9cefb-2360-4165-af02-01dd9d1581b7] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:30:52.493045 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0215c988-84f6-4ff7-bd69-10c51bddb66b tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 26b9cefb-2360-4165-af02-01dd9d1581b7] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:30:52.496160 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0215c988-84f6-4ff7-bd69-10c51bddb66b tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:52.498815 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0215c988-84f6-4ff7-bd69-10c51bddb66b tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:52.500330 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-0215c988-84f6-4ff7-bd69-10c51bddb66b tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 26b9cefb-2360-4165-af02-01dd9d1581b7] instance's host None is down, deleting from database Jul 28 10:30:52.511432 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0215c988-84f6-4ff7-bd69-10c51bddb66b tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 26b9cefb-2360-4165-af02-01dd9d1581b7] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:30:52.765363 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0215c988-84f6-4ff7-bd69-10c51bddb66b tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 26b9cefb-2360-4165-af02-01dd9d1581b7] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:30:52.778220 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0215c988-84f6-4ff7-bd69-10c51bddb66b tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 26b9cefb-2360-4165-af02-01dd9d1581b7] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:30:53.252052 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e2bdb4a0-102c-4452-8809-a2c60b96f7ee tempest-FlavorsV2NegativeTest-738808472 tempest-FlavorsV2NegativeTest-738808472-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:53.273401 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e2bdb4a0-102c-4452-8809-a2c60b96f7ee tempest-FlavorsV2NegativeTest-738808472 tempest-FlavorsV2NegativeTest-738808472-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.564160 Jul 28 10:30:53.275744 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 109/258] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 10:30:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:30:53.305840 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0215c988-84f6-4ff7-bd69-10c51bddb66b tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] 10.222.0.46 "DELETE /compute/v2.1/servers/26b9cefb-2360-4165-af02-01dd9d1581b7" status: 204 len: 0 microversion: 2.1 time: 1.056992 Jul 28 10:30:53.311559 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 150/259] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:30:52 2022] DELETE /compute/v2.1/servers/26b9cefb-2360-4165-af02-01dd9d1581b7 => generated 0 bytes in 1060 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:30:53.330832 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b8c303bd-7942-4ce0-a795-6d43478780d7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:53.337693 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b8c303bd-7942-4ce0-a795-6d43478780d7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 26b9cefb-2360-4165-af02-01dd9d1581b7] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:53.369647 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b8c303bd-7942-4ce0-a795-6d43478780d7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:53.373886 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b8c303bd-7942-4ce0-a795-6d43478780d7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:53.381927 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b8c303bd-7942-4ce0-a795-6d43478780d7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:53.382617 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b8c303bd-7942-4ce0-a795-6d43478780d7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:53.436963 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-b8c303bd-7942-4ce0-a795-6d43478780d7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] HTTP exception thrown: Instance 26b9cefb-2360-4165-af02-01dd9d1581b7 could not be found. Jul 28 10:30:53.440086 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b8c303bd-7942-4ce0-a795-6d43478780d7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Request method failure captured: Jul 28 10:30:53.440086 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/26b9cefb-2360-4165-af02-01dd9d1581b7 HTTP/1.1 Jul 28 10:30:53.440086 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:53.440086 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:53.440086 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:53.440086 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:30:53.440086 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:53.440086 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:53.440086 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:53.440086 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:53.440086 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mVTrH4hB5E1RbkAVtiWcD14vvSNRaEBe0gKyixhm6CM4_wpR3cmK2sfBSpX4Lz5rR4V58R-eVg2CyS08wrLDjWajuJ2c-2BD5a3fHcXuG1bP-i4MWVQ3bf5y3hQ4cfqM1rtov1-oSh3QfFvSYZlk3mYbtPv1XBNTxxXP_IMVZf19fY Jul 28 10:30:53.440086 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:53.440086 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:53.440086 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:53.440086 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:53.440086 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:53.440086 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:53.440086 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 852c30f1dc854287b1e8dc8a5a460f39 Jul 28 10:30:53.440086 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-MigrationsAdminTest-230078319 Jul 28 10:30:53.440086 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:30:53.440086 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:30:53.441457 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/852c30f1dc854287b1e8dc8a5a460f39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/852c30f1dc854287b1e8dc8a5a460f39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/852c30f1dc854287b1e8dc8a5a460f39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_852c30f1dc854287b1e8dc8a5a460f39", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:53.441457 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-MigrationsAdminTest-230078319 Jul 28 10:30:53.441457 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 852c30f1dc854287b1e8dc8a5a460f39 Jul 28 10:30:53.441457 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-MigrationsAdminTest-230078319 Jul 28 10:30:53.441457 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-MigrationsAdminTest-230078319-project Jul 28 10:30:53.441457 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:53.441457 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:53.441457 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: d87d4335997942b5a33744c9646fff59 Jul 28 10:30:53.441457 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-MigrationsAdminTest-230078319-project Jul 28 10:30:53.441457 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:53.441457 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 26b9cefb-2360-4165-af02-01dd9d1581b7 could not be found. Jul 28 10:30:53.441457 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '26b9cefb-2360-4165-af02-01dd9d1581b7'} Jul 28 10:30:53.442250 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:53.442250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:53.442250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:30:53.442250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:30:53.442250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:30:53.442250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:30:53.442250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:30:53.442250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:30:53.442250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:30:53.442250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:30:53.442250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26b9cefb-2360-4165-af02-01dd9d1581b7 could not be found. Jul 28 10:30:53.442250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:53.442250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:53.442250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:53.442250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:53.442250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:53.442250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:53.442250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:53.442250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:53.442250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:53.445725 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:53.445725 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:30:53.445725 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:30:53.445725 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:30:53.445725 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:30:53.445725 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:30:53.445725 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:30:53.445725 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26b9cefb-2360-4165-af02-01dd9d1581b7 could not be found. Jul 28 10:30:53.445725 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:53.445725 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:53.445725 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:53.445725 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:53.445725 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:53.445725 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:53.445725 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:53.445725 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:53.445725 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26b9cefb-2360-4165-af02-01dd9d1581b7 could not be found. Jul 28 10:30:53.445725 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:53.446810 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b8c303bd-7942-4ce0-a795-6d43478780d7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Returning 404 to user: Instance 26b9cefb-2360-4165-af02-01dd9d1581b7 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:53.446810 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b8c303bd-7942-4ce0-a795-6d43478780d7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] 10.222.0.46 "GET /compute/v2.1/servers/26b9cefb-2360-4165-af02-01dd9d1581b7" status: 404 len: 111 microversion: 2.1 time: 0.128522 Jul 28 10:30:53.459459 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 151/260] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:30:53 2022] GET /compute/v2.1/servers/26b9cefb-2360-4165-af02-01dd9d1581b7 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:30:54.320436 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-9c2ee431-0eb2-49bc-b143-0f1f37197916 tempest-InstanceUsageAuditLogTestJSON-273007382 tempest-InstanceUsageAuditLogTestJSON-273007382-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:54.324554 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:54.324554 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:54.386121 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-9c2ee431-0eb2-49bc-b143-0f1f37197916 tempest-InstanceUsageAuditLogTestJSON-273007382 tempest-InstanceUsageAuditLogTestJSON-273007382-project-admin] 10.222.0.46 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-28 10:30:52" status: 200 len: 318 microversion: 2.1 time: 1.107818 Jul 28 10:30:54.389192 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 110/261] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Jul 28 10:30:53 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-28%2010%3A30%3A52 => generated 318 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:54.405848 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c2afb025-e88a-4c99-b083-18d387939b8d tempest-InstanceUsageAuditLogTestJSON-273007382 tempest-InstanceUsageAuditLogTestJSON-273007382-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:54.406953 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:54.406953 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:54.448303 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c2afb025-e88a-4c99-b083-18d387939b8d tempest-InstanceUsageAuditLogTestJSON-273007382 tempest-InstanceUsageAuditLogTestJSON-273007382-project-admin] 10.222.0.46 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.046113 Jul 28 10:30:54.449687 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 111/262] 10.222.0.46 () {58 vars in 1185 bytes} [Thu Jul 28 10:30:54 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:54.491812 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-cd2ed011-d848-447e-a134-a1c88c702d60 tempest-MigrationsAdminTest-61543356 tempest-MigrationsAdminTest-61543356-project-admin] Calling method '.version_select at 0x7fa94bfb3c10>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:54.499550 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cd2ed011-d848-447e-a134-a1c88c702d60 tempest-MigrationsAdminTest-61543356 tempest-MigrationsAdminTest-61543356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:54.502129 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cd2ed011-d848-447e-a134-a1c88c702d60 tempest-MigrationsAdminTest-61543356 tempest-MigrationsAdminTest-61543356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:54.567696 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-cd2ed011-d848-447e-a134-a1c88c702d60 tempest-MigrationsAdminTest-61543356 tempest-MigrationsAdminTest-61543356-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 18 microversion: 2.1 time: 1.096131 Jul 28 10:30:54.582386 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 152/263] 10.222.0.46 () {58 vars in 1143 bytes} [Thu Jul 28 10:30:53 2022] GET /compute/v2.1/os-migrations => generated 18 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:30:55.094814 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-11918670", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:55.971598 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] validate_networks() for None {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:30:56.386093 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-851100c0-5883-4267-81b2-cae8f33638d6 tempest-FlavorsV2NegativeTest-738808472 tempest-FlavorsV2NegativeTest-738808472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-533339332", "imageRef": "bddf0b22-cf1a-47b3-8297-7866f6a7420b", "flavorRef": "452"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:56.523827 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-851100c0-5883-4267-81b2-cae8f33638d6 tempest-FlavorsV2NegativeTest-738808472 tempest-FlavorsV2NegativeTest-738808472-project] validate_networks() for None {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:30:56.849329 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:30:56.850122 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:30:56.850672 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:30:56.851137 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:30:56.851546 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:30:56.901738 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:56.902230 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:56.903107 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:56.912102 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:56.973508 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Getting quotas for project 852c30f1dc854287b1e8dc8a5a460f39. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:30:56.985136 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Getting quotas for user d87d4335997942b5a33744c9646fff59 and project 852c30f1dc854287b1e8dc8a5a460f39. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:30:57.020698 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:30:57.028473 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 4b1fa2e7-cc0e-41c1-a6d5-712cfa045003] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:30:57.095019 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-851100c0-5883-4267-81b2-cae8f33638d6 tempest-FlavorsV2NegativeTest-738808472 tempest-FlavorsV2NegativeTest-738808472-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 28 10:30:57.097172 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-851100c0-5883-4267-81b2-cae8f33638d6 tempest-FlavorsV2NegativeTest-738808472 tempest-FlavorsV2NegativeTest-738808472-project] Request method failure captured: Jul 28 10:30:57.097172 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 10:30:57.097172 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:57.097172 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:57.097172 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:57.097172 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 142 Jul 28 10:30:57.097172 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:57.097172 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:57.097172 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:57.097172 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:57.097172 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mVcytLPObRRzosYeX7e2iejaKyDdez0yTyqU9JrscFMCCeDc_1a-GbidG28HNnZNqlLVWrpS3psNW6fDK8fr-GZG8rLJZUpTyFpTkhl8UNnlSJVCJ9wwfyjPlLM3QygMzu8WKRZ_gPMEAWNSsQfNEYBZaLK-44Ot3mm6cyw3SsNSj0 Jul 28 10:30:57.097172 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:57.097172 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:57.097172 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:57.097172 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:57.097172 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:57.097172 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:57.097172 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 1eb9d243849948249e2d4af15d61c8d2 Jul 28 10:30:57.097172 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-FlavorsV2NegativeTest-738808472 Jul 28 10:30:57.097172 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:30:57.097172 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:30:57.098651 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1eb9d243849948249e2d4af15d61c8d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1eb9d243849948249e2d4af15d61c8d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1eb9d243849948249e2d4af15d61c8d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1eb9d243849948249e2d4af15d61c8d2", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:57.098651 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-FlavorsV2NegativeTest-738808472 Jul 28 10:30:57.098651 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 1eb9d243849948249e2d4af15d61c8d2 Jul 28 10:30:57.098651 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-738808472 Jul 28 10:30:57.098651 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-FlavorsV2NegativeTest-738808472-project Jul 28 10:30:57.098651 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:57.098651 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:57.098651 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 8bc2ba5299cd45faa33d31d026165538 Jul 28 10:30:57.098651 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-FlavorsV2NegativeTest-738808472-project Jul 28 10:30:57.098651 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:30:57.098651 n-d-850468-6 devstack@n-api.service[119464]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-533339332", "imageRef": "bddf0b22-cf1a-47b3-8297-7866f6a7420b", "flavorRef": "452"}} Jul 28 10:30:57.098651 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:57.098651 n-d-850468-6 devstack@n-api.service[119464]: exception: Flavor's memory is too small for requested image. Jul 28 10:30:57.099493 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-533339332', 'imageRef': 'bddf0b22-cf1a-47b3-8297-7866f6a7420b', 'flavorRef': '452'}}} Jul 28 10:30:57.099493 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:57.099493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:57.099493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 28 10:30:57.099493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 28 10:30:57.099493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2152, in create Jul 28 10:30:57.099493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 28 10:30:57.099493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1670, in _create_instance Jul 28 10:30:57.099493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 28 10:30:57.099493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1008, in _checks_for_create_and_rebuild Jul 28 10:30:57.099493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 28 10:30:57.099493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 672, in _validate_flavor_image Jul 28 10:30:57.099493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 28 10:30:57.099493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 740, in _validate_flavor_image_nostatus Jul 28 10:30:57.099493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 28 10:30:57.099493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 28 10:30:57.099493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:57.099493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:57.099493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:57.101167 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:57.101167 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:57.101167 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:57.101167 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:57.101167 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:57.101167 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:57.101167 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:57.101167 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:57.101167 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:57.101167 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:57.101167 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:57.101167 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:30:57.101167 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:30:57.101167 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 10:30:57.101167 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 28 10:30:57.101167 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 28 10:30:57.101167 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 28 10:30:57.101167 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:57.101167 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:57.101167 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:57.101167 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:57.102363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:57.102363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:57.102363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:57.102363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:57.102363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 28 10:30:57.102363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:57.102363 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-851100c0-5883-4267-81b2-cae8f33638d6 tempest-FlavorsV2NegativeTest-738808472 tempest-FlavorsV2NegativeTest-738808472-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:57.102363 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-851100c0-5883-4267-81b2-cae8f33638d6 tempest-FlavorsV2NegativeTest-738808472 tempest-FlavorsV2NegativeTest-738808472-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.718139 Jul 28 10:30:57.102363 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 153/264] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:56 2022] POST /compute/v2.1/servers => generated 93 bytes in 719 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 10:30:57.127432 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e3671a6a-baf9-4a1f-8d35-6e3a51c2dd87 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.032690 Jul 28 10:30:57.136822 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 112/265] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:30:57.144392 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c0ff7788-f6bd-4620-b6df-17f5c1492e1e tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:57.145060 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c0ff7788-f6bd-4620-b6df-17f5c1492e1e tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 4b1fa2e7-cc0e-41c1-a6d5-712cfa045003] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:57.252634 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-c0ff7788-f6bd-4620-b6df-17f5c1492e1e tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d4335997942b5a33744c9646fff59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852c30f1dc854287b1e8dc8a5a460f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:57.263880 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c0ff7788-f6bd-4620-b6df-17f5c1492e1e tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] 10.222.0.46 "GET /compute/v2.1/servers/4b1fa2e7-cc0e-41c1-a6d5-712cfa045003" status: 200 len: 1211 microversion: 2.1 time: 0.128010 Jul 28 10:30:57.272694 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 154/266] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:30:57 2022] GET /compute/v2.1/servers/4b1fa2e7-cc0e-41c1-a6d5-712cfa045003 => generated 1211 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:58.289901 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-12541f29-bcb2-456e-800a-1216c52fc80f tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:58.291617 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-12541f29-bcb2-456e-800a-1216c52fc80f tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 4b1fa2e7-cc0e-41c1-a6d5-712cfa045003] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:58.306971 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-12541f29-bcb2-456e-800a-1216c52fc80f tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:58.307864 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-12541f29-bcb2-456e-800a-1216c52fc80f tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:58.309231 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-12541f29-bcb2-456e-800a-1216c52fc80f tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:58.313537 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-12541f29-bcb2-456e-800a-1216c52fc80f tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:58.378553 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-12541f29-bcb2-456e-800a-1216c52fc80f tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:58.380011 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-12541f29-bcb2-456e-800a-1216c52fc80f tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:58.382344 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-12541f29-bcb2-456e-800a-1216c52fc80f tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lazy-loading 'fault' on Instance uuid 4b1fa2e7-cc0e-41c1-a6d5-712cfa045003 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:30:58.448343 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-12541f29-bcb2-456e-800a-1216c52fc80f tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d4335997942b5a33744c9646fff59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852c30f1dc854287b1e8dc8a5a460f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:30:58.471804 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-12541f29-bcb2-456e-800a-1216c52fc80f tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] 10.222.0.46 "GET /compute/v2.1/servers/4b1fa2e7-cc0e-41c1-a6d5-712cfa045003" status: 200 len: 1284 microversion: 2.1 time: 0.187724 Jul 28 10:30:58.473579 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 155/267] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:30:58 2022] GET /compute/v2.1/servers/4b1fa2e7-cc0e-41c1-a6d5-712cfa045003 => generated 1284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:30:58.484013 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b2cd8175-f986-4930-adbf-10d08852df4d tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:58.499015 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f32f73ee-d0af-46d4-80e9-37b808449c57 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:58.500222 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-f32f73ee-d0af-46d4-80e9-37b808449c57 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 4b1fa2e7-cc0e-41c1-a6d5-712cfa045003] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:58.502086 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b2cd8175-f986-4930-adbf-10d08852df4d tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.840170 Jul 28 10:30:58.511277 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 113/268] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 10:30:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:58.514443 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f32f73ee-d0af-46d4-80e9-37b808449c57 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:58.515715 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f32f73ee-d0af-46d4-80e9-37b808449c57 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:58.516558 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f32f73ee-d0af-46d4-80e9-37b808449c57 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:58.517321 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f32f73ee-d0af-46d4-80e9-37b808449c57 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:58.555197 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-f32f73ee-d0af-46d4-80e9-37b808449c57 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 4b1fa2e7-cc0e-41c1-a6d5-712cfa045003] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:30:58.649260 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-f32f73ee-d0af-46d4-80e9-37b808449c57 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 4b1fa2e7-cc0e-41c1-a6d5-712cfa045003] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:30:58.650856 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f32f73ee-d0af-46d4-80e9-37b808449c57 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:58.651321 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f32f73ee-d0af-46d4-80e9-37b808449c57 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:58.651771 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-f32f73ee-d0af-46d4-80e9-37b808449c57 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 4b1fa2e7-cc0e-41c1-a6d5-712cfa045003] instance's host None is down, deleting from database Jul 28 10:30:58.656893 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-f32f73ee-d0af-46d4-80e9-37b808449c57 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 4b1fa2e7-cc0e-41c1-a6d5-712cfa045003] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:30:58.720015 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-f32f73ee-d0af-46d4-80e9-37b808449c57 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 4b1fa2e7-cc0e-41c1-a6d5-712cfa045003] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:30:58.732530 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-f32f73ee-d0af-46d4-80e9-37b808449c57 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 4b1fa2e7-cc0e-41c1-a6d5-712cfa045003] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:30:59.044159 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f32f73ee-d0af-46d4-80e9-37b808449c57 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4b1fa2e7-cc0e-41c1-a6d5-712cfa045003" status: 204 len: 0 microversion: 2.1 time: 0.546284 Jul 28 10:30:59.051621 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 156/269] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:30:58 2022] DELETE /compute/v2.1/servers/4b1fa2e7-cc0e-41c1-a6d5-712cfa045003 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 10:30:59.067641 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5d109e75-9f3d-402a-96d7-d723d97c3ba2 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:59.069558 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5d109e75-9f3d-402a-96d7-d723d97c3ba2 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 4b1fa2e7-cc0e-41c1-a6d5-712cfa045003] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:30:59.088994 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5d109e75-9f3d-402a-96d7-d723d97c3ba2 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:59.089472 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5d109e75-9f3d-402a-96d7-d723d97c3ba2 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:59.103710 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5d109e75-9f3d-402a-96d7-d723d97c3ba2 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:30:59.104195 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5d109e75-9f3d-402a-96d7-d723d97c3ba2 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:30:59.139633 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-5d109e75-9f3d-402a-96d7-d723d97c3ba2 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] HTTP exception thrown: Instance 4b1fa2e7-cc0e-41c1-a6d5-712cfa045003 could not be found. Jul 28 10:30:59.141487 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5d109e75-9f3d-402a-96d7-d723d97c3ba2 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Request method failure captured: Jul 28 10:30:59.141487 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/4b1fa2e7-cc0e-41c1-a6d5-712cfa045003 HTTP/1.1 Jul 28 10:30:59.141487 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:30:59.141487 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:30:59.141487 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:30:59.141487 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:30:59.141487 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:30:59.141487 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:30:59.141487 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:30:59.141487 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:30:59.141487 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mVTrH4hB5E1RbkAVtiWcD14vvSNRaEBe0gKyixhm6CM4_wpR3cmK2sfBSpX4Lz5rR4V58R-eVg2CyS08wrLDjWajuJ2c-2BD5a3fHcXuG1bP-i4MWVQ3bf5y3hQ4cfqM1rtov1-oSh3QfFvSYZlk3mYbtPv1XBNTxxXP_IMVZf19fY Jul 28 10:30:59.141487 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:30:59.141487 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:30:59.141487 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:30:59.141487 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:30:59.141487 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:30:59.141487 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:30:59.141487 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 852c30f1dc854287b1e8dc8a5a460f39 Jul 28 10:30:59.141487 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-MigrationsAdminTest-230078319 Jul 28 10:30:59.141487 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:30:59.141487 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:30:59.142738 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/852c30f1dc854287b1e8dc8a5a460f39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/852c30f1dc854287b1e8dc8a5a460f39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/852c30f1dc854287b1e8dc8a5a460f39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_852c30f1dc854287b1e8dc8a5a460f39", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:30:59.142738 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-MigrationsAdminTest-230078319 Jul 28 10:30:59.142738 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 852c30f1dc854287b1e8dc8a5a460f39 Jul 28 10:30:59.142738 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-MigrationsAdminTest-230078319 Jul 28 10:30:59.142738 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-MigrationsAdminTest-230078319-project Jul 28 10:30:59.142738 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:30:59.142738 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:30:59.142738 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: d87d4335997942b5a33744c9646fff59 Jul 28 10:30:59.142738 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-MigrationsAdminTest-230078319-project Jul 28 10:30:59.142738 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:30:59.142738 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 4b1fa2e7-cc0e-41c1-a6d5-712cfa045003 could not be found. Jul 28 10:30:59.142738 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '4b1fa2e7-cc0e-41c1-a6d5-712cfa045003'} Jul 28 10:30:59.143400 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:30:59.143400 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:59.143400 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:30:59.143400 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:30:59.143400 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:30:59.143400 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:30:59.143400 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:30:59.143400 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:30:59.143400 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:30:59.143400 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:30:59.143400 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b1fa2e7-cc0e-41c1-a6d5-712cfa045003 could not be found. Jul 28 10:30:59.143400 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:59.143400 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:59.143400 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:59.143400 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:59.143400 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:59.143400 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:59.143400 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:30:59.143400 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:30:59.143400 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:30:59.144445 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:30:59.144445 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:30:59.144445 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:30:59.144445 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:30:59.144445 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:30:59.144445 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:30:59.144445 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:30:59.144445 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b1fa2e7-cc0e-41c1-a6d5-712cfa045003 could not be found. Jul 28 10:30:59.144445 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:59.144445 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:30:59.144445 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:59.144445 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:30:59.144445 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:30:59.144445 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:30:59.144445 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:30:59.144445 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:30:59.144445 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b1fa2e7-cc0e-41c1-a6d5-712cfa045003 could not be found. Jul 28 10:30:59.144445 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:30:59.145836 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5d109e75-9f3d-402a-96d7-d723d97c3ba2 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Returning 404 to user: Instance 4b1fa2e7-cc0e-41c1-a6d5-712cfa045003 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:30:59.147403 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-5d109e75-9f3d-402a-96d7-d723d97c3ba2 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] 10.222.0.46 "GET /compute/v2.1/servers/4b1fa2e7-cc0e-41c1-a6d5-712cfa045003" status: 404 len: 111 microversion: 2.1 time: 0.092617 Jul 28 10:30:59.154755 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 157/270] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:30:59 2022] GET /compute/v2.1/servers/4b1fa2e7-cc0e-41c1-a6d5-712cfa045003 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:30:59.161186 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-14822970-d978-4887-805c-fe11f19d198c tempest-MigrationsAdminTest-61543356 tempest-MigrationsAdminTest-61543356-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:59.172837 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-14822970-d978-4887-805c-fe11f19d198c tempest-MigrationsAdminTest-61543356 tempest-MigrationsAdminTest-61543356-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015914 Jul 28 10:30:59.181316 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 158/271] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 10:30:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:30:59.188846 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-80f97a6b-7239-487b-aee2-5107250d26b1 tempest-MigrationsAdminTest-61543356 tempest-MigrationsAdminTest-61543356-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-653375848", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:59.192937 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:59.192937 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:30:59.258589 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-80f97a6b-7239-487b-aee2-5107250d26b1 tempest-MigrationsAdminTest-61543356 tempest-MigrationsAdminTest-61543356-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.075438 Jul 28 10:30:59.266716 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 159/272] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jul 28 10:30:59 2022] POST /compute/v2.1/flavors => generated 498 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:59.312887 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-56626e83-6d55-40d6-8592-913dd4c208f7 tempest-MigrationsAdminTest-61543356 tempest-MigrationsAdminTest-61543356-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:59.342573 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-56626e83-6d55-40d6-8592-913dd4c208f7 tempest-MigrationsAdminTest-61543356 tempest-MigrationsAdminTest-61543356-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.073917 Jul 28 10:30:59.343514 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 160/273] 10.222.0.46 () {58 vars in 1182 bytes} [Thu Jul 28 10:30:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:30:59.451613 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-86c94803-b2c8-494a-969e-c970638caf23 tempest-ServersWithSpecificFlavorTestJSON-1475453240 tempest-ServersWithSpecificFlavorTestJSON-1475453240-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-11553661", "id": 1046165180, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:59.455250 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:59.455250 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:30:59.489405 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-86c94803-b2c8-494a-969e-c970638caf23 tempest-ServersWithSpecificFlavorTestJSON-1475453240 tempest-ServersWithSpecificFlavorTestJSON-1475453240-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 423 microversion: 2.1 time: 0.976018 Jul 28 10:30:59.505634 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9df071e5-4839-4c1c-9a5a-cb84e329099e tempest-ServersWithSpecificFlavorTestJSON-1475453240 tempest-ServersWithSpecificFlavorTestJSON-1475453240-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:59.510392 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 114/274] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:58 2022] POST /compute/v2.1/flavors => generated 423 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:59.526095 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9df071e5-4839-4c1c-9a5a-cb84e329099e tempest-ServersWithSpecificFlavorTestJSON-1475453240 tempest-ServersWithSpecificFlavorTestJSON-1475453240-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024474 Jul 28 10:30:59.529578 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 161/275] 10.222.0.46 () {58 vars in 1182 bytes} [Thu Jul 28 10:30:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:30:59.544828 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-21b6d059-69d5-4fa9-8c08-29842dec0421 tempest-ServersWithSpecificFlavorTestJSON-1475453240 tempest-ServersWithSpecificFlavorTestJSON-1475453240-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-768267986", "id": 1799137820, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:59.595456 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-21b6d059-69d5-4fa9-8c08-29842dec0421 tempest-ServersWithSpecificFlavorTestJSON-1475453240 tempest-ServersWithSpecificFlavorTestJSON-1475453240-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.054389 Jul 28 10:30:59.598470 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 115/276] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:59 2022] POST /compute/v2.1/flavors => generated 424 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:59.612162 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f176b1c0-d59c-4780-8bf9-dec908adf880 tempest-ServersWithSpecificFlavorTestJSON-1475453240 tempest-ServersWithSpecificFlavorTestJSON-1475453240-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:59.632606 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f176b1c0-d59c-4780-8bf9-dec908adf880 tempest-ServersWithSpecificFlavorTestJSON-1475453240 tempest-ServersWithSpecificFlavorTestJSON-1475453240-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.027148 Jul 28 10:30:59.647910 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 162/277] 10.222.0.46 () {58 vars in 1182 bytes} [Thu Jul 28 10:30:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:30:59.652193 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e9bb3c79-4343-49f0-bb5d-174971f34ed2 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Action: 'create', calling method: .version_select at 0x7fa95808d8b0>, body: {"keypair": {"name": "tempest-keypair-1084944464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzwb+VFaRScWea0aQbMSdqm2CKRzeExjbpWClEQystHfunc9GBX6X8SXlwPi+tw/wrpSl0sB6MjhhjgTjtTlOUBoM5kJjZwRO5p8TSjUNeRDRYWbgC9LeWqqQiCLUuNZg=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:59.689354 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-e9bb3c79-4343-49f0-bb5d-174971f34ed2 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Getting quotas for project 893fb430d96f4a5187573a7e18237769. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:30:59.694852 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-e9bb3c79-4343-49f0-bb5d-174971f34ed2 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Getting quotas for user 2066ac4e76944d949ded86bdb1fd0cd6 and project 893fb430d96f4a5187573a7e18237769. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:30:59.745093 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e9bb3c79-4343-49f0-bb5d-174971f34ed2 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.094521 Jul 28 10:30:59.746124 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 116/278] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:30:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:59.941845 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-389245075", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "009a6d23-586d-4fbe-b0e7-665a73718d15"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:00.045769 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] validate_networks() for None {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:31:00.758264 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:31:00.759840 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:31:00.762151 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:31:00.763659 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:31:00.764328 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:31:00.789294 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:00.790360 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:00.792185 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:00.793535 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:00.844827 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=62,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:00.905980 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Getting quotas for project 852c30f1dc854287b1e8dc8a5a460f39. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:31:00.932902 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Getting quotas for user d87d4335997942b5a33744c9646fff59 and project 852c30f1dc854287b1e8dc8a5a460f39. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:31:00.959209 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:31:00.963466 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 157b4178-3ed8-49b1-b641-7a33281a68e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:31:01.103994 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9d697a99-3664-48df-98aa-19059af59cc7 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.166872 Jul 28 10:31:01.113114 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 163/279] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:30:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:31:01.130194 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0fe26d23-ee9b-4200-b1d8-66a6cab0e2e9 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:01.130913 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0fe26d23-ee9b-4200-b1d8-66a6cab0e2e9 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 157b4178-3ed8-49b1-b641-7a33281a68e7] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:31:01.320357 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-0fe26d23-ee9b-4200-b1d8-66a6cab0e2e9 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d4335997942b5a33744c9646fff59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852c30f1dc854287b1e8dc8a5a460f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:01.348879 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0fe26d23-ee9b-4200-b1d8-66a6cab0e2e9 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] 10.222.0.46 "GET /compute/v2.1/servers/157b4178-3ed8-49b1-b641-7a33281a68e7" status: 200 len: 1278 microversion: 2.1 time: 0.230921 Jul 28 10:31:01.352355 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 164/280] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:31:01 2022] GET /compute/v2.1/servers/157b4178-3ed8-49b1-b641-7a33281a68e7 => generated 1278 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:31:01.665213 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c0cad288-ecea-4a81-afc7-49d5d080ae6f tempest-FlavorMetadataValidation-1551066003 tempest-FlavorMetadataValidation-1551066003-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-750730919", "id": 1087216676, "os-flavor-access:is_public": "True"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:01.734067 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c0cad288-ecea-4a81-afc7-49d5d080ae6f tempest-FlavorMetadataValidation-1551066003 tempest-FlavorMetadataValidation-1551066003-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 1.532432 Jul 28 10:31:01.749099 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 117/281] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Jul 28 10:31:00 2022] POST /compute/v2.1/flavors => generated 470 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:31:01.757169 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9e6126da-d2a1-4159-af43-f5094a734562 tempest-FlavorMetadataValidation-1551066003 tempest-FlavorMetadataValidation-1551066003-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:01.761960 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:01.761960 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:31:02.180531 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9e6126da-d2a1-4159-af43-f5094a734562 tempest-FlavorMetadataValidation-1551066003 tempest-FlavorMetadataValidation-1551066003-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1087216676/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.428441 Jul 28 10:31:02.188006 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 165/282] 10.222.0.46 () {62 vars in 1265 bytes} [Thu Jul 28 10:31:01 2022] POST /compute/v2.1/flavors/1087216676/os-extra_specs => generated 62 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:31:02.194597 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7ea590ec-15dc-41fb-98b7-8df04c9d8c51 tempest-FlavorMetadataValidation-1551066003 tempest-FlavorMetadataValidation-1551066003-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:02.195554 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:02.195554 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:31:02.242236 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=3,nova_api:INSERT=11 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:02.253049 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-7ea590ec-15dc-41fb-98b7-8df04c9d8c51 tempest-FlavorMetadataValidation-1551066003 tempest-FlavorMetadataValidation-1551066003-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1087216676" status: 202 len: 0 microversion: 2.86 time: 0.063964 Jul 28 10:31:02.257306 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 118/283] 10.222.0.46 () {60 vars in 1202 bytes} [Thu Jul 28 10:31:02 2022] DELETE /compute/v2.1/flavors/1087216676 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:31:02.283543 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c1d9023a-def4-4548-a6d4-671c4650448c tempest-FlavorMetadataValidation-1551066003 tempest-FlavorMetadataValidation-1551066003-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:02.331213 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c1d9023a-def4-4548-a6d4-671c4650448c tempest-FlavorMetadataValidation-1551066003 tempest-FlavorMetadataValidation-1551066003-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 7209 microversion: 2.86 time: 0.064103 Jul 28 10:31:02.332025 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 119/284] 10.222.0.46 () {60 vars in 1187 bytes} [Thu Jul 28 10:31:02 2022] GET /compute/v2.1/flavors/detail => generated 7209 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:31:02.377676 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e22f3d0a-fe55-4f89-839c-cd812f179c22 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:02.378333 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-e22f3d0a-fe55-4f89-839c-cd812f179c22 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 157b4178-3ed8-49b1-b641-7a33281a68e7] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:31:02.392276 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e22f3d0a-fe55-4f89-839c-cd812f179c22 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:02.392728 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e22f3d0a-fe55-4f89-839c-cd812f179c22 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:02.393510 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e22f3d0a-fe55-4f89-839c-cd812f179c22 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:02.393968 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e22f3d0a-fe55-4f89-839c-cd812f179c22 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:02.450415 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e22f3d0a-fe55-4f89-839c-cd812f179c22 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:02.451189 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e22f3d0a-fe55-4f89-839c-cd812f179c22 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:02.451995 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-e22f3d0a-fe55-4f89-839c-cd812f179c22 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lazy-loading 'fault' on Instance uuid 157b4178-3ed8-49b1-b641-7a33281a68e7 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:31:02.518553 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-e22f3d0a-fe55-4f89-839c-cd812f179c22 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d4335997942b5a33744c9646fff59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852c30f1dc854287b1e8dc8a5a460f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:02.528351 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e22f3d0a-fe55-4f89-839c-cd812f179c22 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] 10.222.0.46 "GET /compute/v2.1/servers/157b4178-3ed8-49b1-b641-7a33281a68e7" status: 200 len: 1351 microversion: 2.1 time: 0.155624 Jul 28 10:31:02.530993 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 120/285] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:31:02 2022] GET /compute/v2.1/servers/157b4178-3ed8-49b1-b641-7a33281a68e7 => generated 1351 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:31:02.554937 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1e99113b-0e4d-40f3-bc98-8710910f8225 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:02.556095 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1e99113b-0e4d-40f3-bc98-8710910f8225 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 157b4178-3ed8-49b1-b641-7a33281a68e7] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:31:02.564930 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1e99113b-0e4d-40f3-bc98-8710910f8225 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:02.565596 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1e99113b-0e4d-40f3-bc98-8710910f8225 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:02.567065 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1e99113b-0e4d-40f3-bc98-8710910f8225 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:02.567651 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1e99113b-0e4d-40f3-bc98-8710910f8225 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:02.619920 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1e99113b-0e4d-40f3-bc98-8710910f8225 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 157b4178-3ed8-49b1-b641-7a33281a68e7] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:31:02.754768 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1e99113b-0e4d-40f3-bc98-8710910f8225 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 157b4178-3ed8-49b1-b641-7a33281a68e7] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:31:02.758907 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1e99113b-0e4d-40f3-bc98-8710910f8225 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:02.759977 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1e99113b-0e4d-40f3-bc98-8710910f8225 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:02.762685 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-1e99113b-0e4d-40f3-bc98-8710910f8225 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 157b4178-3ed8-49b1-b641-7a33281a68e7] instance's host None is down, deleting from database Jul 28 10:31:02.770802 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-1e99113b-0e4d-40f3-bc98-8710910f8225 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 157b4178-3ed8-49b1-b641-7a33281a68e7] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:31:02.826006 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-1e99113b-0e4d-40f3-bc98-8710910f8225 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 157b4178-3ed8-49b1-b641-7a33281a68e7] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:31:02.835483 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-1e99113b-0e4d-40f3-bc98-8710910f8225 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 157b4178-3ed8-49b1-b641-7a33281a68e7] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:31:02.992865 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-87999b00-930b-4896-af76-0016a4e02715 tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1327460325", "ram": 512, "vcpus": 1, "disk": 10, "id": 1052974186, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:03.016024 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:03.016024 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:31:03.045461 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-87999b00-930b-4896-af76-0016a4e02715 tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.846656 Jul 28 10:31:03.049249 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 166/286] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:31:02 2022] POST /compute/v2.1/flavors => generated 416 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:31:03.064237 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9f016539-8fca-427d-86f5-88de0beaad5f tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:03.070741 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-1e99113b-0e4d-40f3-bc98-8710910f8225 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] 10.222.0.46 "DELETE /compute/v2.1/servers/157b4178-3ed8-49b1-b641-7a33281a68e7" status: 204 len: 0 microversion: 2.1 time: 0.521295 Jul 28 10:31:03.074924 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 121/287] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:31:02 2022] DELETE /compute/v2.1/servers/157b4178-3ed8-49b1-b641-7a33281a68e7 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:31:03.081139 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3ee85cef-f115-4e99-b946-f98a025edfb3 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:03.081764 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3ee85cef-f115-4e99-b946-f98a025edfb3 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: 157b4178-3ed8-49b1-b641-7a33281a68e7] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:31:03.091599 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3ee85cef-f115-4e99-b946-f98a025edfb3 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:03.092179 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3ee85cef-f115-4e99-b946-f98a025edfb3 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:03.093086 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3ee85cef-f115-4e99-b946-f98a025edfb3 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:03.093555 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3ee85cef-f115-4e99-b946-f98a025edfb3 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:03.102047 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9f016539-8fca-427d-86f5-88de0beaad5f tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1052974186/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.044452 Jul 28 10:31:03.103615 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 167/288] 10.222.0.46 () {60 vars in 1224 bytes} [Thu Jul 28 10:31:03 2022] POST /compute/v2.1/flavors/1052974186/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 10:31:03.109087 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-3ee85cef-f115-4e99-b946-f98a025edfb3 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] HTTP exception thrown: Instance 157b4178-3ed8-49b1-b641-7a33281a68e7 could not be found. Jul 28 10:31:03.111214 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3ee85cef-f115-4e99-b946-f98a025edfb3 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Request method failure captured: Jul 28 10:31:03.111214 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/157b4178-3ed8-49b1-b641-7a33281a68e7 HTTP/1.1 Jul 28 10:31:03.111214 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:31:03.111214 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:31:03.111214 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:31:03.111214 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:31:03.111214 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:31:03.111214 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:31:03.111214 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:31:03.111214 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:03.111214 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mVTrH4hB5E1RbkAVtiWcD14vvSNRaEBe0gKyixhm6CM4_wpR3cmK2sfBSpX4Lz5rR4V58R-eVg2CyS08wrLDjWajuJ2c-2BD5a3fHcXuG1bP-i4MWVQ3bf5y3hQ4cfqM1rtov1-oSh3QfFvSYZlk3mYbtPv1XBNTxxXP_IMVZf19fY Jul 28 10:31:03.111214 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:31:03.111214 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:31:03.111214 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:31:03.111214 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:31:03.111214 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:31:03.111214 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:31:03.111214 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 852c30f1dc854287b1e8dc8a5a460f39 Jul 28 10:31:03.111214 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-MigrationsAdminTest-230078319 Jul 28 10:31:03.111214 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:31:03.111214 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:31:03.112874 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/852c30f1dc854287b1e8dc8a5a460f39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/852c30f1dc854287b1e8dc8a5a460f39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/852c30f1dc854287b1e8dc8a5a460f39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_852c30f1dc854287b1e8dc8a5a460f39", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:03.112874 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-MigrationsAdminTest-230078319 Jul 28 10:31:03.112874 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 852c30f1dc854287b1e8dc8a5a460f39 Jul 28 10:31:03.112874 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-MigrationsAdminTest-230078319 Jul 28 10:31:03.112874 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-MigrationsAdminTest-230078319-project Jul 28 10:31:03.112874 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:31:03.112874 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:31:03.112874 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: d87d4335997942b5a33744c9646fff59 Jul 28 10:31:03.112874 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-MigrationsAdminTest-230078319-project Jul 28 10:31:03.112874 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:31:03.112874 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 157b4178-3ed8-49b1-b641-7a33281a68e7 could not be found. Jul 28 10:31:03.112874 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '157b4178-3ed8-49b1-b641-7a33281a68e7'} Jul 28 10:31:03.113681 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:03.113681 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:03.113681 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:31:03.113681 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:31:03.113681 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:31:03.113681 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:31:03.113681 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:31:03.113681 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:31:03.113681 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:31:03.113681 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:31:03.113681 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 157b4178-3ed8-49b1-b641-7a33281a68e7 could not be found. Jul 28 10:31:03.113681 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:03.113681 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:03.113681 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:03.113681 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:03.113681 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:03.113681 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:03.113681 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:03.113681 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:03.113681 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:03.115215 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:03.115215 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:31:03.115215 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:31:03.115215 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:31:03.115215 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:31:03.115215 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:31:03.115215 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:31:03.115215 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 157b4178-3ed8-49b1-b641-7a33281a68e7 could not be found. Jul 28 10:31:03.115215 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:03.115215 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:03.115215 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:03.115215 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:03.115215 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:03.115215 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:03.115215 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:31:03.115215 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:31:03.115215 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 157b4178-3ed8-49b1-b641-7a33281a68e7 could not be found. Jul 28 10:31:03.115215 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:03.118064 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3ee85cef-f115-4e99-b946-f98a025edfb3 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Returning 404 to user: Instance 157b4178-3ed8-49b1-b641-7a33281a68e7 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:03.118064 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3ee85cef-f115-4e99-b946-f98a025edfb3 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] 10.222.0.46 "GET /compute/v2.1/servers/157b4178-3ed8-49b1-b641-7a33281a68e7" status: 404 len: 111 microversion: 2.1 time: 0.036286 Jul 28 10:31:03.118064 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 122/289] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:31:03 2022] GET /compute/v2.1/servers/157b4178-3ed8-49b1-b641-7a33281a68e7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:31:03.145327 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-da397093-d080-4003-b78b-8007c41e0b7e tempest-MigrationsAdminTest-61543356 tempest-MigrationsAdminTest-61543356-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:03.146245 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:03.146245 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:31:03.178782 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-da397093-d080-4003-b78b-8007c41e0b7e tempest-MigrationsAdminTest-61543356 tempest-MigrationsAdminTest-61543356-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/009a6d23-586d-4fbe-b0e7-665a73718d15" status: 202 len: 0 microversion: 2.1 time: 0.055794 Jul 28 10:31:03.178782 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 123/290] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:31:03 2022] DELETE /compute/v2.1/flavors/009a6d23-586d-4fbe-b0e7-665a73718d15 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:31:03.194842 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-88ffd103-2fe6-41b2-9c81-6919663fd646 tempest-MigrationsAdminTest-61543356 tempest-MigrationsAdminTest-61543356-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:03.227643 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-88ffd103-2fe6-41b2-9c81-6919663fd646 tempest-MigrationsAdminTest-61543356 tempest-MigrationsAdminTest-61543356-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 6224 microversion: 2.1 time: 0.042058 Jul 28 10:31:03.228423 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 124/291] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:31:03 2022] GET /compute/v2.1/flavors/detail => generated 6224 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:31:03.312607 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-527739859", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "1799137820", "adminPass": "***", "networks": [{"uuid": "eb7cd06f-a7f4-417d-84f3-8b2697912c1b"}], "security_groups": [{"name": "tempest-securitygroup--1842641025"}], "key_name": "tempest-keypair-1084944464", "user_data": "}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:03.488243 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] validate_networks() for [('eb7cd06f-a7f4-417d-84f3-8b2697912c1b', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:31:03.540766 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e223bdd3-d70a-4ebf-bba0-100bbdd4f978 tempest-FlavorsExtraSpecsTestJSON-1916330338 tempest-FlavorsExtraSpecsTestJSON-1916330338-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:03.555009 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e223bdd3-d70a-4ebf-bba0-100bbdd4f978 tempest-FlavorsExtraSpecsTestJSON-1916330338 tempest-FlavorsExtraSpecsTestJSON-1916330338-project] 10.222.0.46 "GET /compute/v2.1/flavors/1052974186/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.445721 Jul 28 10:31:03.562940 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 168/292] 10.222.0.46 () {58 vars in 1203 bytes} [Thu Jul 28 10:31:03 2022] GET /compute/v2.1/flavors/1052974186/os-extra_specs => generated 66 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:31:03.570956 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1282729544", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:03.682229 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] validate_networks() for None {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:31:04.049557 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:31:04.050335 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:31:04.051277 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:31:04.051967 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:31:04.053280 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:31:04.061831 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:04.070421 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:04.071547 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:04.072708 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:04.073433 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:04.100432 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Getting quotas for project 852c30f1dc854287b1e8dc8a5a460f39. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:31:04.106785 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Getting quotas for user d87d4335997942b5a33744c9646fff59 and project 852c30f1dc854287b1e8dc8a5a460f39. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:31:04.123758 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:31:04.127215 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: a9cfd684-94d4-496d-b535-782ec70ee16b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:31:04.213636 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-de8e8f96-b036-4f2e-974a-fb67daab787d tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649202 Jul 28 10:31:04.222005 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 169/293] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:31:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:31:04.231117 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-28f711d6-d5e4-4383-a119-426901712fe9 tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:04.235482 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:04.235482 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:31:04.293020 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-28f711d6-d5e4-4383-a119-426901712fe9 tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1052974186/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.064483 Jul 28 10:31:04.294664 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 170/294] 10.222.0.46 () {60 vars in 1224 bytes} [Thu Jul 28 10:31:04 2022] POST /compute/v2.1/flavors/1052974186/os-extra_specs => generated 66 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:31:04.311402 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2072c431-ff1a-4892-9505-5001d68665d2 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:04.312176 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-2072c431-ff1a-4892-9505-5001d68665d2 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: a9cfd684-94d4-496d-b535-782ec70ee16b] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:31:04.455669 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:31:04.457041 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:31:04.457746 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:31:04.458556 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:31:04.459361 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:31:04.485378 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:04.485378 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:04.487555 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:04.487890 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:04.499553 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-2072c431-ff1a-4892-9505-5001d68665d2 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d4335997942b5a33744c9646fff59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852c30f1dc854287b1e8dc8a5a460f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:04.507207 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-2072c431-ff1a-4892-9505-5001d68665d2 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] 10.222.0.46 "GET /compute/v2.1/servers/a9cfd684-94d4-496d-b535-782ec70ee16b" status: 200 len: 1213 microversion: 2.1 time: 0.210266 Jul 28 10:31:04.510548 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 171/295] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:31:04 2022] GET /compute/v2.1/servers/a9cfd684-94d4-496d-b535-782ec70ee16b => generated 1213 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:31:04.533333 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f6cb3662-da52-4476-8412-9813493a1d69 tempest-FlavorsExtraSpecsTestJSON-1916330338 tempest-FlavorsExtraSpecsTestJSON-1916330338-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:04.554723 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Getting quotas for project 893fb430d96f4a5187573a7e18237769. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:31:04.561073 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f6cb3662-da52-4476-8412-9813493a1d69 tempest-FlavorsExtraSpecsTestJSON-1916330338 tempest-FlavorsExtraSpecsTestJSON-1916330338-project] 10.222.0.46 "GET /compute/v2.1/flavors/1052974186/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.035317 Jul 28 10:31:04.567703 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 172/296] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:31:04 2022] GET /compute/v2.1/flavors/1052974186/os-extra_specs/hw:numa_nodes => generated 22 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:31:04.570349 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Getting quotas for user 2066ac4e76944d949ded86bdb1fd0cd6 and project 893fb430d96f4a5187573a7e18237769. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:31:04.611173 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:31:04.617085 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] [instance: bda0ac1f-d61f-418f-98cb-41c8aa16200b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:31:04.693349 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f0c21e1b-5812-4bd3-9340-2fb78e64449b tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.395210 Jul 28 10:31:04.695205 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 125/297] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:31:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 1398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:31:04.709141 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-088273c7-a310-4cc8-be8a-a6b1b0613a1d tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:04.722735 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:04.722735 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:31:04.767270 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-088273c7-a310-4cc8-be8a-a6b1b0613a1d tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1052974186/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.070673 Jul 28 10:31:04.768442 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 126/298] 10.222.0.46 () {60 vars in 1224 bytes} [Thu Jul 28 10:31:04 2022] POST /compute/v2.1/flavors/1052974186/os-extra_specs => generated 66 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:31:04.774713 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3fca495d-5b60-4390-8c25-44b2990043c3 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:04.775701 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3fca495d-5b60-4390-8c25-44b2990043c3 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] [instance: bda0ac1f-d61f-418f-98cb-41c8aa16200b] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:31:04.930751 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-3fca495d-5b60-4390-8c25-44b2990043c3 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2066ac4e76944d949ded86bdb1fd0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893fb430d96f4a5187573a7e18237769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:04.951222 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3fca495d-5b60-4390-8c25-44b2990043c3 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] 10.222.0.46 "GET /compute/v2.1/servers/bda0ac1f-d61f-418f-98cb-41c8aa16200b" status: 200 len: 1264 microversion: 2.1 time: 0.178940 Jul 28 10:31:04.954541 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 127/299] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:31:04 2022] GET /compute/v2.1/servers/bda0ac1f-d61f-418f-98cb-41c8aa16200b => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:31:04.961574 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8cd067af-af5f-4d4e-8611-ec2ba59a1a26 tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:04.976667 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-8cd067af-af5f-4d4e-8611-ec2ba59a1a26 tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/1052974186/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.018965 Jul 28 10:31:04.983177 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 128/300] 10.222.0.46 () {58 vars in 1203 bytes} [Thu Jul 28 10:31:04 2022] GET /compute/v2.1/flavors/1052974186/os-extra_specs => generated 66 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:31:04.997380 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-882293ca-afb5-4078-940e-d089ea386656 tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:05.001113 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:05.001113 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:31:05.040896 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-882293ca-afb5-4078-940e-d089ea386656 tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] 10.222.0.46 "PUT /compute/v2.1/flavors/1052974186/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.052280 Jul 28 10:31:05.043908 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 129/301] 10.222.0.46 () {60 vars in 1265 bytes} [Thu Jul 28 10:31:04 2022] PUT /compute/v2.1/flavors/1052974186/os-extra_specs/hw:numa_nodes => generated 22 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:31:05.061666 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-785c1db0-efa0-4ffd-9427-c78559a6a615 tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:05.076680 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-785c1db0-efa0-4ffd-9427-c78559a6a615 tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/1052974186/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.025410 Jul 28 10:31:05.078121 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 130/302] 10.222.0.46 () {58 vars in 1203 bytes} [Thu Jul 28 10:31:05 2022] GET /compute/v2.1/flavors/1052974186/os-extra_specs => generated 66 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:31:05.087045 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e35becf0-fab6-460a-860f-38ddeedbce17 tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:05.091201 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:05.091201 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:31:05.092433 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a288aad4-403d-45c5-a066-ba9eaac4573e tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:05.093503 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e35becf0-fab6-460a-860f-38ddeedbce17 tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:05.093619 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:05.093619 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:31:05.095330 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e35becf0-fab6-460a-860f-38ddeedbce17 tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:05.098485 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e35becf0-fab6-460a-860f-38ddeedbce17 tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:05.099135 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e35becf0-fab6-460a-860f-38ddeedbce17 tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:05.140318 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a288aad4-403d-45c5-a066-ba9eaac4573e tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1052974186/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.054984 Jul 28 10:31:05.142115 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 131/303] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Jul 28 10:31:05 2022] DELETE /compute/v2.1/flavors/1052974186/os-extra_specs/hw:numa_nodes => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 10:31:05.151283 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e35becf0-fab6-460a-860f-38ddeedbce17 tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.585857 Jul 28 10:31:05.152194 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 173/304] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 10:31:04 2022] GET /compute/v2.1/os-services => generated 944 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:05.155395 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ad414a0a-a2f8-4d1c-8ecd-72f5ead1ef24 tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:05.168726 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e00ba770-8c49-4b40-9b0f-6bac29826e3d tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:05.172724 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:05.172724 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:31:05.174870 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e00ba770-8c49-4b40-9b0f-6bac29826e3d tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:05.175525 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e00ba770-8c49-4b40-9b0f-6bac29826e3d tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:05.176720 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e00ba770-8c49-4b40-9b0f-6bac29826e3d tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:05.177717 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e00ba770-8c49-4b40-9b0f-6bac29826e3d tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:05.186145 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ad414a0a-a2f8-4d1c-8ecd-72f5ead1ef24 tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1052974186/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.036968 Jul 28 10:31:05.187120 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 132/305] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Jul 28 10:31:05 2022] DELETE /compute/v2.1/flavors/1052974186/os-extra_specs/hw:cpu_policy => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 10:31:05.201663 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f47d4da3-c520-423d-850f-5a6fa62bfb7b tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:05.206930 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e00ba770-8c49-4b40-9b0f-6bac29826e3d tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?host=n-d-850468-6" status: 200 len: 578 microversion: 2.1 time: 0.045736 Jul 28 10:31:05.207846 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 174/306] 10.222.0.46 () {58 vars in 1172 bytes} [Thu Jul 28 10:31:05 2022] GET /compute/v2.1/os-services?host=n-d-850468-6 => generated 578 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:05.222262 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d1692b1c-e9bc-4bf4-8948-0bf27b252608 tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:05.222403 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f47d4da3-c520-423d-850f-5a6fa62bfb7b tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/1052974186/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028843 Jul 28 10:31:05.223907 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 133/307] 10.222.0.46 () {58 vars in 1203 bytes} [Thu Jul 28 10:31:05 2022] GET /compute/v2.1/flavors/1052974186/os-extra_specs => generated 19 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:31:05.225541 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:05.225541 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:31:05.227202 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d1692b1c-e9bc-4bf4-8948-0bf27b252608 tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:05.227766 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d1692b1c-e9bc-4bf4-8948-0bf27b252608 tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:05.228981 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d1692b1c-e9bc-4bf4-8948-0bf27b252608 tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:05.229233 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d1692b1c-e9bc-4bf4-8948-0bf27b252608 tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:05.237066 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-af57cd9f-ce74-42ce-a96b-dd43c1d3cdfb tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:05.238382 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:05.238382 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:31:05.245050 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=8,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:05.261693 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-d1692b1c-e9bc-4bf4-8948-0bf27b252608 tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.044154 Jul 28 10:31:05.263264 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 175/308] 10.222.0.46 () {58 vars in 1176 bytes} [Thu Jul 28 10:31:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:05.277416 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-431c0a92-6603-408f-8778-4585908c5567 tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:05.281028 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:05.281028 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:31:05.283445 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-431c0a92-6603-408f-8778-4585908c5567 tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:05.284219 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-431c0a92-6603-408f-8778-4585908c5567 tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:05.285720 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-431c0a92-6603-408f-8778-4585908c5567 tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:05.286407 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-431c0a92-6603-408f-8778-4585908c5567 tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:05.292356 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-af57cd9f-ce74-42ce-a96b-dd43c1d3cdfb tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1052974186" status: 202 len: 0 microversion: 2.1 time: 0.060014 Jul 28 10:31:05.292929 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 134/309] 10.222.0.46 () {58 vars in 1161 bytes} [Thu Jul 28 10:31:05 2022] DELETE /compute/v2.1/flavors/1052974186 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:31:05.303958 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-527aafa6-50a4-4482-81eb-87b1e887f431 tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:05.319326 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-431c0a92-6603-408f-8778-4585908c5567 tempest-ServicesAdminTestJSON-2016669256 tempest-ServicesAdminTestJSON-2016669256-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.046345 Jul 28 10:31:05.329334 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 176/310] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 10:31:05 2022] GET /compute/v2.1/os-services => generated 944 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:31:05.331683 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-527aafa6-50a4-4482-81eb-87b1e887f431 tempest-FlavorsExtraSpecsTestJSON-536946253 tempest-FlavorsExtraSpecsTestJSON-536946253-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.033535 Jul 28 10:31:05.333896 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 135/311] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:31:05 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:31:05.535306 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-84afa166-e9f4-44b3-9272-2931493d3581 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:05.536472 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-84afa166-e9f4-44b3-9272-2931493d3581 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: a9cfd684-94d4-496d-b535-782ec70ee16b] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:31:05.547691 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-84afa166-e9f4-44b3-9272-2931493d3581 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:05.549939 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-84afa166-e9f4-44b3-9272-2931493d3581 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:05.550997 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-84afa166-e9f4-44b3-9272-2931493d3581 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:05.555190 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-84afa166-e9f4-44b3-9272-2931493d3581 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:05.609371 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-84afa166-e9f4-44b3-9272-2931493d3581 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:05.610128 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-84afa166-e9f4-44b3-9272-2931493d3581 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:05.610829 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-84afa166-e9f4-44b3-9272-2931493d3581 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lazy-loading 'fault' on Instance uuid a9cfd684-94d4-496d-b535-782ec70ee16b {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:31:05.690382 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-84afa166-e9f4-44b3-9272-2931493d3581 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87d4335997942b5a33744c9646fff59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852c30f1dc854287b1e8dc8a5a460f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:05.702391 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-84afa166-e9f4-44b3-9272-2931493d3581 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] 10.222.0.46 "GET /compute/v2.1/servers/a9cfd684-94d4-496d-b535-782ec70ee16b" status: 200 len: 1286 microversion: 2.1 time: 0.174156 Jul 28 10:31:05.703841 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 177/312] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:31:05 2022] GET /compute/v2.1/servers/a9cfd684-94d4-496d-b535-782ec70ee16b => generated 1286 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:31:05.725467 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-487541f8-cbbb-47d6-b678-95dee272fcaf tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:05.726576 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-487541f8-cbbb-47d6-b678-95dee272fcaf tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: a9cfd684-94d4-496d-b535-782ec70ee16b] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:31:05.738469 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-487541f8-cbbb-47d6-b678-95dee272fcaf tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:05.738918 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-487541f8-cbbb-47d6-b678-95dee272fcaf tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:05.739691 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-487541f8-cbbb-47d6-b678-95dee272fcaf tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:05.740672 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-487541f8-cbbb-47d6-b678-95dee272fcaf tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:05.798817 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-487541f8-cbbb-47d6-b678-95dee272fcaf tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: a9cfd684-94d4-496d-b535-782ec70ee16b] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:31:05.899155 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-487541f8-cbbb-47d6-b678-95dee272fcaf tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: a9cfd684-94d4-496d-b535-782ec70ee16b] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:31:05.904172 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-487541f8-cbbb-47d6-b678-95dee272fcaf tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:05.906358 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-487541f8-cbbb-47d6-b678-95dee272fcaf tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:05.909574 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-487541f8-cbbb-47d6-b678-95dee272fcaf tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: a9cfd684-94d4-496d-b535-782ec70ee16b] instance's host None is down, deleting from database Jul 28 10:31:05.915466 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-487541f8-cbbb-47d6-b678-95dee272fcaf tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: a9cfd684-94d4-496d-b535-782ec70ee16b] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:31:05.977482 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-19c3d8b5-69c6-4ce0-afc5-448e4e2bcfe4 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:05.978308 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-19c3d8b5-69c6-4ce0-afc5-448e4e2bcfe4 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] [instance: bda0ac1f-d61f-418f-98cb-41c8aa16200b] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:31:05.985608 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-19c3d8b5-69c6-4ce0-afc5-448e4e2bcfe4 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:05.994345 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-19c3d8b5-69c6-4ce0-afc5-448e4e2bcfe4 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:05.995194 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-19c3d8b5-69c6-4ce0-afc5-448e4e2bcfe4 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:05.995654 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-19c3d8b5-69c6-4ce0-afc5-448e4e2bcfe4 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:06.014523 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-487541f8-cbbb-47d6-b678-95dee272fcaf tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: a9cfd684-94d4-496d-b535-782ec70ee16b] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:31:06.022415 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-487541f8-cbbb-47d6-b678-95dee272fcaf tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: a9cfd684-94d4-496d-b535-782ec70ee16b] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:31:06.048079 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-19c3d8b5-69c6-4ce0-afc5-448e4e2bcfe4 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:06.048536 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-19c3d8b5-69c6-4ce0-afc5-448e4e2bcfe4 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:06.049168 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-19c3d8b5-69c6-4ce0-afc5-448e4e2bcfe4 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lazy-loading 'fault' on Instance uuid bda0ac1f-d61f-418f-98cb-41c8aa16200b {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:31:06.163593 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-19c3d8b5-69c6-4ce0-afc5-448e4e2bcfe4 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2066ac4e76944d949ded86bdb1fd0cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893fb430d96f4a5187573a7e18237769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:06.176434 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-19c3d8b5-69c6-4ce0-afc5-448e4e2bcfe4 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] 10.222.0.46 "GET /compute/v2.1/servers/bda0ac1f-d61f-418f-98cb-41c8aa16200b" status: 200 len: 1337 microversion: 2.1 time: 0.201660 Jul 28 10:31:06.176434 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 178/313] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:31:05 2022] GET /compute/v2.1/servers/bda0ac1f-d61f-418f-98cb-41c8aa16200b => generated 1337 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:31:06.197303 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a1b67b66-29e5-4993-a281-78e059bd25fb tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:06.197890 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a1b67b66-29e5-4993-a281-78e059bd25fb tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] [instance: bda0ac1f-d61f-418f-98cb-41c8aa16200b] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:31:06.206135 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a1b67b66-29e5-4993-a281-78e059bd25fb tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:06.207897 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a1b67b66-29e5-4993-a281-78e059bd25fb tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:06.209104 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a1b67b66-29e5-4993-a281-78e059bd25fb tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:06.210498 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a1b67b66-29e5-4993-a281-78e059bd25fb tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:06.249276 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a1b67b66-29e5-4993-a281-78e059bd25fb tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] [instance: bda0ac1f-d61f-418f-98cb-41c8aa16200b] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:31:06.339235 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a1b67b66-29e5-4993-a281-78e059bd25fb tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] [instance: bda0ac1f-d61f-418f-98cb-41c8aa16200b] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:31:06.341074 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a1b67b66-29e5-4993-a281-78e059bd25fb tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:06.342131 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a1b67b66-29e5-4993-a281-78e059bd25fb tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:06.342874 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-a1b67b66-29e5-4993-a281-78e059bd25fb tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] [instance: bda0ac1f-d61f-418f-98cb-41c8aa16200b] instance's host None is down, deleting from database Jul 28 10:31:06.345671 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=64,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:06.350014 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-a1b67b66-29e5-4993-a281-78e059bd25fb tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] [instance: bda0ac1f-d61f-418f-98cb-41c8aa16200b] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:31:06.372260 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-487541f8-cbbb-47d6-b678-95dee272fcaf tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a9cfd684-94d4-496d-b535-782ec70ee16b" status: 204 len: 0 microversion: 2.1 time: 0.650905 Jul 28 10:31:06.373455 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 136/314] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:31:05 2022] DELETE /compute/v2.1/servers/a9cfd684-94d4-496d-b535-782ec70ee16b => generated 0 bytes in 653 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:31:06.387647 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ac19c018-ad0b-4468-a058-4825c2e73b90 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:06.389227 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ac19c018-ad0b-4468-a058-4825c2e73b90 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] [instance: a9cfd684-94d4-496d-b535-782ec70ee16b] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:31:06.401685 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ac19c018-ad0b-4468-a058-4825c2e73b90 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:06.402564 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ac19c018-ad0b-4468-a058-4825c2e73b90 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:06.403526 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ac19c018-ad0b-4468-a058-4825c2e73b90 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:06.404485 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ac19c018-ad0b-4468-a058-4825c2e73b90 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:06.428787 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-ac19c018-ad0b-4468-a058-4825c2e73b90 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] HTTP exception thrown: Instance a9cfd684-94d4-496d-b535-782ec70ee16b could not be found. Jul 28 10:31:06.430658 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ac19c018-ad0b-4468-a058-4825c2e73b90 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Request method failure captured: Jul 28 10:31:06.430658 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/a9cfd684-94d4-496d-b535-782ec70ee16b HTTP/1.1 Jul 28 10:31:06.430658 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:31:06.430658 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:31:06.430658 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:31:06.430658 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:31:06.430658 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:31:06.430658 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:31:06.430658 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:31:06.430658 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:06.430658 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mVTrH4hB5E1RbkAVtiWcD14vvSNRaEBe0gKyixhm6CM4_wpR3cmK2sfBSpX4Lz5rR4V58R-eVg2CyS08wrLDjWajuJ2c-2BD5a3fHcXuG1bP-i4MWVQ3bf5y3hQ4cfqM1rtov1-oSh3QfFvSYZlk3mYbtPv1XBNTxxXP_IMVZf19fY Jul 28 10:31:06.430658 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:31:06.430658 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:31:06.430658 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:31:06.430658 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:31:06.430658 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:31:06.430658 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:31:06.430658 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 852c30f1dc854287b1e8dc8a5a460f39 Jul 28 10:31:06.430658 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-MigrationsAdminTest-230078319 Jul 28 10:31:06.430658 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:31:06.430658 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:31:06.432057 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/852c30f1dc854287b1e8dc8a5a460f39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/852c30f1dc854287b1e8dc8a5a460f39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/852c30f1dc854287b1e8dc8a5a460f39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_852c30f1dc854287b1e8dc8a5a460f39", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:06.432057 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-MigrationsAdminTest-230078319 Jul 28 10:31:06.432057 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 852c30f1dc854287b1e8dc8a5a460f39 Jul 28 10:31:06.432057 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-MigrationsAdminTest-230078319 Jul 28 10:31:06.432057 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-MigrationsAdminTest-230078319-project Jul 28 10:31:06.432057 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:31:06.432057 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:31:06.432057 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: d87d4335997942b5a33744c9646fff59 Jul 28 10:31:06.432057 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-MigrationsAdminTest-230078319-project Jul 28 10:31:06.432057 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:31:06.432057 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance a9cfd684-94d4-496d-b535-782ec70ee16b could not be found. Jul 28 10:31:06.432057 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'a9cfd684-94d4-496d-b535-782ec70ee16b'} Jul 28 10:31:06.433152 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:06.433152 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:06.433152 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:31:06.433152 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:31:06.433152 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:31:06.433152 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:31:06.433152 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:31:06.433152 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:31:06.433152 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:31:06.433152 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:31:06.433152 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9cfd684-94d4-496d-b535-782ec70ee16b could not be found. Jul 28 10:31:06.433152 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:06.433152 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:06.433152 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:06.433152 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:06.433152 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:06.433152 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:06.433152 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:06.433152 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:06.433152 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:06.434461 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:06.434461 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:31:06.434461 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:31:06.434461 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:31:06.434461 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:31:06.434461 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:31:06.434461 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:31:06.434461 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9cfd684-94d4-496d-b535-782ec70ee16b could not be found. Jul 28 10:31:06.434461 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:06.434461 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:06.434461 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:06.434461 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:06.434461 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:06.434461 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:06.434461 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:31:06.434461 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:31:06.434461 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9cfd684-94d4-496d-b535-782ec70ee16b could not be found. Jul 28 10:31:06.434461 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:06.435581 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ac19c018-ad0b-4468-a058-4825c2e73b90 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] Returning 404 to user: Instance a9cfd684-94d4-496d-b535-782ec70ee16b could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:06.436716 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ac19c018-ad0b-4468-a058-4825c2e73b90 tempest-MigrationsAdminTest-230078319 tempest-MigrationsAdminTest-230078319-project] 10.222.0.46 "GET /compute/v2.1/servers/a9cfd684-94d4-496d-b535-782ec70ee16b" status: 404 len: 111 microversion: 2.1 time: 0.056075 Jul 28 10:31:06.442529 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 137/315] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:31:06 2022] GET /compute/v2.1/servers/a9cfd684-94d4-496d-b535-782ec70ee16b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:31:06.457746 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-a1b67b66-29e5-4993-a281-78e059bd25fb tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] [instance: bda0ac1f-d61f-418f-98cb-41c8aa16200b] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:31:06.465951 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-a1b67b66-29e5-4993-a281-78e059bd25fb tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] [instance: bda0ac1f-d61f-418f-98cb-41c8aa16200b] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:31:06.843353 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a1b67b66-29e5-4993-a281-78e059bd25fb tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bda0ac1f-d61f-418f-98cb-41c8aa16200b" status: 204 len: 0 microversion: 2.1 time: 0.649337 Jul 28 10:31:06.846379 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 179/316] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:31:06 2022] DELETE /compute/v2.1/servers/bda0ac1f-d61f-418f-98cb-41c8aa16200b => generated 0 bytes in 652 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:31:06.853924 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3b835402-b331-4026-a9af-9179f0986681 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:06.854831 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3b835402-b331-4026-a9af-9179f0986681 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] [instance: bda0ac1f-d61f-418f-98cb-41c8aa16200b] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:31:06.871853 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3b835402-b331-4026-a9af-9179f0986681 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:06.872318 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3b835402-b331-4026-a9af-9179f0986681 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:06.875067 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3b835402-b331-4026-a9af-9179f0986681 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:06.876868 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3b835402-b331-4026-a9af-9179f0986681 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:06.912681 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-3b835402-b331-4026-a9af-9179f0986681 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] HTTP exception thrown: Instance bda0ac1f-d61f-418f-98cb-41c8aa16200b could not be found. Jul 28 10:31:06.915012 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3b835402-b331-4026-a9af-9179f0986681 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Request method failure captured: Jul 28 10:31:06.915012 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/bda0ac1f-d61f-418f-98cb-41c8aa16200b HTTP/1.1 Jul 28 10:31:06.915012 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:31:06.915012 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:31:06.915012 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:31:06.915012 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:31:06.915012 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:31:06.915012 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:31:06.915012 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:31:06.915012 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:06.915012 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mVTFSGvXAWOziVFi1qNb-acyJZNgbhYHCsORVdt36PL9fchrzhY68euI_Fa81u81hJdv0Qmb26TkwlA5CY_PBdHVO_I7aBtBoRzkI2dzAMPEA7k2H1IyOfvx8BneN1Mot7c44CNFJtr9iqZHrS40xyjYSb_sYD11eM_9i30tRo2uwU Jul 28 10:31:06.915012 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:31:06.915012 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:31:06.915012 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:31:06.915012 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:31:06.915012 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:31:06.915012 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:31:06.915012 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 893fb430d96f4a5187573a7e18237769 Jul 28 10:31:06.915012 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1238553154 Jul 28 10:31:06.915012 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:31:06.915012 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:31:06.916386 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/893fb430d96f4a5187573a7e18237769"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/893fb430d96f4a5187573a7e18237769"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/893fb430d96f4a5187573a7e18237769"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_893fb430d96f4a5187573a7e18237769", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:06.916386 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1238553154 Jul 28 10:31:06.916386 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 893fb430d96f4a5187573a7e18237769 Jul 28 10:31:06.916386 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1238553154 Jul 28 10:31:06.916386 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1238553154-project Jul 28 10:31:06.916386 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:31:06.916386 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:31:06.916386 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 2066ac4e76944d949ded86bdb1fd0cd6 Jul 28 10:31:06.916386 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1238553154-project Jul 28 10:31:06.916386 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:31:06.916386 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance bda0ac1f-d61f-418f-98cb-41c8aa16200b could not be found. Jul 28 10:31:06.916386 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'bda0ac1f-d61f-418f-98cb-41c8aa16200b'} Jul 28 10:31:06.917178 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:06.917178 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:06.917178 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:31:06.917178 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:31:06.917178 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:31:06.917178 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:31:06.917178 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:31:06.917178 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:31:06.917178 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:31:06.917178 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:31:06.917178 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bda0ac1f-d61f-418f-98cb-41c8aa16200b could not be found. Jul 28 10:31:06.917178 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:06.917178 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:06.917178 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:06.917178 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:06.917178 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:06.917178 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:06.917178 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:06.917178 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:06.917178 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:06.918509 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:06.918509 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:31:06.918509 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:31:06.918509 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:31:06.918509 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:31:06.918509 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:31:06.918509 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:31:06.918509 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bda0ac1f-d61f-418f-98cb-41c8aa16200b could not be found. Jul 28 10:31:06.918509 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:06.918509 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:06.918509 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:06.918509 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:06.918509 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:06.918509 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:06.918509 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:31:06.918509 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:31:06.918509 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bda0ac1f-d61f-418f-98cb-41c8aa16200b could not be found. Jul 28 10:31:06.918509 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:06.920478 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3b835402-b331-4026-a9af-9179f0986681 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Returning 404 to user: Instance bda0ac1f-d61f-418f-98cb-41c8aa16200b could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:06.921537 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3b835402-b331-4026-a9af-9179f0986681 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] 10.222.0.46 "GET /compute/v2.1/servers/bda0ac1f-d61f-418f-98cb-41c8aa16200b" status: 404 len: 111 microversion: 2.1 time: 0.073169 Jul 28 10:31:06.929113 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 138/317] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:31:06 2022] GET /compute/v2.1/servers/bda0ac1f-d61f-418f-98cb-41c8aa16200b => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:31:06.934976 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1a88bdd6-d8a8-41ed-ab04-bbe549b56cd4 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] Calling method '.version_select at 0x7fa94bec8ee0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:06.994006 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1a88bdd6-d8a8-41ed-ab04-bbe549b56cd4 tempest-ServersWithSpecificFlavorTestJSON-1238553154 tempest-ServersWithSpecificFlavorTestJSON-1238553154-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1084944464" status: 202 len: 0 microversion: 2.1 time: 0.064029 Jul 28 10:31:06.995894 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 180/318] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Jul 28 10:31:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1084944464 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:31:08.627843 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-59c14ab4-75e8-4e8e-be4e-5a2b1cb19661 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Calling method '.version_select at 0x7fa958042b80>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:08.738089 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-881443c7-c1e8-4568-8a44-882fe0531f3e tempest-ServersWithSpecificFlavorTestJSON-1475453240 tempest-ServersWithSpecificFlavorTestJSON-1475453240-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:08.741332 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:08.741332 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:31:08.789475 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-881443c7-c1e8-4568-8a44-882fe0531f3e tempest-ServersWithSpecificFlavorTestJSON-1475453240 tempest-ServersWithSpecificFlavorTestJSON-1475453240-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1799137820" status: 202 len: 0 microversion: 2.1 time: 0.055994 Jul 28 10:31:08.794051 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 181/319] 10.222.0.46 () {58 vars in 1161 bytes} [Thu Jul 28 10:31:08 2022] DELETE /compute/v2.1/flavors/1799137820 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:31:08.799464 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1c8a009c-ca89-413f-bfad-484c90be8b60 tempest-ServersWithSpecificFlavorTestJSON-1475453240 tempest-ServersWithSpecificFlavorTestJSON-1475453240-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:08.848606 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1c8a009c-ca89-413f-bfad-484c90be8b60 tempest-ServersWithSpecificFlavorTestJSON-1475453240 tempest-ServersWithSpecificFlavorTestJSON-1475453240-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5404 microversion: 2.1 time: 0.047046 Jul 28 10:31:08.849331 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 182/320] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:31:08 2022] GET /compute/v2.1/flavors/detail => generated 5404 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:31:08.872458 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d6efe86d-4102-463c-850e-16da57979695 tempest-ServersWithSpecificFlavorTestJSON-1475453240 tempest-ServersWithSpecificFlavorTestJSON-1475453240-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:08.923028 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-d6efe86d-4102-463c-850e-16da57979695 tempest-ServersWithSpecificFlavorTestJSON-1475453240 tempest-ServersWithSpecificFlavorTestJSON-1475453240-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1046165180" status: 202 len: 0 microversion: 2.1 time: 0.059674 Jul 28 10:31:08.926954 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 183/321] 10.222.0.46 () {58 vars in 1161 bytes} [Thu Jul 28 10:31:08 2022] DELETE /compute/v2.1/flavors/1046165180 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:31:08.932245 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9549ef32-6df3-4046-b4b4-e470a6073978 tempest-ServersWithSpecificFlavorTestJSON-1475453240 tempest-ServersWithSpecificFlavorTestJSON-1475453240-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:08.979294 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9549ef32-6df3-4046-b4b4-e470a6073978 tempest-ServersWithSpecificFlavorTestJSON-1475453240 tempest-ServersWithSpecificFlavorTestJSON-1475453240-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050424 Jul 28 10:31:08.980318 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 184/322] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:31:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:31:09.416180 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-59c14ab4-75e8-4e8e-be4e-5a2b1cb19661 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/28d9a732d4a649db98c330b1689b1b01" status: 200 len: 371 microversion: 2.1 time: 1.618289 Jul 28 10:31:09.417018 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 139/323] 10.222.0.46 () {58 vars in 1242 bytes} [Thu Jul 28 10:31:07 2022] GET /compute/v2.1/os-quota-sets/28d9a732d4a649db98c330b1689b1b01 => generated 371 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:09.429558 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9ffd1edc-9fe8-440c-81c8-b62a2331b941 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Action: 'update', calling method: .version_select at 0x7fa94bf0ef70>, body: {"quota_set": {"ram": "5120"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:09.740094 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9ffd1edc-9fe8-440c-81c8-b62a2331b941 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:09.743077 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9ffd1edc-9fe8-440c-81c8-b62a2331b941 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:09.747353 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9ffd1edc-9fe8-440c-81c8-b62a2331b941 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:09.748050 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9ffd1edc-9fe8-440c-81c8-b62a2331b941 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:09.926147 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9ffd1edc-9fe8-440c-81c8-b62a2331b941 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/28d9a732d4a649db98c330b1689b1b01" status: 200 len: 328 microversion: 2.1 time: 0.500916 Jul 28 10:31:09.934232 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 185/324] 10.222.0.46 () {60 vars in 1262 bytes} [Thu Jul 28 10:31:09 2022] PUT /compute/v2.1/os-quota-sets/28d9a732d4a649db98c330b1689b1b01 => generated 328 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:31:09.939484 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-9cbf285f-f1f3-43d5-b1a1-7a76d22ed110 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:09.973047 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-9cbf285f-f1f3-43d5-b1a1-7a76d22ed110 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-quota-sets/28d9a732d4a649db98c330b1689b1b01" status: 202 len: 0 microversion: 2.1 time: 0.038199 Jul 28 10:31:09.974003 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 140/325] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:31:09 2022] DELETE /compute/v2.1/os-quota-sets/28d9a732d4a649db98c330b1689b1b01 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:31:10.012610 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-41921a8a-60d4-421a-a22f-0b84f085702d tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Calling method '.version_select at 0x7fa94bfe7550>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:10.984586 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1,nova_api:DELETE=7 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:11.050808 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-41921a8a-60d4-421a-a22f-0b84f085702d tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/28d9a732d4a649db98c330b1689b1b01" status: 200 len: 371 microversion: 2.1 time: 1.052084 Jul 28 10:31:11.053946 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 186/326] 10.222.0.46 () {58 vars in 1242 bytes} [Thu Jul 28 10:31:09 2022] GET /compute/v2.1/os-quota-sets/28d9a732d4a649db98c330b1689b1b01 => generated 371 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:11.606856 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-04981b97-1607-46af-a083-f939dbfe825d tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Calling method '.version_select at 0x7fa94bfeee50>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:12.321457 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-04981b97-1607-46af-a083-f939dbfe825d tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/32b7e674499344ceb041f80979f61e21/defaults" status: 200 len: 371 microversion: 2.1 time: 0.720723 Jul 28 10:31:12.322065 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 141/327] 10.222.0.46 () {58 vars in 1269 bytes} [Thu Jul 28 10:31:11 2022] GET /compute/v2.1/os-quota-sets/32b7e674499344ceb041f80979f61e21/defaults => generated 371 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:13.168043 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b15ba9b9-4814-4050-af9a-dca94f9786d9 tempest-HypervisorAdminV228Test-1256035136 tempest-HypervisorAdminV228Test-1256035136-project-admin] Calling method '.version_select at 0x7fa94be08040>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:13.168849 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:13.168849 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:31:13.170439 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b15ba9b9-4814-4050-af9a-dca94f9786d9 tempest-HypervisorAdminV228Test-1256035136 tempest-HypervisorAdminV228Test-1256035136-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:13.170891 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b15ba9b9-4814-4050-af9a-dca94f9786d9 tempest-HypervisorAdminV228Test-1256035136 tempest-HypervisorAdminV228Test-1256035136-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:13.176538 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=39 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:13.215836 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b15ba9b9-4814-4050-af9a-dca94f9786d9 tempest-HypervisorAdminV228Test-1256035136 tempest-HypervisorAdminV228Test-1256035136-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:13.222718 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b15ba9b9-4814-4050-af9a-dca94f9786d9 tempest-HypervisorAdminV228Test-1256035136 tempest-HypervisorAdminV228Test-1256035136-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:13.254649 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b15ba9b9-4814-4050-af9a-dca94f9786d9 tempest-HypervisorAdminV228Test-1256035136 tempest-HypervisorAdminV228Test-1256035136-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:13.256483 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b15ba9b9-4814-4050-af9a-dca94f9786d9 tempest-HypervisorAdminV228Test-1256035136 tempest-HypervisorAdminV228Test-1256035136-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:13.268876 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b15ba9b9-4814-4050-af9a-dca94f9786d9 tempest-HypervisorAdminV228Test-1256035136 tempest-HypervisorAdminV228Test-1256035136-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.715945 Jul 28 10:31:13.278526 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 187/328] 10.222.0.46 () {60 vars in 1187 bytes} [Thu Jul 28 10:31:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:31:13.283173 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f9c9357c-b425-4cfa-af56-993130457e24 tempest-HypervisorAdminV228Test-1256035136 tempest-HypervisorAdminV228Test-1256035136-project-admin] Calling method '.version_select at 0x7fa94bfeeee0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:13.288529 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:13.288529 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:31:13.300879 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f9c9357c-b425-4cfa-af56-993130457e24 tempest-HypervisorAdminV228Test-1256035136 tempest-HypervisorAdminV228Test-1256035136-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a9e94609-c9be-4409-8579-80fe73a29a93(cell1) {{(pid=119463) load_cells /opt/stack/nova/nova/compute/api.py:307}} Jul 28 10:31:13.302731 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f9c9357c-b425-4cfa-af56-993130457e24 tempest-HypervisorAdminV228Test-1256035136 tempest-HypervisorAdminV228Test-1256035136-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:13.303452 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f9c9357c-b425-4cfa-af56-993130457e24 tempest-HypervisorAdminV228Test-1256035136 tempest-HypervisorAdminV228Test-1256035136-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:13.314821 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=19 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:13.326145 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f9c9357c-b425-4cfa-af56-993130457e24 tempest-HypervisorAdminV228Test-1256035136 tempest-HypervisorAdminV228Test-1256035136-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:13.330584 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f9c9357c-b425-4cfa-af56-993130457e24 tempest-HypervisorAdminV228Test-1256035136 tempest-HypervisorAdminV228Test-1256035136-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:13.336464 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f9c9357c-b425-4cfa-af56-993130457e24 tempest-HypervisorAdminV228Test-1256035136 tempest-HypervisorAdminV228Test-1256035136-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 717 microversion: 2.28 time: 0.057713 Jul 28 10:31:13.337793 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 142/329] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jul 28 10:31:13 2022] GET /compute/v2.1/os-hypervisors/1 => generated 717 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:31:13.486994 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b32a369a-fd71-4e8b-943a-f8bc55e5cc25 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Action: 'update', calling method: .version_select at 0x7fa94be08a60>, body: {"quota_set": {"ram": "5120"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:14.627380 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=35 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:14.637993 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b32a369a-fd71-4e8b-943a-f8bc55e5cc25 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:14.638447 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b32a369a-fd71-4e8b-943a-f8bc55e5cc25 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:14.642855 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b32a369a-fd71-4e8b-943a-f8bc55e5cc25 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:14.645657 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b32a369a-fd71-4e8b-943a-f8bc55e5cc25 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:14.823217 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b32a369a-fd71-4e8b-943a-f8bc55e5cc25 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/c41d45832a794022a49625b4187c9bce" status: 200 len: 328 microversion: 2.1 time: 1.339659 Jul 28 10:31:14.829014 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 188/330] 10.222.0.46 () {60 vars in 1262 bytes} [Thu Jul 28 10:31:13 2022] PUT /compute/v2.1/os-quota-sets/c41d45832a794022a49625b4187c9bce => generated 328 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:14.841023 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-01ba5efe-6be3-4b51-b8fb-61cd6994bf85 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Calling method '.version_select at 0x7fa94bfee820>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:15.467945 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=57 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:15.475856 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-01ba5efe-6be3-4b51-b8fb-61cd6994bf85 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:15.480820 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-01ba5efe-6be3-4b51-b8fb-61cd6994bf85 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:15.484005 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-01ba5efe-6be3-4b51-b8fb-61cd6994bf85 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:15.489009 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-01ba5efe-6be3-4b51-b8fb-61cd6994bf85 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:15.560974 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-01ba5efe-6be3-4b51-b8fb-61cd6994bf85 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/c41d45832a794022a49625b4187c9bce/detail" status: 200 len: 916 microversion: 2.1 time: 0.724720 Jul 28 10:31:15.573511 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 143/331] 10.222.0.46 () {58 vars in 1263 bytes} [Thu Jul 28 10:31:14 2022] GET /compute/v2.1/os-quota-sets/c41d45832a794022a49625b4187c9bce/detail => generated 916 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:16.839406 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c2ffdeb0-cb61-4c9b-a8fe-8092d0dd3ded tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Action: 'update', calling method: .version_select at 0x7fa94be34e50>, body: {"quota_set": {"ram": "2048"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:17.647618 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2ffdeb0-cb61-4c9b-a8fe-8092d0dd3ded tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:17.655939 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2ffdeb0-cb61-4c9b-a8fe-8092d0dd3ded tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:17.659186 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2ffdeb0-cb61-4c9b-a8fe-8092d0dd3ded tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:17.662747 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2ffdeb0-cb61-4c9b-a8fe-8092d0dd3ded tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:17.803655 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2ffdeb0-cb61-4c9b-a8fe-8092d0dd3ded tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:17.804408 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2ffdeb0-cb61-4c9b-a8fe-8092d0dd3ded tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:17.811391 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2ffdeb0-cb61-4c9b-a8fe-8092d0dd3ded tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:17.811909 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2ffdeb0-cb61-4c9b-a8fe-8092d0dd3ded tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:18.004731 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c2ffdeb0-cb61-4c9b-a8fe-8092d0dd3ded tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/c41d45832a794022a49625b4187c9bce?user_id=bbe4c2b69b1e4e9485eb7e0670670119" status: 200 len: 328 microversion: 2.1 time: 1.176512 Jul 28 10:31:18.005680 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 189/332] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Jul 28 10:31:16 2022] PUT /compute/v2.1/os-quota-sets/c41d45832a794022a49625b4187c9bce?user_id=bbe4c2b69b1e4e9485eb7e0670670119 => generated 328 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:18.024793 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-73bb63b1-fbb3-4622-b1df-43f5c82ca60f tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Calling method '.version_select at 0x7fa958022af0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:18.879410 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c4180638-61a9-461a-b51a-976e6ca1e293 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Calling method '.version_select at 0x7fa94bec8ee0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:18.881028 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:18.881028 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:31:18.884440 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c4180638-61a9-461a-b51a-976e6ca1e293 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:18.885097 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c4180638-61a9-461a-b51a-976e6ca1e293 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:18.953423 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c4180638-61a9-461a-b51a-976e6ca1e293 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:18.953902 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c4180638-61a9-461a-b51a-976e6ca1e293 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:19.015838 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c4180638-61a9-461a-b51a-976e6ca1e293 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:19.017473 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c4180638-61a9-461a-b51a-976e6ca1e293 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:19.054116 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c4180638-61a9-461a-b51a-976e6ca1e293 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.010206 Jul 28 10:31:19.064325 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 190/333] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:31:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:19.095298 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a080c5cb-82d3-4368-b729-1ce19d3417f4 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Calling method '.version_select at 0x7fa95a5caf70>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:19.102101 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:19.102101 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:31:19.108138 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a080c5cb-82d3-4368-b729-1ce19d3417f4 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:19.110935 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a080c5cb-82d3-4368-b729-1ce19d3417f4 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:19.215821 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a080c5cb-82d3-4368-b729-1ce19d3417f4 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:19.216275 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a080c5cb-82d3-4368-b729-1ce19d3417f4 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:19.272764 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a080c5cb-82d3-4368-b729-1ce19d3417f4 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:19.277106 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a080c5cb-82d3-4368-b729-1ce19d3417f4 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:19.297927 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a080c5cb-82d3-4368-b729-1ce19d3417f4 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/n-h2-850468-6/servers" status: 200 len: 104 microversion: 2.1 time: 0.232337 Jul 28 10:31:19.301031 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 191/334] 10.222.0.46 () {58 vars in 1212 bytes} [Thu Jul 28 10:31:19 2022] GET /compute/v2.1/os-hypervisors/n-h2-850468-6/servers => generated 104 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:19.417351 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0807d1c6-7fd9-4f4b-8eb4-d7634d6f3c0e tempest-NetworksTest-1489324915 tempest-NetworksTest-1489324915-project-admin] Calling method '.version_select at 0x7fa94be7ac10>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:19.458405 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-73bb63b1-fbb3-4622-b1df-43f5c82ca60f tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/c41d45832a794022a49625b4187c9bce?user_id=bbe4c2b69b1e4e9485eb7e0670670119" status: 200 len: 370 microversion: 2.1 time: 1.444714 Jul 28 10:31:19.459463 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 144/335] 10.222.0.46 () {58 vars in 1323 bytes} [Thu Jul 28 10:31:18 2022] GET /compute/v2.1/os-quota-sets/c41d45832a794022a49625b4187c9bce?user_id=bbe4c2b69b1e4e9485eb7e0670670119 => generated 370 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:19.500684 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-bfcb77c0-37db-4035-b3fd-8699720cd5f7 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Calling method '.version_select at 0x7fa958042dc0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:19.502223 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:19.502223 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:31:19.508724 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bfcb77c0-37db-4035-b3fd-8699720cd5f7 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:19.510515 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bfcb77c0-37db-4035-b3fd-8699720cd5f7 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:19.552986 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bfcb77c0-37db-4035-b3fd-8699720cd5f7 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:19.553687 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bfcb77c0-37db-4035-b3fd-8699720cd5f7 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:19.589879 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bfcb77c0-37db-4035-b3fd-8699720cd5f7 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:19.595204 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bfcb77c0-37db-4035-b3fd-8699720cd5f7 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:19.610225 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-bfcb77c0-37db-4035-b3fd-8699720cd5f7 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.129713 Jul 28 10:31:19.613424 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 145/336] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:31:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:19.642200 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7af6db50-da3e-4ebc-9d9f-acfc2e9fb484 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Calling method '.version_select at 0x7fa958022ca0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:19.643638 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:19.643638 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:31:19.649821 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7af6db50-da3e-4ebc-9d9f-acfc2e9fb484 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:19.650689 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7af6db50-da3e-4ebc-9d9f-acfc2e9fb484 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:19.684997 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7af6db50-da3e-4ebc-9d9f-acfc2e9fb484 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:19.685818 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7af6db50-da3e-4ebc-9d9f-acfc2e9fb484 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:19.718614 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-7af6db50-da3e-4ebc-9d9f-acfc2e9fb484 tempest-HypervisorAdminUnderV252Test-267326356 tempest-HypervisorAdminUnderV252Test-267326356-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/n-h2-850468-6/search" status: 200 len: 104 microversion: 2.1 time: 0.095198 Jul 28 10:31:19.720020 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 146/337] 10.222.0.46 () {58 vars in 1209 bytes} [Thu Jul 28 10:31:19 2022] GET /compute/v2.1/os-hypervisors/n-h2-850468-6/search => generated 104 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:20.305077 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c818ae4e-547f-4434-ba3e-45958b02920d tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Calling method '.version_select at 0x7fa94bfeeca0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:20.347998 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0807d1c6-7fd9-4f4b-8eb4-d7634d6f3c0e tempest-NetworksTest-1489324915 tempest-NetworksTest-1489324915-project-admin] 10.222.0.46 "GET /compute/v2.1/os-networks" status: 200 len: 5395 microversion: 2.1 time: 1.044353 Jul 28 10:31:20.349511 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 192/338] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 10:31:19 2022] GET /compute/v2.1/os-networks => generated 5395 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:31:20.357994 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4fa1dfb2-bea5-4f1c-a64c-ac4a2020dbd4 tempest-NetworksTest-1489324915 tempest-NetworksTest-1489324915-project-admin] Calling method '.version_select at 0x7fa95803d550>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:20.805970 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-4fa1dfb2-bea5-4f1c-a64c-ac4a2020dbd4 tempest-NetworksTest-1489324915 tempest-NetworksTest-1489324915-project-admin] 10.222.0.46 "GET /compute/v2.1/os-networks/c45c8dc7-65d8-4dcb-8b4b-da6b676017e7" status: 200 len: 652 microversion: 2.1 time: 0.452127 Jul 28 10:31:20.823117 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 193/339] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Jul 28 10:31:20 2022] GET /compute/v2.1/os-networks/c45c8dc7-65d8-4dcb-8b4b-da6b676017e7 => generated 652 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:20.829071 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8a131b70-08b3-4126-a143-37f5d17a12e7 tempest-NetworksTest-1489324915 tempest-NetworksTest-1489324915-project-admin] Calling method '.version_select at 0x7fa94bdcb3a0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:20.875546 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c818ae4e-547f-4434-ba3e-45958b02920d tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/32b7e674499344ceb041f80979f61e21/defaults" status: 200 len: 371 microversion: 2.1 time: 0.576794 Jul 28 10:31:20.877196 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 147/340] 10.222.0.46 () {58 vars in 1269 bytes} [Thu Jul 28 10:31:20 2022] GET /compute/v2.1/os-quota-sets/32b7e674499344ceb041f80979f61e21/defaults => generated 371 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:20.888974 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-dc05800a-8c34-4951-b4d2-22c124bf3b66 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Action: 'update', calling method: .version_select at 0x7fa958022d30>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:21.141039 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dc05800a-8c34-4951-b4d2-22c124bf3b66 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:21.142204 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dc05800a-8c34-4951-b4d2-22c124bf3b66 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:21.143529 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dc05800a-8c34-4951-b4d2-22c124bf3b66 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:21.144097 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dc05800a-8c34-4951-b4d2-22c124bf3b66 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:21.186495 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-8a131b70-08b3-4126-a143-37f5d17a12e7 tempest-NetworksTest-1489324915 tempest-NetworksTest-1489324915-project-admin] 10.222.0.46 "GET /compute/v2.1/os-networks" status: 200 len: 5395 microversion: 2.1 time: 0.361714 Jul 28 10:31:21.187377 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 194/341] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 10:31:20 2022] GET /compute/v2.1/os-networks => generated 5395 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:31:21.673425 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-dc05800a-8c34-4951-b4d2-22c124bf3b66 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/32b7e674499344ceb041f80979f61e21" status: 200 len: 329 microversion: 2.1 time: 0.787980 Jul 28 10:31:21.675110 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 148/342] 10.222.0.46 () {60 vars in 1263 bytes} [Thu Jul 28 10:31:20 2022] PUT /compute/v2.1/os-quota-sets/32b7e674499344ceb041f80979f61e21 => generated 329 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:21.686722 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-be8c8c63-eafd-45d7-8784-6baaa372bab2 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Action: 'update', calling method: .version_select at 0x7fa94bdcb700>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:22.515390 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-be8c8c63-eafd-45d7-8784-6baaa372bab2 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:22.516752 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-be8c8c63-eafd-45d7-8784-6baaa372bab2 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:22.518438 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-be8c8c63-eafd-45d7-8784-6baaa372bab2 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:22.519570 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-be8c8c63-eafd-45d7-8784-6baaa372bab2 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:23.156931 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=12,nova_api:UPDATE=10 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:23.402412 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-be8c8c63-eafd-45d7-8784-6baaa372bab2 tempest-QuotasAdminTestJSON-732698667 tempest-QuotasAdminTestJSON-732698667-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/32b7e674499344ceb041f80979f61e21" status: 200 len: 329 microversion: 2.1 time: 1.719556 Jul 28 10:31:23.414347 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 195/343] 10.222.0.46 () {60 vars in 1263 bytes} [Thu Jul 28 10:31:21 2022] PUT /compute/v2.1/os-quota-sets/32b7e674499344ceb041f80979f61e21 => generated 329 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:31:24.733463 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1787480580", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "7e4b5175-802f-40cd-8d61-3d01bee12ef4"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:24.866770 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] validate_networks() for [('7e4b5175-802f-40cd-8d61-3d01bee12ef4', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:31:27.236508 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-495a108c-39f6-4bff-b6ae-0a298c1f999a tempest-KeyPairsV210TestJSON-866968399 tempest-KeyPairsV210TestJSON-866968399-project-admin] Action: 'create', calling method: .version_select at 0x7fa94bdcb9d0>, body: {"keypair": {"name": "tempest-keypair-175572745", "type": "ssh", "user_id": "88175a469c4843559708a1af3037f6af", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNItvt2IzFyhUpTQsGnjLbQADZKGRjxIfmeozrHlPzs27QV1QOD3Oko8rhJ1vKN8g7Ed9d12BeHlht01WeZlqBF/mDoHT3D4gIYF4tyuc5Vkcv2qsFk5GnLnPF/fwj9H2g=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:27.313248 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-495a108c-39f6-4bff-b6ae-0a298c1f999a tempest-KeyPairsV210TestJSON-866968399 tempest-KeyPairsV210TestJSON-866968399-project-admin] Getting quotas for project d163368b6df14c43aaabb373495100ec. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:31:27.318886 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-495a108c-39f6-4bff-b6ae-0a298c1f999a tempest-KeyPairsV210TestJSON-866968399 tempest-KeyPairsV210TestJSON-866968399-project-admin] Getting quotas for user 6b68c4c816344acf83c61b5509d8407c and project d163368b6df14c43aaabb373495100ec. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:31:27.383069 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-495a108c-39f6-4bff-b6ae-0a298c1f999a tempest-KeyPairsV210TestJSON-866968399 tempest-KeyPairsV210TestJSON-866968399-project-admin] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.680049 Jul 28 10:31:27.396324 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 196/344] 10.222.0.46 () {62 vars in 1200 bytes} [Thu Jul 28 10:31:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 686 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 28 10:31:27.401678 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7cc83aa0-cd55-4600-b563-a80515451025 tempest-KeyPairsV210TestJSON-866968399 tempest-KeyPairsV210TestJSON-866968399-project-admin] Action: 'create', calling method: .version_select at 0x7fa94bdf6ca0>, body: {"keypair": {"name": "tempest-keypair-988709539", "type": "ssh", "user_id": "88175a469c4843559708a1af3037f6af", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjh/E+RyPN5cFzx4uKWXD3XGw2gi1OkAhpYNpvQweVjtTF255VC/nB2m0lD3iygv9AGdiE2WFiA6ZLsnx/BpAdeKBNHQ6GRcxfZNW/KLV0e8s7Ci9tPyTwRfSMqruQZAg=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:27.432253 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-7cc83aa0-cd55-4600-b563-a80515451025 tempest-KeyPairsV210TestJSON-866968399 tempest-KeyPairsV210TestJSON-866968399-project-admin] Getting quotas for project d163368b6df14c43aaabb373495100ec. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:31:27.445113 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-7cc83aa0-cd55-4600-b563-a80515451025 tempest-KeyPairsV210TestJSON-866968399 tempest-KeyPairsV210TestJSON-866968399-project-admin] Getting quotas for user 6b68c4c816344acf83c61b5509d8407c and project d163368b6df14c43aaabb373495100ec. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:31:27.510124 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7cc83aa0-cd55-4600-b563-a80515451025 tempest-KeyPairsV210TestJSON-866968399 tempest-KeyPairsV210TestJSON-866968399-project-admin] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.112081 Jul 28 10:31:27.510848 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 197/345] 10.222.0.46 () {62 vars in 1200 bytes} [Thu Jul 28 10:31:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 10:31:27.522636 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-614a7e3a-da49-4c29-87e2-c3a3c309f5e5 tempest-KeyPairsV210TestJSON-866968399 tempest-KeyPairsV210TestJSON-866968399-project-admin] Calling method '.version_select at 0x7fa94bd8a4c0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:27.543056 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-614a7e3a-da49-4c29-87e2-c3a3c309f5e5 tempest-KeyPairsV210TestJSON-866968399 tempest-KeyPairsV210TestJSON-866968399-project-admin] 10.222.0.46 "GET /compute/v2.1/os-keypairs/tempest-keypair-175572745?user_id=88175a469c4843559708a1af3037f6af" status: 200 len: 511 microversion: 2.10 time: 0.022686 Jul 28 10:31:27.543782 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 198/346] 10.222.0.46 () {60 vars in 1337 bytes} [Thu Jul 28 10:31:27 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-175572745?user_id=88175a469c4843559708a1af3037f6af => generated 511 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:31:27.558657 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f4baa7a4-b153-4beb-9394-83b2757f1a9b tempest-KeyPairsV210TestJSON-866968399 tempest-KeyPairsV210TestJSON-866968399-project-admin] Action: 'create', calling method: .version_select at 0x7fa94bd8a670>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1004889085", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCna0s6tAeSoMLnI5BqitAPCSic08AsB4pFkZSuNw0RGcCLtEGZrOmKGW9eATmk5q85A7IophQTOYaZnMUVPxfuvtJ0VtnqB1ULed85OO3MD+/qhanBapg/Xeay9QcGMXg=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:27.594771 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-f4baa7a4-b153-4beb-9394-83b2757f1a9b tempest-KeyPairsV210TestJSON-866968399 tempest-KeyPairsV210TestJSON-866968399-project-admin] Getting quotas for project d163368b6df14c43aaabb373495100ec. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:31:27.595335 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:31:27.596036 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:31:27.596531 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:31:27.596946 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:31:27.597361 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:31:27.602232 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-f4baa7a4-b153-4beb-9394-83b2757f1a9b tempest-KeyPairsV210TestJSON-866968399 tempest-KeyPairsV210TestJSON-866968399-project-admin] Getting quotas for user 6b68c4c816344acf83c61b5509d8407c and project d163368b6df14c43aaabb373495100ec. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:31:27.622214 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:27.623129 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:27.623622 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:27.624067 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:27.662121 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f4baa7a4-b153-4beb-9394-83b2757f1a9b tempest-KeyPairsV210TestJSON-866968399 tempest-KeyPairsV210TestJSON-866968399-project-admin] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.105873 Jul 28 10:31:27.669690 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 199/347] 10.222.0.46 () {62 vars in 1200 bytes} [Thu Jul 28 10:31:27 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 10:31:27.679295 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=14 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:27.689907 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-586ab624-0d2e-4e2a-bb79-b70ebe36b67e tempest-KeyPairsV210TestJSON-866968399 tempest-KeyPairsV210TestJSON-866968399-project-admin] Calling method '.version_select at 0x7fa94bd96310>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:27.705740 n-d-850468-6 devstack@n-api.service[119464]: WARNING oslo_db.sqlalchemy.utils [None req-586ab624-0d2e-4e2a-bb79-b70ebe36b67e tempest-KeyPairsV210TestJSON-866968399 tempest-KeyPairsV210TestJSON-866968399-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 28 10:31:27.706317 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Getting quotas for project 42eab8cff05b43bc9a9b6e46b399d941. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:31:27.723058 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Getting quotas for user 69fe966bc18948f0b8c6367ea8f160c1 and project 42eab8cff05b43bc9a9b6e46b399d941. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:31:27.746822 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-586ab624-0d2e-4e2a-bb79-b70ebe36b67e tempest-KeyPairsV210TestJSON-866968399 tempest-KeyPairsV210TestJSON-866968399-project-admin] 10.222.0.46 "GET /compute/v2.1/os-keypairs?user_id=88175a469c4843559708a1af3037f6af" status: 200 len: 724 microversion: 2.10 time: 0.075915 Jul 28 10:31:27.773842 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 200/348] 10.222.0.46 () {60 vars in 1259 bytes} [Thu Jul 28 10:31:27 2022] GET /compute/v2.1/os-keypairs?user_id=88175a469c4843559708a1af3037f6af => generated 724 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:31:27.786802 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:31:27.788449 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.utils [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1787480580 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-178748058 Jul 28 10:31:27.789177 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] [instance: 6634f82f-f726-4467-a1af-c0f9666ebc5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:31:27.797514 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-dd71963c-1bae-4099-88d6-a4393a506fe3 tempest-KeyPairsV210TestJSON-866968399 tempest-KeyPairsV210TestJSON-866968399-project-admin] Calling method '.version_select at 0x7fa94bd8a5e0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:27.856855 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-dd71963c-1bae-4099-88d6-a4393a506fe3 tempest-KeyPairsV210TestJSON-866968399 tempest-KeyPairsV210TestJSON-866968399-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1004889085" status: 204 len: 0 microversion: 2.10 time: 0.081555 Jul 28 10:31:27.857544 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 201/349] 10.222.0.46 () {60 vars in 1325 bytes} [Thu Jul 28 10:31:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1004889085 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:31:27.876563 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6a398c68-9880-4244-a4d6-d321bc18e40e tempest-KeyPairsV210TestJSON-866968399 tempest-KeyPairsV210TestJSON-866968399-project-admin] Calling method '.version_select at 0x7fa94bd8a3a0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:27.920460 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b7f18dd7-85b4-4652-88de-cdf7caf51186 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.938786 Jul 28 10:31:27.923120 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 149/350] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:31:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:31:27.934689 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-6a398c68-9880-4244-a4d6-d321bc18e40e tempest-KeyPairsV210TestJSON-866968399 tempest-KeyPairsV210TestJSON-866968399-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-988709539?user_id=88175a469c4843559708a1af3037f6af" status: 204 len: 0 microversion: 2.10 time: 0.072422 Jul 28 10:31:27.935583 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 202/351] 10.222.0.46 () {60 vars in 1340 bytes} [Thu Jul 28 10:31:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-988709539?user_id=88175a469c4843559708a1af3037f6af => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:31:27.953735 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d942c57c-385e-4689-b042-3170f011f1e9 tempest-KeyPairsV210TestJSON-866968399 tempest-KeyPairsV210TestJSON-866968399-project-admin] Calling method '.version_select at 0x7fa94bd96670>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:27.964237 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-25c18afd-b1bb-45cd-b9b8-7b76d0636b49 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:27.964859 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-25c18afd-b1bb-45cd-b9b8-7b76d0636b49 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] [instance: 6634f82f-f726-4467-a1af-c0f9666ebc5f] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:31:28.072408 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-d942c57c-385e-4689-b042-3170f011f1e9 tempest-KeyPairsV210TestJSON-866968399 tempest-KeyPairsV210TestJSON-866968399-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-175572745?user_id=88175a469c4843559708a1af3037f6af" status: 204 len: 0 microversion: 2.10 time: 0.130615 Jul 28 10:31:28.073483 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 203/352] 10.222.0.46 () {60 vars in 1340 bytes} [Thu Jul 28 10:31:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-175572745?user_id=88175a469c4843559708a1af3037f6af => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:31:28.229223 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-25c18afd-b1bb-45cd-b9b8-7b76d0636b49 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fe966bc18948f0b8c6367ea8f160c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eab8cff05b43bc9a9b6e46b399d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:28.250608 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-25c18afd-b1bb-45cd-b9b8-7b76d0636b49 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] 10.222.0.46 "GET /compute/v2.1/servers/6634f82f-f726-4467-a1af-c0f9666ebc5f" status: 200 len: 1232 microversion: 2.1 time: 0.316867 Jul 28 10:31:28.269907 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 150/353] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:31:27 2022] GET /compute/v2.1/servers/6634f82f-f726-4467-a1af-c0f9666ebc5f => generated 1232 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:31:29.280792 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-56d2e167-2458-4846-b34a-2bc1558e5fbc tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:29.281435 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-56d2e167-2458-4846-b34a-2bc1558e5fbc tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] [instance: 6634f82f-f726-4467-a1af-c0f9666ebc5f] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:31:29.301004 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-56d2e167-2458-4846-b34a-2bc1558e5fbc tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:29.302193 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-56d2e167-2458-4846-b34a-2bc1558e5fbc tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:29.303020 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-56d2e167-2458-4846-b34a-2bc1558e5fbc tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:29.303458 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-56d2e167-2458-4846-b34a-2bc1558e5fbc tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:29.424383 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-56d2e167-2458-4846-b34a-2bc1558e5fbc tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:29.425843 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-56d2e167-2458-4846-b34a-2bc1558e5fbc tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:29.427424 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-56d2e167-2458-4846-b34a-2bc1558e5fbc tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lazy-loading 'fault' on Instance uuid 6634f82f-f726-4467-a1af-c0f9666ebc5f {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:31:29.783359 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-56d2e167-2458-4846-b34a-2bc1558e5fbc tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fe966bc18948f0b8c6367ea8f160c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eab8cff05b43bc9a9b6e46b399d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:29.792340 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-56d2e167-2458-4846-b34a-2bc1558e5fbc tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] 10.222.0.46 "GET /compute/v2.1/servers/6634f82f-f726-4467-a1af-c0f9666ebc5f" status: 200 len: 1305 microversion: 2.1 time: 0.515378 Jul 28 10:31:29.825703 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 151/354] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:31:29 2022] GET /compute/v2.1/servers/6634f82f-f726-4467-a1af-c0f9666ebc5f => generated 1305 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:31:29.848250 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-dcf5fea4-e5c0-47dd-bed4-fab743cf75d1 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:29.857453 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-dcf5fea4-e5c0-47dd-bed4-fab743cf75d1 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] [instance: 6634f82f-f726-4467-a1af-c0f9666ebc5f] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:31:29.896324 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dcf5fea4-e5c0-47dd-bed4-fab743cf75d1 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:29.896949 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dcf5fea4-e5c0-47dd-bed4-fab743cf75d1 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:29.899189 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dcf5fea4-e5c0-47dd-bed4-fab743cf75d1 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:29.899650 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dcf5fea4-e5c0-47dd-bed4-fab743cf75d1 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:30.007020 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-dcf5fea4-e5c0-47dd-bed4-fab743cf75d1 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] [instance: 6634f82f-f726-4467-a1af-c0f9666ebc5f] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:31:30.041912 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-873a872b-1bf5-40df-9312-df489d7c9ac3 tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] Action: 'create', calling method: .version_select at 0x7fa94bdf6e50>, body: {"pool": null} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:30.195543 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-dcf5fea4-e5c0-47dd-bed4-fab743cf75d1 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] [instance: 6634f82f-f726-4467-a1af-c0f9666ebc5f] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:31:30.196376 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dcf5fea4-e5c0-47dd-bed4-fab743cf75d1 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:30.196824 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dcf5fea4-e5c0-47dd-bed4-fab743cf75d1 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:30.197267 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-dcf5fea4-e5c0-47dd-bed4-fab743cf75d1 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] [instance: 6634f82f-f726-4467-a1af-c0f9666ebc5f] instance's host None is down, deleting from database Jul 28 10:31:30.224432 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-dcf5fea4-e5c0-47dd-bed4-fab743cf75d1 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] [instance: 6634f82f-f726-4467-a1af-c0f9666ebc5f] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:31:30.356423 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-dcf5fea4-e5c0-47dd-bed4-fab743cf75d1 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] [instance: 6634f82f-f726-4467-a1af-c0f9666ebc5f] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:31:30.365117 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-dcf5fea4-e5c0-47dd-bed4-fab743cf75d1 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] [instance: 6634f82f-f726-4467-a1af-c0f9666ebc5f] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:31:30.876309 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-dcf5fea4-e5c0-47dd-bed4-fab743cf75d1 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6634f82f-f726-4467-a1af-c0f9666ebc5f" status: 204 len: 0 microversion: 2.1 time: 1.048888 Jul 28 10:31:30.877461 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 152/355] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:31:29 2022] DELETE /compute/v2.1/servers/6634f82f-f726-4467-a1af-c0f9666ebc5f => generated 0 bytes in 1051 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:31:30.887217 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b1566d72-db30-404c-8aba-8f6b70575fe6 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:30.888604 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b1566d72-db30-404c-8aba-8f6b70575fe6 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] [instance: 6634f82f-f726-4467-a1af-c0f9666ebc5f] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:31:30.930595 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b1566d72-db30-404c-8aba-8f6b70575fe6 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:30.931440 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b1566d72-db30-404c-8aba-8f6b70575fe6 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:30.932896 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b1566d72-db30-404c-8aba-8f6b70575fe6 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:30.942038 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b1566d72-db30-404c-8aba-8f6b70575fe6 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:30.986252 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-b1566d72-db30-404c-8aba-8f6b70575fe6 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] HTTP exception thrown: Instance 6634f82f-f726-4467-a1af-c0f9666ebc5f could not be found. Jul 28 10:31:30.989837 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b1566d72-db30-404c-8aba-8f6b70575fe6 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Request method failure captured: Jul 28 10:31:30.989837 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/6634f82f-f726-4467-a1af-c0f9666ebc5f HTTP/1.1 Jul 28 10:31:30.989837 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:31:30.989837 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:31:30.989837 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:31:30.989837 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:31:30.989837 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:31:30.989837 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:31:30.989837 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:31:30.989837 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:30.989837 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mV6TpysjnsDK3WDCgxcJYVbjWeDqREsMj7G6II-ZaJbKPs82xTuTaPiN0WO4tcWtlNX7xvJ63_Y7gbrJBi3UovANrGNUtqZpCRCyanIBbH2TDJE52wVh1TsQl5tjF-T-Ah8Us9DYqryT95bpw3n-vsdK4Smid0PCVx9BM9SK69d-0k Jul 28 10:31:30.989837 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:31:30.989837 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:31:30.989837 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:31:30.989837 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:31:30.989837 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:31:30.989837 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:31:30.989837 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 42eab8cff05b43bc9a9b6e46b399d941 Jul 28 10:31:30.989837 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-884269863 Jul 28 10:31:30.989837 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:31:30.989837 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:31:30.991359 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/42eab8cff05b43bc9a9b6e46b399d941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/42eab8cff05b43bc9a9b6e46b399d941"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/42eab8cff05b43bc9a9b6e46b399d941"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_42eab8cff05b43bc9a9b6e46b399d941", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:30.991359 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-884269863 Jul 28 10:31:30.991359 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 42eab8cff05b43bc9a9b6e46b399d941 Jul 28 10:31:30.991359 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-884269863 Jul 28 10:31:30.991359 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project Jul 28 10:31:30.991359 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:31:30.991359 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:31:30.991359 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 69fe966bc18948f0b8c6367ea8f160c1 Jul 28 10:31:30.991359 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project Jul 28 10:31:30.991359 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:31:30.991359 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 6634f82f-f726-4467-a1af-c0f9666ebc5f could not be found. Jul 28 10:31:30.991359 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '6634f82f-f726-4467-a1af-c0f9666ebc5f'} Jul 28 10:31:30.992196 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:30.992196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:30.992196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:31:30.992196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:31:30.992196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:31:30.992196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:31:30.992196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:31:30.992196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:31:30.992196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:31:30.992196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:31:30.992196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6634f82f-f726-4467-a1af-c0f9666ebc5f could not be found. Jul 28 10:31:30.992196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:30.992196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:30.992196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:30.992196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:30.992196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:30.992196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:30.992196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:30.992196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:30.992196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:30.993547 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:30.993547 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:31:30.993547 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:31:30.993547 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:31:30.993547 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:31:30.993547 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:31:30.993547 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:31:30.993547 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6634f82f-f726-4467-a1af-c0f9666ebc5f could not be found. Jul 28 10:31:30.993547 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:30.993547 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:30.993547 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:30.993547 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:30.993547 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:30.993547 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:30.993547 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:31:30.993547 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:31:30.993547 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6634f82f-f726-4467-a1af-c0f9666ebc5f could not be found. Jul 28 10:31:30.993547 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:30.999033 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b1566d72-db30-404c-8aba-8f6b70575fe6 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] Returning 404 to user: Instance 6634f82f-f726-4467-a1af-c0f9666ebc5f could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:31.001041 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b1566d72-db30-404c-8aba-8f6b70575fe6 tempest-FloatingIPsAssociationNegativeTestJSON-884269863 tempest-FloatingIPsAssociationNegativeTestJSON-884269863-project] 10.222.0.46 "GET /compute/v2.1/servers/6634f82f-f726-4467-a1af-c0f9666ebc5f" status: 404 len: 111 microversion: 2.1 time: 0.118459 Jul 28 10:31:31.004880 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 153/356] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:31:30 2022] GET /compute/v2.1/servers/6634f82f-f726-4467-a1af-c0f9666ebc5f => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:31:32.534732 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=61,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:32.536495 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=26 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:34.374105 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6d80a36f-19df-4bdf-8cbb-90f65983cbfc tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Calling method '.version_select at 0x7fa958022ca0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:34.377618 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:34.377618 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:31:34.383531 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6d80a36f-19df-4bdf-8cbb-90f65983cbfc tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:34.384430 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6d80a36f-19df-4bdf-8cbb-90f65983cbfc tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:34.479399 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6d80a36f-19df-4bdf-8cbb-90f65983cbfc tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:34.501284 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6d80a36f-19df-4bdf-8cbb-90f65983cbfc tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:34.540088 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6d80a36f-19df-4bdf-8cbb-90f65983cbfc tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:34.542498 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6d80a36f-19df-4bdf-8cbb-90f65983cbfc tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:34.627557 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6d80a36f-19df-4bdf-8cbb-90f65983cbfc tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:34.631622 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6d80a36f-19df-4bdf-8cbb-90f65983cbfc tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:34.702318 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6d80a36f-19df-4bdf-8cbb-90f65983cbfc tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:34.703577 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6d80a36f-19df-4bdf-8cbb-90f65983cbfc tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:34.737646 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6d80a36f-19df-4bdf-8cbb-90f65983cbfc tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1571 microversion: 2.53 time: 1.068825 Jul 28 10:31:34.739464 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 154/357] 10.222.0.46 () {60 vars in 1243 bytes} [Thu Jul 28 10:31:33 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1571 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:31:34.758774 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d3ac90ef-2d47-48d4-832c-d9375cd0320a tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Calling method '.version_select at 0x7fa95808d8b0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:34.773010 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:34.773010 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:31:34.781326 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d3ac90ef-2d47-48d4-832c-d9375cd0320a tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:34.782600 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d3ac90ef-2d47-48d4-832c-d9375cd0320a tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:34.820776 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d3ac90ef-2d47-48d4-832c-d9375cd0320a tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:34.821974 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d3ac90ef-2d47-48d4-832c-d9375cd0320a tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:34.841300 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d3ac90ef-2d47-48d4-832c-d9375cd0320a tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:34.842317 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d3ac90ef-2d47-48d4-832c-d9375cd0320a tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:34.868504 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d3ac90ef-2d47-48d4-832c-d9375cd0320a tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:34.869201 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d3ac90ef-2d47-48d4-832c-d9375cd0320a tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:34.888726 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d3ac90ef-2d47-48d4-832c-d9375cd0320a tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:34.890028 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d3ac90ef-2d47-48d4-832c-d9375cd0320a tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:34.905973 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d3ac90ef-2d47-48d4-832c-d9375cd0320a tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 265 microversion: 2.53 time: 0.151805 Jul 28 10:31:34.916496 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 155/358] 10.222.0.46 () {60 vars in 1222 bytes} [Thu Jul 28 10:31:34 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:31:34.933513 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f1002f7c-3d15-42bd-9e46-92de19e60ef4 tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Calling method '.version_select at 0x7fa94bfee8b0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:34.944610 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:34.944610 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:31:34.958998 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f1002f7c-3d15-42bd-9e46-92de19e60ef4 tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:34.959634 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f1002f7c-3d15-42bd-9e46-92de19e60ef4 tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:35.028260 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f1002f7c-3d15-42bd-9e46-92de19e60ef4 tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:35.031181 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f1002f7c-3d15-42bd-9e46-92de19e60ef4 tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:35.062457 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f1002f7c-3d15-42bd-9e46-92de19e60ef4 tempest-HypervisorAdminV253TestBase-805252278 tempest-HypervisorAdminV253TestBase-805252278-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/13cef5b7-6bfc-4b49-8b47-78eeae5e453e" status: 200 len: 791 microversion: 2.53 time: 0.135639 Jul 28 10:31:35.068558 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 156/359] 10.222.0.46 () {60 vars in 1298 bytes} [Thu Jul 28 10:31:34 2022] GET /compute/v2.1/os-hypervisors/13cef5b7-6bfc-4b49-8b47-78eeae5e453e => generated 791 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:31:37.213600 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-873a872b-1bf5-40df-9312-df489d7c9ac3 tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.102995 Jul 28 10:31:37.214826 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 204/360] 10.222.0.46 () {60 vars in 1170 bytes} [Thu Jul 28 10:31:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:37.227841 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-76756caa-41ae-49c4-9366-aaab96621ba8 tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] Calling method '.version_select at 0x7fa9580425e0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:37.855709 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=65 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:38.052069 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=7,nova_api:UPDATE=4,nova_api:DELETE=3 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:38.122541 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-76756caa-41ae-49c4-9366-aaab96621ba8 tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips/c07ec787-c43d-4ae9-8ca4-9b39f5f289e0" status: 200 len: 142 microversion: 2.1 time: 0.899555 Jul 28 10:31:38.123420 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 157/361] 10.222.0.46 () {58 vars in 1260 bytes} [Thu Jul 28 10:31:37 2022] GET /compute/v2.1/os-floating-ips/c07ec787-c43d-4ae9-8ca4-9b39f5f289e0 => generated 142 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:38.136081 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ca81c0b7-9475-430d-9011-0b1e0e70f3af tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] Calling method '.version_select at 0x7fa9580220d0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:38.237018 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=47 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:38.490073 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ca81c0b7-9475-430d-9011-0b1e0e70f3af tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.357728 Jul 28 10:31:38.490964 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 158/362] 10.222.0.46 () {58 vars in 1149 bytes} [Thu Jul 28 10:31:38 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:38.697962 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ebf0b062-343d-4add-baa3-daf083ac77b0 tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] Action: 'update', calling method: .version_select at 0x7fa94bda55e0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:39.397457 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-750e23f5-52b4-46d8-8d65-c61b461b49fd tempest-SecurityGroupsTestAdminJSON-1963420539 tempest-SecurityGroupsTestAdminJSON-1963420539-project] Action: 'create', calling method: .version_select at 0x7fa94bfed4c0>, body: {"security_group": {"name": "tempest-securitygroup-888734545", "description": "tempest-description-1720325465"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:39.738627 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ebf0b062-343d-4add-baa3-daf083ac77b0 tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:39.740330 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ebf0b062-343d-4add-baa3-daf083ac77b0 tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:39.742131 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ebf0b062-343d-4add-baa3-daf083ac77b0 tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:39.744104 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ebf0b062-343d-4add-baa3-daf083ac77b0 tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:39.886944 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ebf0b062-343d-4add-baa3-daf083ac77b0 tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/7c8ba3e674dc43d99b941c61917147ea" status: 200 len: 148 microversion: 2.57 time: 2.030784 Jul 28 10:31:39.889327 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 205/363] 10.222.0.46 () {62 vars in 1303 bytes} [Thu Jul 28 10:31:37 2022] PUT /compute/v2.1/os-quota-sets/7c8ba3e674dc43d99b941c61917147ea => generated 148 bytes in 2035 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:31:39.898697 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e901ec14-dfb4-4c2f-a9c4-9fedabe086ec tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] Calling method '.version_select at 0x7fa94bdb7ca0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:39.994784 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-750e23f5-52b4-46d8-8d65-c61b461b49fd tempest-SecurityGroupsTestAdminJSON-1963420539 tempest-SecurityGroupsTestAdminJSON-1963420539-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.502541 Jul 28 10:31:39.995810 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 159/364] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:31:38 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:40.000889 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-37b32fb5-bca7-4526-9963-3185403ee8ec tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] Calling method '.version_select at 0x7fa94bfedee0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:40.770484 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-37b32fb5-bca7-4526-9963-3185403ee8ec tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:40.772879 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-37b32fb5-bca7-4526-9963-3185403ee8ec tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:40.776764 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-37b32fb5-bca7-4526-9963-3185403ee8ec tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:40.777401 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-37b32fb5-bca7-4526-9963-3185403ee8ec tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:40.805144 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:DELETE=4,nova_cell0:SELECT=45,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:40.827082 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-37b32fb5-bca7-4526-9963-3185403ee8ec tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/7c8ba3e674dc43d99b941c61917147ea/detail" status: 200 len: 463 microversion: 2.57 time: 0.829970 Jul 28 10:31:40.837892 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 160/365] 10.222.0.46 () {60 vars in 1304 bytes} [Thu Jul 28 10:31:39 2022] GET /compute/v2.1/os-quota-sets/7c8ba3e674dc43d99b941c61917147ea/detail => generated 463 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:31:40.843561 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-82f3143d-6dc2-4566-8b3b-6f3880b93388 tempest-SecurityGroupsTestAdminJSON-1963420539 tempest-SecurityGroupsTestAdminJSON-1963420539-project] Action: 'create', calling method: .version_select at 0x7fa958042d30>, body: {"security_group": {"name": "tempest-securitygroup-70415339", "description": "tempest-description-1024253109"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:41.050820 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e901ec14-dfb4-4c2f-a9c4-9fedabe086ec tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/c07ec787-c43d-4ae9-8ca4-9b39f5f289e0" status: 202 len: 0 microversion: 2.1 time: 1.159760 Jul 28 10:31:41.052471 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 206/366] 10.222.0.46 () {58 vars in 1263 bytes} [Thu Jul 28 10:31:39 2022] DELETE /compute/v2.1/os-floating-ips/c07ec787-c43d-4ae9-8ca4-9b39f5f289e0 => generated 0 bytes in 1162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:31:41.062089 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8538377f-50d5-43cf-98f7-f90984eb20ca tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] Action: 'create', calling method: .version_select at 0x7fa94bda5940>, body: {"pool": null} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:41.167571 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-82f3143d-6dc2-4566-8b3b-6f3880b93388 tempest-SecurityGroupsTestAdminJSON-1963420539 tempest-SecurityGroupsTestAdminJSON-1963420539-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.328351 Jul 28 10:31:41.168787 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 161/367] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:31:40 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:41.592695 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-564d99bd-2195-480c-ad41-6cba9ed2198f tempest-SecurityGroupsTestAdminJSON-1787477959 tempest-SecurityGroupsTestAdminJSON-1787477959-project-admin] Action: 'create', calling method: .version_select at 0x7fa958042040>, body: {"security_group": {"name": "tempest-securitygroup-922744729", "description": "tempest-description-1990445705"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:41.990659 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-564d99bd-2195-480c-ad41-6cba9ed2198f tempest-SecurityGroupsTestAdminJSON-1787477959 tempest-SecurityGroupsTestAdminJSON-1787477959-project-admin] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.813067 Jul 28 10:31:41.991739 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 162/368] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:31:41 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:41.996510 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-421b60f1-0936-46b1-86cd-bf6f9019fdf6 tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] Action: 'update', calling method: .version_select at 0x7fa9580224c0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:42.509144 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-421b60f1-0936-46b1-86cd-bf6f9019fdf6 tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:42.511470 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-421b60f1-0936-46b1-86cd-bf6f9019fdf6 tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:42.512316 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-421b60f1-0936-46b1-86cd-bf6f9019fdf6 tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:42.512755 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-421b60f1-0936-46b1-86cd-bf6f9019fdf6 tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:42.578086 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-421b60f1-0936-46b1-86cd-bf6f9019fdf6 tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:42.578808 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-421b60f1-0936-46b1-86cd-bf6f9019fdf6 tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:42.580103 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-421b60f1-0936-46b1-86cd-bf6f9019fdf6 tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:42.580687 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-421b60f1-0936-46b1-86cd-bf6f9019fdf6 tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:42.659696 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-421b60f1-0936-46b1-86cd-bf6f9019fdf6 tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/7c8ba3e674dc43d99b941c61917147ea?user_id=224c20b9b7be41d2b16b5ed43e5cfb54" status: 200 len: 148 microversion: 2.57 time: 0.666450 Jul 28 10:31:42.661609 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 163/369] 10.222.0.46 () {62 vars in 1384 bytes} [Thu Jul 28 10:31:41 2022] PUT /compute/v2.1/os-quota-sets/7c8ba3e674dc43d99b941c61917147ea?user_id=224c20b9b7be41d2b16b5ed43e5cfb54 => generated 148 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:31:42.667868 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a8ecb327-6e4f-4d9e-b71c-c28c2456a174 tempest-SecurityGroupsTestAdminJSON-1787477959 tempest-SecurityGroupsTestAdminJSON-1787477959-project-admin] Action: 'create', calling method: .version_select at 0x7fa94bf87ca0>, body: {"security_group": {"name": "tempest-securitygroup-620397804", "description": "tempest-description-997268661"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:42.742940 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-8538377f-50d5-43cf-98f7-f90984eb20ca tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.684826 Jul 28 10:31:42.744015 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 207/370] 10.222.0.46 () {60 vars in 1170 bytes} [Thu Jul 28 10:31:41 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:42.749053 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-cf3b58c6-193b-466f-bb05-3ede3ba42e81 tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] Calling method '.version_select at 0x7fa94bda5550>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:42.901834 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a8ecb327-6e4f-4d9e-b71c-c28c2456a174 tempest-SecurityGroupsTestAdminJSON-1787477959 tempest-SecurityGroupsTestAdminJSON-1787477959-project-admin] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.238803 Jul 28 10:31:42.902546 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 164/371] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:31:42 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:42.908464 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3adda69a-77d0-4617-be7a-2ea7e8dc9a22 tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] Calling method '.version_select at 0x7fa94bf87280>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:43.351199 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-cf3b58c6-193b-466f-bb05-3ede3ba42e81 tempest-QuotasAdminTestV257-1864726939 tempest-QuotasAdminTestV257-1864726939-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/7c8ba3e674dc43d99b941c61917147ea?user_id=224c20b9b7be41d2b16b5ed43e5cfb54" status: 200 len: 190 microversion: 2.57 time: 0.605609 Jul 28 10:31:43.353178 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 208/372] 10.222.0.46 () {60 vars in 1364 bytes} [Thu Jul 28 10:31:42 2022] GET /compute/v2.1/os-quota-sets/7c8ba3e674dc43d99b941c61917147ea?user_id=224c20b9b7be41d2b16b5ed43e5cfb54 => generated 190 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:31:43.360560 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-dd7df843-cdaa-4af5-837a-d8572f5cfb73 tempest-SecurityGroupsTestAdminJSON-1787477959 tempest-SecurityGroupsTestAdminJSON-1787477959-project-admin] Calling method '.version_select at 0x7fa94bdb7820>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:43.985655 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3adda69a-77d0-4617-be7a-2ea7e8dc9a22 tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/f09e772b-416c-4525-9baf-7d29bc06a998" status: 202 len: 0 microversion: 2.1 time: 1.082141 Jul 28 10:31:43.989810 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 165/373] 10.222.0.46 () {58 vars in 1263 bytes} [Thu Jul 28 10:31:42 2022] DELETE /compute/v2.1/os-floating-ips/f09e772b-416c-4525-9baf-7d29bc06a998 => generated 0 bytes in 1084 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:31:43.995694 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c37a7008-141f-40f9-a5b3-a9515d5eff91 tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] Calling method '.version_select at 0x7fa94bfed160>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:44.059094 n-d-850468-6 devstack@n-api.service[119463]: DEBUG neutronclient.v2_0.client [None req-c37a7008-141f-40f9-a5b3-a9515d5eff91 tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f09e772b-416c-4525-9baf-7d29bc06a998 could not be found", "detail": ""}} {{(pid=119463) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 10:31:44.059942 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-c37a7008-141f-40f9-a5b3-a9515d5eff91 tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] HTTP exception thrown: Floating IP not found for ID f09e772b-416c-4525-9baf-7d29bc06a998 Jul 28 10:31:44.073354 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c37a7008-141f-40f9-a5b3-a9515d5eff91 tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] Request method failure captured: Jul 28 10:31:44.073354 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/os-floating-ips/f09e772b-416c-4525-9baf-7d29bc06a998 HTTP/1.1 Jul 28 10:31:44.073354 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:31:44.073354 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:31:44.073354 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:31:44.073354 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:31:44.073354 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:31:44.073354 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:31:44.073354 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:31:44.073354 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:44.073354 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mWApOwAR-DmxIdpl8hZlKxln6LE7TUkIyWiESW978r_qBoStnn6ttEsLWnDw-e7nBTaDQjHg7kfravioHfjmDNXd0TnhPO6loMSKJAakgPO5KqfTSWKYsJrKvzilQbImqeSCAJX3tnxVDOa2c7qL5rtZElhunohT92grshTlFhZPv8 Jul 28 10:31:44.073354 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:31:44.073354 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:31:44.073354 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:31:44.073354 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:31:44.073354 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:31:44.073354 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:31:44.073354 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: e0eb3b2a22c446e68cca910b8d40ca12 Jul 28 10:31:44.073354 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-FloatingIPsTestJSON-500781076 Jul 28 10:31:44.073354 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:31:44.073354 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:31:44.075048 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e0eb3b2a22c446e68cca910b8d40ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e0eb3b2a22c446e68cca910b8d40ca12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e0eb3b2a22c446e68cca910b8d40ca12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e0eb3b2a22c446e68cca910b8d40ca12", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:44.075048 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-FloatingIPsTestJSON-500781076 Jul 28 10:31:44.075048 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: e0eb3b2a22c446e68cca910b8d40ca12 Jul 28 10:31:44.075048 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-FloatingIPsTestJSON-500781076 Jul 28 10:31:44.075048 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-FloatingIPsTestJSON-500781076-project Jul 28 10:31:44.075048 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:31:44.075048 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:31:44.075048 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 5134f685641244db8273f06e943b2f60 Jul 28 10:31:44.075048 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-FloatingIPsTestJSON-500781076-project Jul 28 10:31:44.075048 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:31:44.075048 n-d-850468-6 devstack@n-api.service[119463]: exception: Floating IP not found for ID f09e772b-416c-4525-9baf-7d29bc06a998 Jul 28 10:31:44.075048 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'f09e772b-416c-4525-9baf-7d29bc06a998'} Jul 28 10:31:44.075048 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:44.075941 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:44.075941 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 28 10:31:44.075941 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 28 10:31:44.075941 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:31:44.075941 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:31:44.075941 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 28 10:31:44.075941 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 28 10:31:44.075941 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:31:44.075941 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:31:44.075941 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 10:31:44.075941 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 10:31:44.075941 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:31:44.075941 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:31:44.075941 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 10:31:44.075941 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 10:31:44.075941 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:31:44.075941 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:31:44.075941 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 10:31:44.075941 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 10:31:44.077282 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:31:44.077282 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:31:44.077282 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 10:31:44.077282 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 10:31:44.077282 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 10:31:44.077282 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 10:31:44.077282 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f09e772b-416c-4525-9baf-7d29bc06a998 could not be found Jul 28 10:31:44.077282 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40798ba3-4985-48c3-bd07-2b9737b20699'] Jul 28 10:31:44.077282 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:44.077282 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:44.077282 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:44.077282 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:44.077282 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 28 10:31:44.077282 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 28 10:31:44.077282 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 28 10:31:44.077282 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 28 10:31:44.077282 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f09e772b-416c-4525-9baf-7d29bc06a998. Jul 28 10:31:44.077282 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:44.077282 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:44.077282 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:44.078654 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:44.078654 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:44.078654 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:44.078654 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:44.078654 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:44.078654 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:31:44.078654 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:31:44.078654 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:44.078654 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:44.078654 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 28 10:31:44.078654 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 10:31:44.078654 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f09e772b-416c-4525-9baf-7d29bc06a998 Jul 28 10:31:44.078654 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:44.078654 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:44.078654 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:44.078654 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:44.078654 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:44.078654 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:44.078654 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:31:44.078654 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:31:44.080076 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f09e772b-416c-4525-9baf-7d29bc06a998 Jul 28 10:31:44.080076 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:44.080076 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c37a7008-141f-40f9-a5b3-a9515d5eff91 tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] Returning 404 to user: Floating IP not found for ID f09e772b-416c-4525-9baf-7d29bc06a998 {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:44.081164 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c37a7008-141f-40f9-a5b3-a9515d5eff91 tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips/f09e772b-416c-4525-9baf-7d29bc06a998" status: 404 len: 111 microversion: 2.1 time: 0.089921 Jul 28 10:31:44.082671 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 166/374] 10.222.0.46 () {58 vars in 1260 bytes} [Thu Jul 28 10:31:43 2022] GET /compute/v2.1/os-floating-ips/f09e772b-416c-4525-9baf-7d29bc06a998 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:31:44.093128 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-fcbadbea-805f-4def-bcea-de07ebd86f24 tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] Calling method '.version_select at 0x7fa94bfed8b0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:44.153170 n-d-850468-6 devstack@n-api.service[119463]: DEBUG neutronclient.v2_0.client [None req-fcbadbea-805f-4def-bcea-de07ebd86f24 tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f09e772b-416c-4525-9baf-7d29bc06a998 could not be found", "detail": ""}} {{(pid=119463) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 10:31:44.153954 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-fcbadbea-805f-4def-bcea-de07ebd86f24 tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] HTTP exception thrown: Floating IP not found for ID f09e772b-416c-4525-9baf-7d29bc06a998 Jul 28 10:31:44.155674 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-fcbadbea-805f-4def-bcea-de07ebd86f24 tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] Request method failure captured: Jul 28 10:31:44.155674 n-d-850468-6 devstack@n-api.service[119463]: request: DELETE /compute/v2.1/os-floating-ips/f09e772b-416c-4525-9baf-7d29bc06a998 HTTP/1.1 Jul 28 10:31:44.155674 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:31:44.155674 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:31:44.155674 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:31:44.155674 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:31:44.155674 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:31:44.155674 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:31:44.155674 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:31:44.155674 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:44.155674 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mWApOwAR-DmxIdpl8hZlKxln6LE7TUkIyWiESW978r_qBoStnn6ttEsLWnDw-e7nBTaDQjHg7kfravioHfjmDNXd0TnhPO6loMSKJAakgPO5KqfTSWKYsJrKvzilQbImqeSCAJX3tnxVDOa2c7qL5rtZElhunohT92grshTlFhZPv8 Jul 28 10:31:44.155674 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:31:44.155674 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:31:44.155674 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:31:44.155674 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:31:44.155674 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:31:44.155674 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:31:44.155674 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: e0eb3b2a22c446e68cca910b8d40ca12 Jul 28 10:31:44.155674 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-FloatingIPsTestJSON-500781076 Jul 28 10:31:44.155674 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:31:44.155674 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:31:44.157415 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e0eb3b2a22c446e68cca910b8d40ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e0eb3b2a22c446e68cca910b8d40ca12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e0eb3b2a22c446e68cca910b8d40ca12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e0eb3b2a22c446e68cca910b8d40ca12", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:44.157415 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-FloatingIPsTestJSON-500781076 Jul 28 10:31:44.157415 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: e0eb3b2a22c446e68cca910b8d40ca12 Jul 28 10:31:44.157415 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-FloatingIPsTestJSON-500781076 Jul 28 10:31:44.157415 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-FloatingIPsTestJSON-500781076-project Jul 28 10:31:44.157415 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:31:44.157415 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:31:44.157415 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 5134f685641244db8273f06e943b2f60 Jul 28 10:31:44.157415 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-FloatingIPsTestJSON-500781076-project Jul 28 10:31:44.157415 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:31:44.157415 n-d-850468-6 devstack@n-api.service[119463]: exception: Floating IP not found for ID f09e772b-416c-4525-9baf-7d29bc06a998 Jul 28 10:31:44.157415 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'f09e772b-416c-4525-9baf-7d29bc06a998'} Jul 28 10:31:44.157415 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:44.158327 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:44.158327 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 28 10:31:44.158327 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 28 10:31:44.158327 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:31:44.158327 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:31:44.158327 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 28 10:31:44.158327 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 28 10:31:44.158327 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:31:44.158327 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:31:44.158327 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 10:31:44.158327 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 10:31:44.158327 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:31:44.158327 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:31:44.158327 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 10:31:44.158327 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 10:31:44.158327 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:31:44.158327 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:31:44.158327 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 10:31:44.158327 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 10:31:44.159593 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:31:44.159593 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:31:44.159593 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 10:31:44.159593 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 10:31:44.159593 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 10:31:44.159593 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 10:31:44.159593 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f09e772b-416c-4525-9baf-7d29bc06a998 could not be found Jul 28 10:31:44.159593 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb3468f1-865e-4cf0-b5be-24d09a5781d8'] Jul 28 10:31:44.159593 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:44.159593 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:44.159593 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:44.159593 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:44.159593 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 28 10:31:44.159593 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 28 10:31:44.159593 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 28 10:31:44.159593 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 28 10:31:44.159593 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f09e772b-416c-4525-9baf-7d29bc06a998. Jul 28 10:31:44.159593 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:44.159593 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:44.159593 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:44.161294 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:44.161294 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:44.161294 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:44.161294 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:44.161294 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:44.161294 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:31:44.161294 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:31:44.161294 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:44.161294 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:44.161294 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 28 10:31:44.161294 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 10:31:44.161294 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f09e772b-416c-4525-9baf-7d29bc06a998 Jul 28 10:31:44.161294 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:44.161294 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:44.161294 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:44.161294 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:44.161294 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:44.161294 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:44.161294 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:31:44.161294 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:31:44.162669 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f09e772b-416c-4525-9baf-7d29bc06a998 Jul 28 10:31:44.162669 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:44.162669 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-fcbadbea-805f-4def-bcea-de07ebd86f24 tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] Returning 404 to user: Floating IP not found for ID f09e772b-416c-4525-9baf-7d29bc06a998 {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:44.162669 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-fcbadbea-805f-4def-bcea-de07ebd86f24 tempest-FloatingIPsTestJSON-500781076 tempest-FloatingIPsTestJSON-500781076-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/f09e772b-416c-4525-9baf-7d29bc06a998" status: 404 len: 111 microversion: 2.1 time: 0.069573 Jul 28 10:31:44.164760 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 167/375] 10.222.0.46 () {58 vars in 1263 bytes} [Thu Jul 28 10:31:44 2022] DELETE /compute/v2.1/os-floating-ips/f09e772b-416c-4525-9baf-7d29bc06a998 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:31:45.005463 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b38f3752-63c0-4bbc-975b-42999e772196 tempest-QuotaClassesAdmin257Test-1328897551 tempest-QuotaClassesAdmin257Test-1328897551-project-admin] Calling method '.version_select at 0x7fa94bf871f0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:45.007485 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:45.007485 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:31:45.046335 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b38f3752-63c0-4bbc-975b-42999e772196 tempest-QuotaClassesAdmin257Test-1328897551 tempest-QuotaClassesAdmin257Test-1328897551-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.518075 Jul 28 10:31:45.058958 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 168/376] 10.222.0.46 () {60 vars in 1226 bytes} [Thu Jul 28 10:31:44 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:31:45.068032 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f370208e-e225-45e6-8ab1-2052b59d1594 tempest-QuotaClassesAdmin257Test-1328897551 tempest-QuotaClassesAdmin257Test-1328897551-project-admin] Action: 'update', calling method: .version_select at 0x7fa94bfeddc0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:45.073463 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:45.073463 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:31:45.297625 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=8,nova_api:UPDATE=5 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:45.417707 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-dd7df843-cdaa-4af5-837a-d8572f5cfb73 tempest-SecurityGroupsTestAdminJSON-1787477959 tempest-SecurityGroupsTestAdminJSON-1787477959-project-admin] 10.222.0.46 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 6249 microversion: 2.1 time: 2.062923 Jul 28 10:31:45.418741 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 209/377] 10.222.0.46 () {58 vars in 1191 bytes} [Thu Jul 28 10:31:43 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 6249 bytes in 2065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:31:45.439411 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-3702c118-beca-4f1f-81aa-3f12ccd9cb1b tempest-SecurityGroupsTestAdminJSON-1963420539 tempest-SecurityGroupsTestAdminJSON-1963420539-project] Calling method '.version_select at 0x7fa94bd96280>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:45.506064 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f370208e-e225-45e6-8ab1-2052b59d1594 tempest-QuotaClassesAdmin257Test-1328897551 tempest-QuotaClassesAdmin257Test-1328897551-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.442609 Jul 28 10:31:45.512138 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 169/378] 10.222.0.46 () {62 vars in 1247 bytes} [Thu Jul 28 10:31:45 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:31:45.527968 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-18fca256-0657-40ad-b68c-02075960f3c5 tempest-QuotaClassesAdmin257Test-1328897551 tempest-QuotaClassesAdmin257Test-1328897551-project-admin] Calling method '.version_select at 0x7fa94bfed9d0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:45.544204 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-18fca256-0657-40ad-b68c-02075960f3c5 tempest-QuotaClassesAdmin257Test-1328897551 tempest-QuotaClassesAdmin257Test-1328897551-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.024751 Jul 28 10:31:45.546294 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 170/379] 10.222.0.46 () {60 vars in 1226 bytes} [Thu Jul 28 10:31:45 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:31:45.560193 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-89282061-0e0d-4fe2-b831-b32c5bfd2e9c tempest-QuotaClassesAdmin257Test-1328897551 tempest-QuotaClassesAdmin257Test-1328897551-project-admin] Action: 'update', calling method: .version_select at 0x7fa94bfed8b0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:45.696400 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-89282061-0e0d-4fe2-b831-b32c5bfd2e9c tempest-QuotaClassesAdmin257Test-1328897551 tempest-QuotaClassesAdmin257Test-1328897551-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.141229 Jul 28 10:31:45.707588 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 171/380] 10.222.0.46 () {62 vars in 1247 bytes} [Thu Jul 28 10:31:45 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:31:46.640036 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-3702c118-beca-4f1f-81aa-3f12ccd9cb1b tempest-SecurityGroupsTestAdminJSON-1963420539 tempest-SecurityGroupsTestAdminJSON-1963420539-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 1.205046 Jul 28 10:31:46.642824 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 210/381] 10.222.0.46 () {58 vars in 1191 bytes} [Thu Jul 28 10:31:45 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:31:46.689540 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4be6c90c-27f9-404b-86ea-fbc4239bf39b tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Calling method '.version_select at 0x7fa94beeca60>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:46.694238 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:46.694238 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:31:46.695748 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4be6c90c-27f9-404b-86ea-fbc4239bf39b tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:46.696205 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4be6c90c-27f9-404b-86ea-fbc4239bf39b tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:46.699805 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4be6c90c-27f9-404b-86ea-fbc4239bf39b tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:46.701463 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4be6c90c-27f9-404b-86ea-fbc4239bf39b tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:46.716138 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=51 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:46.787279 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-4be6c90c-27f9-404b-86ea-fbc4239bf39b tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 1.018499 Jul 28 10:31:46.794085 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 172/382] 10.222.0.46 () {58 vars in 1128 bytes} [Thu Jul 28 10:31:45 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:46.798622 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-97786e05-6615-467b-9d2f-3d2340cf4603 tempest-SecurityGroupsTestAdminJSON-1787477959 tempest-SecurityGroupsTestAdminJSON-1787477959-project-admin] Calling method '.version_select at 0x7fa94beecaf0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:46.994244 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-80ef2447-9fd8-42d8-b58d-167cb76bed42 tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Calling method '.version_select at 0x7fa94bd8af70>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:46.996050 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:46.996050 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:31:46.998971 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-80ef2447-9fd8-42d8-b58d-167cb76bed42 tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:46.999436 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-80ef2447-9fd8-42d8-b58d-167cb76bed42 tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:47.034050 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-80ef2447-9fd8-42d8-b58d-167cb76bed42 tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:47.037246 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-80ef2447-9fd8-42d8-b58d-167cb76bed42 tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:47.068931 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-80ef2447-9fd8-42d8-b58d-167cb76bed42 tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:47.069722 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-80ef2447-9fd8-42d8-b58d-167cb76bed42 tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:47.080396 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-80ef2447-9fd8-42d8-b58d-167cb76bed42 tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.435559 Jul 28 10:31:47.084186 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 211/383] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:31:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:47.337508 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-18b5741f-d406-48c8-8650-a8be30cf1e09 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Calling method '.version_select at 0x7fa94bd8a790>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:47.340904 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:47.340904 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:31:47.343210 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-18b5741f-d406-48c8-8650-a8be30cf1e09 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'f03613a7c9164790ad86f4965bc709f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28236ff7f54d4b8a90ac3dad03d72884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:47.347819 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-18b5741f-d406-48c8-8650-a8be30cf1e09 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Request method failure captured: Jul 28 10:31:47.347819 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 28 10:31:47.347819 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:31:47.347819 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:31:47.347819 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:31:47.347819 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:31:47.347819 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:31:47.347819 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:31:47.347819 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:31:47.347819 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:47.347819 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWOuS6Ii21c3EG98eVwPlu-235aenOSvLlNIOS0B3dQFTltJHzBACzWo0Iff76nJg3eMIOyTl00p84zcnRtZwEtkBfZ2W5Bu-viOZiyLGvf1PatSWdlHQWSxm15S73sqkc0fv2IsaUnwVqFADBX-VNdpk10gJhoKSevQQpXmAr7T1U Jul 28 10:31:47.347819 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:31:47.347819 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:31:47.347819 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:31:47.347819 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:31:47.347819 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:31:47.347819 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:31:47.347819 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 28236ff7f54d4b8a90ac3dad03d72884 Jul 28 10:31:47.347819 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-856952922 Jul 28 10:31:47.347819 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:31:47.347819 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:31:47.349283 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/28236ff7f54d4b8a90ac3dad03d72884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/28236ff7f54d4b8a90ac3dad03d72884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/28236ff7f54d4b8a90ac3dad03d72884"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_28236ff7f54d4b8a90ac3dad03d72884", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:47.349283 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-HostsAdminNegativeTestJSON-856952922 Jul 28 10:31:47.349283 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 28236ff7f54d4b8a90ac3dad03d72884 Jul 28 10:31:47.349283 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-856952922 Jul 28 10:31:47.349283 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-HostsAdminNegativeTestJSON-856952922-project Jul 28 10:31:47.349283 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:31:47.349283 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:31:47.349283 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: f03613a7c9164790ad86f4965bc709f1 Jul 28 10:31:47.349283 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-HostsAdminNegativeTestJSON-856952922-project Jul 28 10:31:47.349283 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:31:47.349283 n-d-850468-6 devstack@n-api.service[119464]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 28 10:31:47.349283 n-d-850468-6 devstack@n-api.service[119464]: action_args: {} Jul 28 10:31:47.349283 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:47.350250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:47.350250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:47.350250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:47.350250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:47.350250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:47.350250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:31:47.350250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:31:47.350250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 10:31:47.350250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:31:47.350250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:47.350250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:47.350250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 28 10:31:47.350250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 28 10:31:47.350250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:31:47.350250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:31:47.350250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:31:47.350250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:31:47.350250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:31:47.350250 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:31:47.351632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:31:47.351632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:31:47.351632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:31:47.351632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:31:47.351632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:31:47.351632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:31:47.351632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:31:47.351632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:31:47.351632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 28 10:31:47.351632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:47.351632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:47.351632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:47.351632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:47.351632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:47.351632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:47.351632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:31:47.351632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:31:47.351632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 28 10:31:47.351632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:47.356787 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-18b5741f-d406-48c8-8650-a8be30cf1e09 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:47.358662 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-18b5741f-d406-48c8-8650-a8be30cf1e09 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] 10.222.0.46 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.273296 Jul 28 10:31:47.361917 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 212/384] 10.222.0.46 () {58 vars in 1128 bytes} [Thu Jul 28 10:31:47 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 277 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:31:47.612543 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-97786e05-6615-467b-9d2f-3d2340cf4603 tempest-SecurityGroupsTestAdminJSON-1787477959 tempest-SecurityGroupsTestAdminJSON-1787477959-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/700b4d1b-68fb-491b-bdd9-b76ca9981556" status: 202 len: 0 microversion: 2.1 time: 0.819123 Jul 28 10:31:47.616072 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 173/385] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:31:46 2022] DELETE /compute/v2.1/os-security-groups/700b4d1b-68fb-491b-bdd9-b76ca9981556 => generated 0 bytes in 821 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:31:47.622475 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-715cdba1-4a48-49e8-99b3-184bb0606946 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Calling method '.version_select at 0x7fa94beecca0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:47.623539 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:47.623539 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:31:47.626113 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-715cdba1-4a48-49e8-99b3-184bb0606946 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'f03613a7c9164790ad86f4965bc709f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28236ff7f54d4b8a90ac3dad03d72884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:47.631505 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-715cdba1-4a48-49e8-99b3-184bb0606946 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Request method failure captured: Jul 28 10:31:47.631505 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/os-hosts/n-d-850468-6/reboot HTTP/1.1 Jul 28 10:31:47.631505 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:31:47.631505 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:31:47.631505 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:31:47.631505 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:31:47.631505 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:31:47.631505 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:31:47.631505 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:31:47.631505 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:47.631505 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mWOuS6Ii21c3EG98eVwPlu-235aenOSvLlNIOS0B3dQFTltJHzBACzWo0Iff76nJg3eMIOyTl00p84zcnRtZwEtkBfZ2W5Bu-viOZiyLGvf1PatSWdlHQWSxm15S73sqkc0fv2IsaUnwVqFADBX-VNdpk10gJhoKSevQQpXmAr7T1U Jul 28 10:31:47.631505 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:31:47.631505 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:31:47.631505 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:31:47.631505 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:31:47.631505 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:31:47.631505 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:31:47.631505 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 28236ff7f54d4b8a90ac3dad03d72884 Jul 28 10:31:47.631505 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-856952922 Jul 28 10:31:47.631505 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:31:47.631505 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:31:47.632964 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/28236ff7f54d4b8a90ac3dad03d72884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/28236ff7f54d4b8a90ac3dad03d72884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/28236ff7f54d4b8a90ac3dad03d72884"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_28236ff7f54d4b8a90ac3dad03d72884", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:47.632964 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-HostsAdminNegativeTestJSON-856952922 Jul 28 10:31:47.632964 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 28236ff7f54d4b8a90ac3dad03d72884 Jul 28 10:31:47.632964 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-856952922 Jul 28 10:31:47.632964 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-HostsAdminNegativeTestJSON-856952922-project Jul 28 10:31:47.632964 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:31:47.632964 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:31:47.632964 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: f03613a7c9164790ad86f4965bc709f1 Jul 28 10:31:47.632964 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-HostsAdminNegativeTestJSON-856952922-project Jul 28 10:31:47.632964 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:31:47.632964 n-d-850468-6 devstack@n-api.service[119463]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 28 10:31:47.632964 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'n-d-850468-6'} Jul 28 10:31:47.632964 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:47.633888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:47.633888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:47.633888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:47.633888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:47.633888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:47.633888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:31:47.633888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:31:47.633888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:47.633888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:47.633888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 28 10:31:47.633888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 28 10:31:47.633888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:31:47.633888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:31:47.633888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:31:47.633888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:31:47.633888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:31:47.633888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:31:47.633888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:31:47.633888 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:31:47.635240 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:31:47.635240 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:31:47.635240 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:31:47.635240 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:31:47.635240 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:31:47.635240 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:31:47.635240 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 28 10:31:47.635240 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:47.635240 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:47.635240 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:47.635240 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:47.635240 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:47.635240 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:47.635240 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:31:47.635240 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:31:47.635240 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 28 10:31:47.635240 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:47.637312 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-715cdba1-4a48-49e8-99b3-184bb0606946 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:47.640744 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-715cdba1-4a48-49e8-99b3-184bb0606946 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] 10.222.0.46 "GET /compute/v2.1/os-hosts/n-d-850468-6/reboot" status: 403 len: 111 microversion: 2.1 time: 0.022688 Jul 28 10:31:47.642997 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 174/386] 10.222.0.46 () {58 vars in 1188 bytes} [Thu Jul 28 10:31:47 2022] GET /compute/v2.1/os-hosts/n-d-850468-6/reboot => generated 111 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:31:47.655466 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-22206243-6368-4027-a940-f65688ae07f7 tempest-SecurityGroupsTestAdminJSON-1787477959 tempest-SecurityGroupsTestAdminJSON-1787477959-project-admin] Calling method '.version_select at 0x7fa94bfed700>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:47.941646 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-21b08f51-9ef6-4df3-8b85-1384fb99ffdd tempest-HypervisorAdminNegativeUnderV252Test-520043596 tempest-HypervisorAdminNegativeUnderV252Test-520043596-project] Calling method '.version_select at 0x7fa94bda5790>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:47.942632 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:47.942632 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:31:47.944042 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-21b08f51-9ef6-4df3-8b85-1384fb99ffdd tempest-HypervisorAdminNegativeUnderV252Test-520043596 tempest-HypervisorAdminNegativeUnderV252Test-520043596-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '94166124c7214ec18fe938dbb903c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ed5e536944d848725f42cd9b813c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:47.947742 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-21b08f51-9ef6-4df3-8b85-1384fb99ffdd tempest-HypervisorAdminNegativeUnderV252Test-520043596 tempest-HypervisorAdminNegativeUnderV252Test-520043596-project] Request method failure captured: Jul 28 10:31:47.947742 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-hypervisors/n-h2-850468-6/search HTTP/1.1 Jul 28 10:31:47.947742 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:31:47.947742 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:31:47.947742 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:31:47.947742 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:31:47.947742 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:31:47.947742 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:31:47.947742 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:31:47.947742 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:47.947742 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWP1s7YVs_J_QGMy7Sp13gs28_acfIop02G7zqlG-NM9tt1CsI1C7UthcpYkLLCUabPQ9c-c-i6yXLlvQbBwose4IZ-WVYgPCXK7mLPogCcUePwn-rRkFHK-XNx-CwKzRi11xTq6OZdOiXNsXTt1N6tKcy9tSQPyZTa2SrrGk4g4iY Jul 28 10:31:47.947742 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:31:47.947742 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:31:47.947742 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:31:47.947742 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:31:47.947742 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:31:47.947742 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:31:47.947742 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: f44ed5e536944d848725f42cd9b813c6 Jul 28 10:31:47.947742 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-520043596 Jul 28 10:31:47.947742 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:31:47.947742 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:31:47.949288 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f44ed5e536944d848725f42cd9b813c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f44ed5e536944d848725f42cd9b813c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f44ed5e536944d848725f42cd9b813c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f44ed5e536944d848725f42cd9b813c6", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:47.949288 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-520043596 Jul 28 10:31:47.949288 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: f44ed5e536944d848725f42cd9b813c6 Jul 28 10:31:47.949288 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-520043596 Jul 28 10:31:47.949288 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-520043596-project Jul 28 10:31:47.949288 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:31:47.949288 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:31:47.949288 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 94166124c7214ec18fe938dbb903c486 Jul 28 10:31:47.949288 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-520043596-project Jul 28 10:31:47.949288 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:31:47.949288 n-d-850468-6 devstack@n-api.service[119464]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 28 10:31:47.949288 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'n-h2-850468-6'} Jul 28 10:31:47.950193 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:47.950193 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:47.950193 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:47.950193 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:47.950193 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:47.950193 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:47.950193 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:31:47.950193 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:31:47.950193 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:47.950193 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:47.950193 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 28 10:31:47.950193 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 28 10:31:47.950193 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:31:47.950193 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:31:47.950193 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:31:47.950193 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:31:47.950193 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:31:47.950193 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:31:47.950193 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:31:47.951473 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:31:47.951473 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:31:47.951473 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:31:47.951473 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:31:47.951473 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:31:47.951473 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:31:47.951473 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:31:47.951473 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 28 10:31:47.951473 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:47.951473 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:47.951473 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:47.951473 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:47.951473 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:47.951473 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:47.951473 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:31:47.951473 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:31:47.951473 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 28 10:31:47.951473 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:47.953338 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-21b08f51-9ef6-4df3-8b85-1384fb99ffdd tempest-HypervisorAdminNegativeUnderV252Test-520043596 tempest-HypervisorAdminNegativeUnderV252Test-520043596-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:47.955066 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-21b08f51-9ef6-4df3-8b85-1384fb99ffdd tempest-HypervisorAdminNegativeUnderV252Test-520043596 tempest-HypervisorAdminNegativeUnderV252Test-520043596-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/n-h2-850468-6/search" status: 403 len: 117 microversion: 2.1 time: 0.590250 Jul 28 10:31:47.960027 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 213/387] 10.222.0.46 () {58 vars in 1209 bytes} [Thu Jul 28 10:31:47 2022] GET /compute/v2.1/os-hypervisors/n-h2-850468-6/search => generated 117 bytes in 597 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:31:47.985495 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c1ad725c-de21-4faa-ab2f-eef5e95c9cbe tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Calling method '.version_select at 0x7fa94bda5c10>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:47.987545 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:47.987545 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:31:48.011417 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-c1ad725c-de21-4faa-ab2f-eef5e95c9cbe tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.016985 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c1ad725c-de21-4faa-ab2f-eef5e95c9cbe tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Request method failure captured: Jul 28 10:31:48.016985 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 28 10:31:48.016985 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:31:48.016985 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:31:48.016985 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:31:48.016985 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:31:48.016985 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:31:48.016985 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:31:48.016985 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:31:48.016985 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:48.016985 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWRA8WUYp2b-Fh-cLEl1nrIa0AMzCkozvxTEc4clj3qaM2fj1m7wiuDBlV2amK844xWRCb2208IWGYQEtoOPEGa2xVFtPc-urQNe62Ofx-wIZXIo4Rb8nSSqq-O4lK7jRcnB8lblcI0DOTo7dty0SWhzvND2NvN2SODkfvlmxPZ8io Jul 28 10:31:48.016985 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:31:48.016985 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:31:48.016985 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:31:48.016985 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:31:48.016985 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:31:48.016985 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:31:48.016985 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: fef455a3ad294b5aa277e84c479f441f Jul 28 10:31:48.016985 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.016985 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:31:48.016985 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:31:48.018781 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fef455a3ad294b5aa277e84c479f441f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:48.018781 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.018781 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: fef455a3ad294b5aa277e84c479f441f Jul 28 10:31:48.018781 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.018781 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-HostsAdminNegativeTestJSON-427902840-project-admin Jul 28 10:31:48.018781 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:31:48.018781 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:31:48.018781 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 4337e1e6b6a748189a4cf2b3bb4a6184 Jul 28 10:31:48.018781 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-HostsAdminNegativeTestJSON-427902840-project-admin Jul 28 10:31:48.018781 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:31:48.018781 n-d-850468-6 devstack@n-api.service[119464]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.018781 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'nonexistent_hostname'} Jul 28 10:31:48.018781 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:48.021362 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.021362 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 28 10:31:48.021362 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 28 10:31:48.021362 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 10:31:48.021362 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 10:31:48.021362 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:31:48.021362 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:31:48.021362 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:31:48.021362 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:31:48.021362 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 10:31:48.021362 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 10:31:48.021362 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5941, in targeted Jul 28 10:31:48.021362 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 28 10:31:48.021362 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:31:48.021362 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:31:48.021362 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 28 10:31:48.021362 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 28 10:31:48.021362 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:31:48.021362 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:31:48.025088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 28 10:31:48.025088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 28 10:31:48.025088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.025088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.025088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:48.025088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.025088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.025088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.025088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.025088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:48.025088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:48.025088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:31:48.025088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:31:48.025088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:48.025088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:48.025088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 28 10:31:48.025088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 28 10:31:48.025088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 28 10:31:48.025088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:31:48.036367 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.036367 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.036367 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:48.036367 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.036367 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.036367 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.036367 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.036367 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:31:48.036367 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:31:48.036367 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.036367 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.036367 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c1ad725c-de21-4faa-ab2f-eef5e95c9cbe tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:48.036367 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c1ad725c-de21-4faa-ab2f-eef5e95c9cbe tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.060111 Jul 28 10:31:48.036367 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 214/388] 10.222.0.46 () {58 vars in 1212 bytes} [Thu Jul 28 10:31:47 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:31:48.038485 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fbde7ca7-2d4f-481f-986f-3d0119a3477f tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Calling method '.version_select at 0x7fa94bd96430>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:48.044013 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fbde7ca7-2d4f-481f-986f-3d0119a3477f tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:48.044542 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fbde7ca7-2d4f-481f-986f-3d0119a3477f tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:48.051555 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-fbde7ca7-2d4f-481f-986f-3d0119a3477f tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 28 10:31:48.053000 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fbde7ca7-2d4f-481f-986f-3d0119a3477f tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Request method failure captured: Jul 28 10:31:48.053000 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 28 10:31:48.053000 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:31:48.053000 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:31:48.053000 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:31:48.053000 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:31:48.053000 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:31:48.053000 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:31:48.053000 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:31:48.053000 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:48.053000 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWRM2FMI6ClXUwYAF7GMW1AWKfb5ZyI12unHeaDfopYAbJIBrCmfQq8aWHBX0ikG6lRkqye_YvY8NrvZAceXJZN35dyMlJX6BoPqWvgirD2JkX5IMIvRO8rA9zr-29yQuXUdOaEJ_bGB8akBdJMRFEu-UJM8-qco3-TQC5VzIWYn5g Jul 28 10:31:48.053000 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:31:48.053000 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:31:48.053000 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:31:48.053000 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:31:48.053000 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:31:48.053000 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:31:48.053000 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 04c0a0c92a4545598e5932bac95ea3ea Jul 28 10:31:48.053000 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-459062590 Jul 28 10:31:48.053000 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:31:48.053000 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:31:48.056219 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/04c0a0c92a4545598e5932bac95ea3ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/04c0a0c92a4545598e5932bac95ea3ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/04c0a0c92a4545598e5932bac95ea3ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_04c0a0c92a4545598e5932bac95ea3ea", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:48.056219 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-459062590 Jul 28 10:31:48.056219 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 04c0a0c92a4545598e5932bac95ea3ea Jul 28 10:31:48.056219 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-459062590 Jul 28 10:31:48.056219 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin Jul 28 10:31:48.056219 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:31:48.056219 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:31:48.056219 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: d6c82fba8b4d4416ba493b732f29b5d5 Jul 28 10:31:48.056219 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin Jul 28 10:31:48.056219 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:31:48.056219 n-d-850468-6 devstack@n-api.service[119464]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 28 10:31:48.056219 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 28 10:31:48.057107 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:48.057107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.057107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.057107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.057107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:48.057107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:48.057107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:31:48.057107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:31:48.057107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:48.057107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:48.057107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 28 10:31:48.057107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 28 10:31:48.057107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 28 10:31:48.057107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 10:31:48.057107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 28 10:31:48.057107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.057107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:48.057107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.057107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.057107 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.058472 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.058472 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:31:48.058472 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:31:48.058472 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 28 10:31:48.058472 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.058472 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fbde7ca7-2d4f-481f-986f-3d0119a3477f tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:48.058472 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-fbde7ca7-2d4f-481f-986f-3d0119a3477f tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.028323 Jul 28 10:31:48.060429 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 215/389] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Jul 28 10:31:48 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:31:48.065483 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c40962ec-d3a1-4f0c-9231-33cd2f4fbcf1 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Calling method '.version_select at 0x7fa94bd961f0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:48.067170 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:48.067170 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:31:48.069331 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-c40962ec-d3a1-4f0c-9231-33cd2f4fbcf1 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'f03613a7c9164790ad86f4965bc709f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28236ff7f54d4b8a90ac3dad03d72884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:48.071114 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c40962ec-d3a1-4f0c-9231-33cd2f4fbcf1 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Request method failure captured: Jul 28 10:31:48.071114 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-hosts/n-d-850468-6 HTTP/1.1 Jul 28 10:31:48.071114 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:31:48.071114 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:31:48.071114 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:31:48.071114 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:31:48.071114 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:31:48.071114 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:31:48.071114 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:31:48.071114 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:48.071114 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWOuS6Ii21c3EG98eVwPlu-235aenOSvLlNIOS0B3dQFTltJHzBACzWo0Iff76nJg3eMIOyTl00p84zcnRtZwEtkBfZ2W5Bu-viOZiyLGvf1PatSWdlHQWSxm15S73sqkc0fv2IsaUnwVqFADBX-VNdpk10gJhoKSevQQpXmAr7T1U Jul 28 10:31:48.071114 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:31:48.071114 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:31:48.071114 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:31:48.071114 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:31:48.071114 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:31:48.071114 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:31:48.071114 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 28236ff7f54d4b8a90ac3dad03d72884 Jul 28 10:31:48.071114 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-856952922 Jul 28 10:31:48.071114 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:31:48.071114 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:31:48.072677 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/28236ff7f54d4b8a90ac3dad03d72884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/28236ff7f54d4b8a90ac3dad03d72884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/28236ff7f54d4b8a90ac3dad03d72884"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_28236ff7f54d4b8a90ac3dad03d72884", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:48.072677 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-HostsAdminNegativeTestJSON-856952922 Jul 28 10:31:48.072677 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 28236ff7f54d4b8a90ac3dad03d72884 Jul 28 10:31:48.072677 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-856952922 Jul 28 10:31:48.072677 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-HostsAdminNegativeTestJSON-856952922-project Jul 28 10:31:48.072677 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:31:48.072677 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:31:48.072677 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: f03613a7c9164790ad86f4965bc709f1 Jul 28 10:31:48.072677 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-HostsAdminNegativeTestJSON-856952922-project Jul 28 10:31:48.072677 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:31:48.072677 n-d-850468-6 devstack@n-api.service[119464]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 28 10:31:48.072677 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'n-d-850468-6'} Jul 28 10:31:48.072677 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:48.073611 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.073611 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.073611 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.073611 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:48.073611 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:48.073611 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:31:48.073611 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:31:48.073611 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:48.073611 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:48.073611 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 28 10:31:48.073611 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 28 10:31:48.073611 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:31:48.073611 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:31:48.073611 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:31:48.073611 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:31:48.073611 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:31:48.073611 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:31:48.073611 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:31:48.073611 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:31:48.075218 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:31:48.075218 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:31:48.075218 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:31:48.075218 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:31:48.075218 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:31:48.075218 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:31:48.075218 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 28 10:31:48.075218 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.075218 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:48.075218 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.075218 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.075218 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.075218 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.075218 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:31:48.075218 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:31:48.075218 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 28 10:31:48.075218 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.076391 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c40962ec-d3a1-4f0c-9231-33cd2f4fbcf1 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:48.076895 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c40962ec-d3a1-4f0c-9231-33cd2f4fbcf1 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] 10.222.0.46 "GET /compute/v2.1/os-hosts/n-d-850468-6" status: 403 len: 109 microversion: 2.1 time: 0.013769 Jul 28 10:31:48.083223 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 216/390] 10.222.0.46 () {58 vars in 1167 bytes} [Thu Jul 28 10:31:48 2022] GET /compute/v2.1/os-hosts/n-d-850468-6 => generated 109 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:31:48.083223 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-579288de-5fa0-4ac1-a2c7-f88a65832725 tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Calling method '.version_select at 0x7fa94bda5160>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:48.083525 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:48.083525 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:31:48.085102 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-579288de-5fa0-4ac1-a2c7-f88a65832725 tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:48.085621 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-579288de-5fa0-4ac1-a2c7-f88a65832725 tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:48.104259 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-579288de-5fa0-4ac1-a2c7-f88a65832725 tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:48.104874 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-579288de-5fa0-4ac1-a2c7-f88a65832725 tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:48.117915 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-579288de-5fa0-4ac1-a2c7-f88a65832725 tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:48.118552 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-579288de-5fa0-4ac1-a2c7-f88a65832725 tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:48.126460 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-579288de-5fa0-4ac1-a2c7-f88a65832725 tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.047841 Jul 28 10:31:48.133683 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 217/391] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:31:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:48.138823 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6fd81058-1ff0-4591-a622-7fc396d45db4 tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Calling method '.version_select at 0x7fa94bda5040>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:48.139968 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:48.139968 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:31:48.148155 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-6fd81058-1ff0-4591-a622-7fc396d45db4 tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.150239 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6fd81058-1ff0-4591-a622-7fc396d45db4 tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Request method failure captured: Jul 28 10:31:48.150239 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 28 10:31:48.150239 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:31:48.150239 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:31:48.150239 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:31:48.150239 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:31:48.150239 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:31:48.150239 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:31:48.150239 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:31:48.150239 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:48.150239 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWRA8WUYp2b-Fh-cLEl1nrIa0AMzCkozvxTEc4clj3qaM2fj1m7wiuDBlV2amK844xWRCb2208IWGYQEtoOPEGa2xVFtPc-urQNe62Ofx-wIZXIo4Rb8nSSqq-O4lK7jRcnB8lblcI0DOTo7dty0SWhzvND2NvN2SODkfvlmxPZ8io Jul 28 10:31:48.150239 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:31:48.150239 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:31:48.150239 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:31:48.150239 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:31:48.150239 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:31:48.150239 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:31:48.150239 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: fef455a3ad294b5aa277e84c479f441f Jul 28 10:31:48.150239 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.150239 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:31:48.150239 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:31:48.151438 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fef455a3ad294b5aa277e84c479f441f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:48.151438 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.151438 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: fef455a3ad294b5aa277e84c479f441f Jul 28 10:31:48.151438 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.151438 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-HostsAdminNegativeTestJSON-427902840-project-admin Jul 28 10:31:48.151438 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:31:48.151438 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:31:48.151438 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 4337e1e6b6a748189a4cf2b3bb4a6184 Jul 28 10:31:48.151438 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-HostsAdminNegativeTestJSON-427902840-project-admin Jul 28 10:31:48.151438 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:31:48.151438 n-d-850468-6 devstack@n-api.service[119464]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.151438 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'nonexistent_hostname'} Jul 28 10:31:48.151438 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:48.152156 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.152156 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 28 10:31:48.152156 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 28 10:31:48.152156 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:31:48.152156 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:31:48.152156 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 28 10:31:48.152156 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 28 10:31:48.152156 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:31:48.152156 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:31:48.152156 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 28 10:31:48.152156 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 28 10:31:48.152156 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.152156 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.152156 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:48.152156 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.152156 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.152156 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.152156 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.152156 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:48.153225 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:48.153225 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:31:48.153225 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:31:48.153225 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:48.153225 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:48.153225 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 28 10:31:48.153225 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:31:48.153225 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.153225 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.153225 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:48.153225 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.153225 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.153225 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.153225 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.153225 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:31:48.153225 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:31:48.153225 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.153225 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.156709 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6fd81058-1ff0-4591-a622-7fc396d45db4 tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:48.158101 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-6fd81058-1ff0-4591-a622-7fc396d45db4 tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.023133 Jul 28 10:31:48.159325 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 218/392] 10.222.0.46 () {58 vars in 1191 bytes} [Thu Jul 28 10:31:48 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:31:48.167097 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-3054930a-406e-47a9-bd77-73e6ca8a77bf tempest-HypervisorAdminNegativeUnderV252Test-520043596 tempest-HypervisorAdminNegativeUnderV252Test-520043596-project] Calling method '.version_select at 0x7fa94bd96a60>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:48.168229 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:48.168229 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:31:48.169589 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-3054930a-406e-47a9-bd77-73e6ca8a77bf tempest-HypervisorAdminNegativeUnderV252Test-520043596 tempest-HypervisorAdminNegativeUnderV252Test-520043596-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '94166124c7214ec18fe938dbb903c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ed5e536944d848725f42cd9b813c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:48.171398 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-3054930a-406e-47a9-bd77-73e6ca8a77bf tempest-HypervisorAdminNegativeUnderV252Test-520043596 tempest-HypervisorAdminNegativeUnderV252Test-520043596-project] Request method failure captured: Jul 28 10:31:48.171398 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 28 10:31:48.171398 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:31:48.171398 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:31:48.171398 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:31:48.171398 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:31:48.171398 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:31:48.171398 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:31:48.171398 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:31:48.171398 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:48.171398 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWP1s7YVs_J_QGMy7Sp13gs28_acfIop02G7zqlG-NM9tt1CsI1C7UthcpYkLLCUabPQ9c-c-i6yXLlvQbBwose4IZ-WVYgPCXK7mLPogCcUePwn-rRkFHK-XNx-CwKzRi11xTq6OZdOiXNsXTt1N6tKcy9tSQPyZTa2SrrGk4g4iY Jul 28 10:31:48.171398 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:31:48.171398 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:31:48.171398 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:31:48.171398 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:31:48.171398 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:31:48.171398 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:31:48.171398 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: f44ed5e536944d848725f42cd9b813c6 Jul 28 10:31:48.171398 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-520043596 Jul 28 10:31:48.171398 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:31:48.171398 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:31:48.172589 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f44ed5e536944d848725f42cd9b813c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f44ed5e536944d848725f42cd9b813c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f44ed5e536944d848725f42cd9b813c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f44ed5e536944d848725f42cd9b813c6", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:48.172589 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-520043596 Jul 28 10:31:48.172589 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: f44ed5e536944d848725f42cd9b813c6 Jul 28 10:31:48.172589 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-520043596 Jul 28 10:31:48.172589 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-520043596-project Jul 28 10:31:48.172589 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:31:48.172589 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:31:48.172589 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 94166124c7214ec18fe938dbb903c486 Jul 28 10:31:48.172589 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-520043596-project Jul 28 10:31:48.172589 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:31:48.172589 n-d-850468-6 devstack@n-api.service[119464]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 28 10:31:48.172589 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '1'} Jul 28 10:31:48.172589 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:48.173338 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.173338 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.173338 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.173338 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:48.173338 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:48.173338 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:31:48.173338 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:31:48.173338 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:48.173338 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:48.173338 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 28 10:31:48.173338 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 28 10:31:48.173338 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:31:48.173338 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:31:48.173338 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:31:48.173338 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:31:48.173338 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:31:48.173338 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:31:48.173338 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:31:48.173338 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:31:48.177251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:31:48.177251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:31:48.177251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:31:48.177251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:31:48.177251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:31:48.177251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:31:48.177251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 28 10:31:48.177251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.177251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:48.177251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.177251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.177251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.177251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.177251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:31:48.177251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:31:48.177251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 28 10:31:48.177251 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.180348 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-3054930a-406e-47a9-bd77-73e6ca8a77bf tempest-HypervisorAdminNegativeUnderV252Test-520043596 tempest-HypervisorAdminNegativeUnderV252Test-520043596-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:48.181457 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-3054930a-406e-47a9-bd77-73e6ca8a77bf tempest-HypervisorAdminNegativeUnderV252Test-520043596 tempest-HypervisorAdminNegativeUnderV252Test-520043596-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.020409 Jul 28 10:31:48.186702 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 219/393] 10.222.0.46 () {58 vars in 1176 bytes} [Thu Jul 28 10:31:48 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:31:48.193328 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2dbc78f5-69c3-4e87-b020-a8fa1550e115 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Calling method '.version_select at 0x7fa94bd8a700>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:48.194688 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:48.194688 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:31:48.196300 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-2dbc78f5-69c3-4e87-b020-a8fa1550e115 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'f03613a7c9164790ad86f4965bc709f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28236ff7f54d4b8a90ac3dad03d72884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:48.198218 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2dbc78f5-69c3-4e87-b020-a8fa1550e115 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Request method failure captured: Jul 28 10:31:48.198218 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-hosts/n-d-850468-6/shutdown HTTP/1.1 Jul 28 10:31:48.198218 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:31:48.198218 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:31:48.198218 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:31:48.198218 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:31:48.198218 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:31:48.198218 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:31:48.198218 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:31:48.198218 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:48.198218 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWOuS6Ii21c3EG98eVwPlu-235aenOSvLlNIOS0B3dQFTltJHzBACzWo0Iff76nJg3eMIOyTl00p84zcnRtZwEtkBfZ2W5Bu-viOZiyLGvf1PatSWdlHQWSxm15S73sqkc0fv2IsaUnwVqFADBX-VNdpk10gJhoKSevQQpXmAr7T1U Jul 28 10:31:48.198218 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:31:48.198218 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:31:48.198218 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:31:48.198218 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:31:48.198218 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:31:48.198218 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:31:48.198218 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 28236ff7f54d4b8a90ac3dad03d72884 Jul 28 10:31:48.198218 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-856952922 Jul 28 10:31:48.198218 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:31:48.198218 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:31:48.199693 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/28236ff7f54d4b8a90ac3dad03d72884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/28236ff7f54d4b8a90ac3dad03d72884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/28236ff7f54d4b8a90ac3dad03d72884"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_28236ff7f54d4b8a90ac3dad03d72884", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:48.199693 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-HostsAdminNegativeTestJSON-856952922 Jul 28 10:31:48.199693 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 28236ff7f54d4b8a90ac3dad03d72884 Jul 28 10:31:48.199693 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-856952922 Jul 28 10:31:48.199693 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-HostsAdminNegativeTestJSON-856952922-project Jul 28 10:31:48.199693 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:31:48.199693 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:31:48.199693 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: f03613a7c9164790ad86f4965bc709f1 Jul 28 10:31:48.199693 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-HostsAdminNegativeTestJSON-856952922-project Jul 28 10:31:48.199693 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:31:48.199693 n-d-850468-6 devstack@n-api.service[119464]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 28 10:31:48.199693 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'n-d-850468-6'} Jul 28 10:31:48.199693 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:48.200446 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.200446 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.200446 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.200446 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:48.200446 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:48.200446 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:31:48.200446 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:31:48.200446 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:48.200446 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:48.200446 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 28 10:31:48.200446 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 28 10:31:48.200446 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:31:48.200446 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:31:48.200446 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:31:48.200446 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:31:48.200446 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:31:48.200446 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:31:48.200446 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:31:48.200446 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:31:48.201613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:31:48.201613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:31:48.201613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:31:48.201613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:31:48.201613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:31:48.201613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:31:48.201613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 28 10:31:48.201613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.201613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:48.201613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.201613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.201613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.201613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.201613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:31:48.201613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:31:48.201613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 28 10:31:48.201613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.204162 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2dbc78f5-69c3-4e87-b020-a8fa1550e115 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:48.205399 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-2dbc78f5-69c3-4e87-b020-a8fa1550e115 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] 10.222.0.46 "GET /compute/v2.1/os-hosts/n-d-850468-6/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.017317 Jul 28 10:31:48.206551 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 220/394] 10.222.0.46 () {58 vars in 1194 bytes} [Thu Jul 28 10:31:48 2022] GET /compute/v2.1/os-hosts/n-d-850468-6/shutdown => generated 113 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:31:48.212083 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-3e9d4547-280f-4e9a-9dc7-7bf4593c779f tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Calling method '.version_select at 0x7fa95a5dba60>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:48.214625 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3e9d4547-280f-4e9a-9dc7-7bf4593c779f tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:48.215418 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3e9d4547-280f-4e9a-9dc7-7bf4593c779f tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:48.226589 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-3e9d4547-280f-4e9a-9dc7-7bf4593c779f tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] HTTP exception thrown: No hypervisor matching 'ad962df6-3838-4b3c-a016-3dcd6fe9a88f' could be found. Jul 28 10:31:48.228146 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-3e9d4547-280f-4e9a-9dc7-7bf4593c779f tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Request method failure captured: Jul 28 10:31:48.228146 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-hypervisors/ad962df6-3838-4b3c-a016-3dcd6fe9a88f/servers HTTP/1.1 Jul 28 10:31:48.228146 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:31:48.228146 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:31:48.228146 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:31:48.228146 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:31:48.228146 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:31:48.228146 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:31:48.228146 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:31:48.228146 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:48.228146 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWRM2FMI6ClXUwYAF7GMW1AWKfb5ZyI12unHeaDfopYAbJIBrCmfQq8aWHBX0ikG6lRkqye_YvY8NrvZAceXJZN35dyMlJX6BoPqWvgirD2JkX5IMIvRO8rA9zr-29yQuXUdOaEJ_bGB8akBdJMRFEu-UJM8-qco3-TQC5VzIWYn5g Jul 28 10:31:48.228146 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:31:48.228146 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:31:48.228146 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:31:48.228146 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:31:48.228146 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:31:48.228146 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:31:48.228146 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 04c0a0c92a4545598e5932bac95ea3ea Jul 28 10:31:48.228146 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-459062590 Jul 28 10:31:48.228146 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:31:48.228146 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:31:48.229360 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/04c0a0c92a4545598e5932bac95ea3ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/04c0a0c92a4545598e5932bac95ea3ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/04c0a0c92a4545598e5932bac95ea3ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_04c0a0c92a4545598e5932bac95ea3ea", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:48.229360 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-459062590 Jul 28 10:31:48.229360 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 04c0a0c92a4545598e5932bac95ea3ea Jul 28 10:31:48.229360 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-459062590 Jul 28 10:31:48.229360 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin Jul 28 10:31:48.229360 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:31:48.229360 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:31:48.229360 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: d6c82fba8b4d4416ba493b732f29b5d5 Jul 28 10:31:48.229360 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin Jul 28 10:31:48.229360 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:31:48.229360 n-d-850468-6 devstack@n-api.service[119464]: exception: No hypervisor matching 'ad962df6-3838-4b3c-a016-3dcd6fe9a88f' could be found. Jul 28 10:31:48.229360 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'ad962df6-3838-4b3c-a016-3dcd6fe9a88f'} Jul 28 10:31:48.230116 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:48.230116 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.230116 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.230116 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.230116 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:48.230116 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:48.230116 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:31:48.230116 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:31:48.230116 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:48.230116 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:48.230116 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 28 10:31:48.230116 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 28 10:31:48.230116 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 28 10:31:48.230116 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 10:31:48.230116 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'ad962df6-3838-4b3c-a016-3dcd6fe9a88f' could be found. Jul 28 10:31:48.230116 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.230116 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:48.230116 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.230116 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.231150 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.231150 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.231150 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:31:48.231150 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:31:48.231150 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'ad962df6-3838-4b3c-a016-3dcd6fe9a88f' could be found. Jul 28 10:31:48.231150 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.231150 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-3e9d4547-280f-4e9a-9dc7-7bf4593c779f tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] Returning 404 to user: No hypervisor matching 'ad962df6-3838-4b3c-a016-3dcd6fe9a88f' could be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:48.231150 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-3e9d4547-280f-4e9a-9dc7-7bf4593c779f tempest-HypervisorAdminNegativeUnderV252Test-459062590 tempest-HypervisorAdminNegativeUnderV252Test-459062590-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/ad962df6-3838-4b3c-a016-3dcd6fe9a88f/servers" status: 404 len: 123 microversion: 2.1 time: 0.021765 Jul 28 10:31:48.236865 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 221/395] 10.222.0.46 () {58 vars in 1281 bytes} [Thu Jul 28 10:31:48 2022] GET /compute/v2.1/os-hypervisors/ad962df6-3838-4b3c-a016-3dcd6fe9a88f/servers => generated 123 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:31:48.243667 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-eb6d55e7-472a-4525-b0d3-6f976354f8ce tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Calling method '.version_select at 0x7fa94bda58b0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:48.254729 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-eb6d55e7-472a-4525-b0d3-6f976354f8ce tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.260460 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-eb6d55e7-472a-4525-b0d3-6f976354f8ce tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Request method failure captured: Jul 28 10:31:48.260460 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 28 10:31:48.260460 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:31:48.260460 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:31:48.260460 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:31:48.260460 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:31:48.260460 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:31:48.260460 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:31:48.260460 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:31:48.260460 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:48.260460 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWRA8WUYp2b-Fh-cLEl1nrIa0AMzCkozvxTEc4clj3qaM2fj1m7wiuDBlV2amK844xWRCb2208IWGYQEtoOPEGa2xVFtPc-urQNe62Ofx-wIZXIo4Rb8nSSqq-O4lK7jRcnB8lblcI0DOTo7dty0SWhzvND2NvN2SODkfvlmxPZ8io Jul 28 10:31:48.260460 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:31:48.260460 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:31:48.260460 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:31:48.260460 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:31:48.260460 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:31:48.260460 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:31:48.260460 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: fef455a3ad294b5aa277e84c479f441f Jul 28 10:31:48.260460 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.260460 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:31:48.260460 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:31:48.261886 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fef455a3ad294b5aa277e84c479f441f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:48.261886 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.261886 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: fef455a3ad294b5aa277e84c479f441f Jul 28 10:31:48.261886 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.261886 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-HostsAdminNegativeTestJSON-427902840-project-admin Jul 28 10:31:48.261886 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:31:48.261886 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:31:48.261886 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 4337e1e6b6a748189a4cf2b3bb4a6184 Jul 28 10:31:48.261886 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-HostsAdminNegativeTestJSON-427902840-project-admin Jul 28 10:31:48.261886 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:31:48.261886 n-d-850468-6 devstack@n-api.service[119464]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.261886 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'nonexistent_hostname'} Jul 28 10:31:48.261886 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:48.262613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.262613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 28 10:31:48.262613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 28 10:31:48.262613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 10:31:48.262613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 10:31:48.262613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:31:48.262613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:31:48.262613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:31:48.262613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:31:48.262613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 10:31:48.262613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 10:31:48.262613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5941, in targeted Jul 28 10:31:48.262613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 28 10:31:48.262613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:31:48.262613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:31:48.262613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 28 10:31:48.262613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 28 10:31:48.262613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:31:48.262613 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:31:48.263711 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 28 10:31:48.263711 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 28 10:31:48.263711 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.263711 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.263711 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:48.263711 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.263711 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.263711 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.263711 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.263711 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:48.263711 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:48.263711 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:31:48.263711 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:31:48.263711 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:48.263711 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:48.263711 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 28 10:31:48.263711 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 28 10:31:48.263711 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 28 10:31:48.263711 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:31:48.264746 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.264746 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.264746 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:48.264746 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.264746 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.264746 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.264746 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.264746 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:31:48.264746 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:31:48.264746 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.264746 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.264746 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-eb6d55e7-472a-4525-b0d3-6f976354f8ce tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:48.264746 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-eb6d55e7-472a-4525-b0d3-6f976354f8ce tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.024110 Jul 28 10:31:48.268769 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 222/396] 10.222.0.46 () {58 vars in 1218 bytes} [Thu Jul 28 10:31:48 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:31:48.276324 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-76897c50-0461-42e2-9f0b-895ffaf929d9 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Calling method '.version_select at 0x7fa94bd96430>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:48.277359 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:48.277359 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:31:48.278722 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-76897c50-0461-42e2-9f0b-895ffaf929d9 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'f03613a7c9164790ad86f4965bc709f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28236ff7f54d4b8a90ac3dad03d72884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:48.280639 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-76897c50-0461-42e2-9f0b-895ffaf929d9 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Request method failure captured: Jul 28 10:31:48.280639 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-hosts/n-d-850468-6/startup HTTP/1.1 Jul 28 10:31:48.280639 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:31:48.280639 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:31:48.280639 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:31:48.280639 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:31:48.280639 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:31:48.280639 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:31:48.280639 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:31:48.280639 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:48.280639 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWOuS6Ii21c3EG98eVwPlu-235aenOSvLlNIOS0B3dQFTltJHzBACzWo0Iff76nJg3eMIOyTl00p84zcnRtZwEtkBfZ2W5Bu-viOZiyLGvf1PatSWdlHQWSxm15S73sqkc0fv2IsaUnwVqFADBX-VNdpk10gJhoKSevQQpXmAr7T1U Jul 28 10:31:48.280639 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:31:48.280639 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:31:48.280639 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:31:48.280639 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:31:48.280639 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:31:48.280639 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:31:48.280639 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 28236ff7f54d4b8a90ac3dad03d72884 Jul 28 10:31:48.280639 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-856952922 Jul 28 10:31:48.280639 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:31:48.280639 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:31:48.282405 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/28236ff7f54d4b8a90ac3dad03d72884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/28236ff7f54d4b8a90ac3dad03d72884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/28236ff7f54d4b8a90ac3dad03d72884"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_28236ff7f54d4b8a90ac3dad03d72884", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:48.282405 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-HostsAdminNegativeTestJSON-856952922 Jul 28 10:31:48.282405 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 28236ff7f54d4b8a90ac3dad03d72884 Jul 28 10:31:48.282405 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-856952922 Jul 28 10:31:48.282405 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-HostsAdminNegativeTestJSON-856952922-project Jul 28 10:31:48.282405 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:31:48.282405 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:31:48.282405 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: f03613a7c9164790ad86f4965bc709f1 Jul 28 10:31:48.282405 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-HostsAdminNegativeTestJSON-856952922-project Jul 28 10:31:48.282405 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:31:48.282405 n-d-850468-6 devstack@n-api.service[119464]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 28 10:31:48.282405 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'n-d-850468-6'} Jul 28 10:31:48.282405 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:48.283295 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.283295 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.283295 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.283295 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:48.283295 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:48.283295 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:31:48.283295 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:31:48.283295 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:48.283295 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:48.283295 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 28 10:31:48.283295 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 28 10:31:48.283295 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:31:48.283295 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:31:48.283295 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:31:48.283295 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:31:48.283295 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:31:48.283295 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:31:48.283295 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:31:48.283295 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:31:48.284434 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:31:48.284434 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:31:48.284434 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:31:48.284434 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:31:48.284434 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:31:48.284434 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:31:48.284434 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 28 10:31:48.284434 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.284434 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:48.284434 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.284434 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.284434 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.284434 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.284434 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:31:48.284434 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:31:48.284434 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 28 10:31:48.284434 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.286390 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-76897c50-0461-42e2-9f0b-895ffaf929d9 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:48.287390 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-76897c50-0461-42e2-9f0b-895ffaf929d9 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] 10.222.0.46 "GET /compute/v2.1/os-hosts/n-d-850468-6/startup" status: 403 len: 110 microversion: 2.1 time: 0.016458 Jul 28 10:31:48.294449 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 223/397] 10.222.0.46 () {58 vars in 1191 bytes} [Thu Jul 28 10:31:48 2022] GET /compute/v2.1/os-hosts/n-d-850468-6/startup => generated 110 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:31:48.299616 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-202da115-7df1-4904-89fa-203d906664bd tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Calling method '.version_select at 0x7fa94bd8a3a0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:48.314376 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-202da115-7df1-4904-89fa-203d906664bd tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.318437 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-202da115-7df1-4904-89fa-203d906664bd tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Request method failure captured: Jul 28 10:31:48.318437 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 28 10:31:48.318437 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:31:48.318437 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:31:48.318437 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:31:48.318437 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:31:48.318437 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:31:48.318437 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:31:48.318437 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:31:48.318437 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:48.318437 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWRA8WUYp2b-Fh-cLEl1nrIa0AMzCkozvxTEc4clj3qaM2fj1m7wiuDBlV2amK844xWRCb2208IWGYQEtoOPEGa2xVFtPc-urQNe62Ofx-wIZXIo4Rb8nSSqq-O4lK7jRcnB8lblcI0DOTo7dty0SWhzvND2NvN2SODkfvlmxPZ8io Jul 28 10:31:48.318437 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:31:48.318437 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:31:48.318437 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:31:48.318437 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:31:48.318437 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:31:48.318437 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:31:48.318437 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: fef455a3ad294b5aa277e84c479f441f Jul 28 10:31:48.318437 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.318437 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:31:48.318437 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:31:48.319871 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fef455a3ad294b5aa277e84c479f441f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:48.319871 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.319871 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: fef455a3ad294b5aa277e84c479f441f Jul 28 10:31:48.319871 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.319871 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-HostsAdminNegativeTestJSON-427902840-project-admin Jul 28 10:31:48.319871 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:31:48.319871 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:31:48.319871 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 4337e1e6b6a748189a4cf2b3bb4a6184 Jul 28 10:31:48.319871 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-HostsAdminNegativeTestJSON-427902840-project-admin Jul 28 10:31:48.319871 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:31:48.319871 n-d-850468-6 devstack@n-api.service[119464]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.319871 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'nonexistent_hostname'} Jul 28 10:31:48.319871 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:48.320695 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.320695 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 28 10:31:48.320695 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 28 10:31:48.320695 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 10:31:48.320695 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 10:31:48.320695 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:31:48.320695 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:31:48.320695 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:31:48.320695 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:31:48.320695 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 10:31:48.320695 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 10:31:48.320695 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5941, in targeted Jul 28 10:31:48.320695 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 28 10:31:48.320695 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:31:48.320695 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:31:48.320695 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 28 10:31:48.320695 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 28 10:31:48.320695 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:31:48.320695 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:31:48.321783 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 28 10:31:48.321783 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 28 10:31:48.321783 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.321783 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.321783 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:48.321783 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.321783 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.321783 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.321783 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.321783 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:48.321783 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:48.321783 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:31:48.321783 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:31:48.321783 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:48.321783 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:48.321783 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 28 10:31:48.321783 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 28 10:31:48.321783 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 28 10:31:48.321783 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:31:48.322840 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.322840 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.322840 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:48.322840 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.322840 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.322840 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.322840 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.322840 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:31:48.322840 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:31:48.322840 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.322840 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.325021 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-202da115-7df1-4904-89fa-203d906664bd tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:48.326879 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-202da115-7df1-4904-89fa-203d906664bd tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.030710 Jul 28 10:31:48.328011 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 224/398] 10.222.0.46 () {58 vars in 1215 bytes} [Thu Jul 28 10:31:48 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 28 10:31:48.346587 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7523b387-d226-48c2-b568-0bfc2bc23a68 tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Action: 'update', calling method: .version_select at 0x7fa94bd96f70>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:48.352489 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7523b387-d226-48c2-b568-0bfc2bc23a68 tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Request method failure captured: Jul 28 10:31:48.352489 n-d-850468-6 devstack@n-api.service[119464]: request: PUT /compute/v2.1/os-hosts/n-d-850468-6 HTTP/1.1 Jul 28 10:31:48.352489 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:31:48.352489 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:31:48.352489 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:31:48.352489 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 51 Jul 28 10:31:48.352489 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:31:48.352489 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:31:48.352489 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:31:48.352489 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:48.352489 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWRA8WUYp2b-Fh-cLEl1nrIa0AMzCkozvxTEc4clj3qaM2fj1m7wiuDBlV2amK844xWRCb2208IWGYQEtoOPEGa2xVFtPc-urQNe62Ofx-wIZXIo4Rb8nSSqq-O4lK7jRcnB8lblcI0DOTo7dty0SWhzvND2NvN2SODkfvlmxPZ8io Jul 28 10:31:48.352489 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:31:48.352489 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:31:48.352489 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:31:48.352489 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:31:48.352489 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:31:48.352489 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:31:48.352489 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: fef455a3ad294b5aa277e84c479f441f Jul 28 10:31:48.352489 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.352489 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:31:48.352489 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:31:48.353806 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fef455a3ad294b5aa277e84c479f441f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:48.353806 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.353806 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: fef455a3ad294b5aa277e84c479f441f Jul 28 10:31:48.353806 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.353806 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-HostsAdminNegativeTestJSON-427902840-project-admin Jul 28 10:31:48.353806 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:31:48.353806 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:31:48.353806 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 4337e1e6b6a748189a4cf2b3bb4a6184 Jul 28 10:31:48.353806 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-HostsAdminNegativeTestJSON-427902840-project-admin Jul 28 10:31:48.353806 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:31:48.353806 n-d-850468-6 devstack@n-api.service[119464]: {"status": "enable", "maintenance_mode": "invalid"} Jul 28 10:31:48.353806 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:31:48.353806 n-d-850468-6 devstack@n-api.service[119464]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'n-d-850468-6', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise error Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'disable', Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'Enable', Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'Disable', Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi On instance: Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'invalid' Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.354722 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.356219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.356219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:48.356219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:48.356219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:31:48.356219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:31:48.356219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:48.356219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:48.356219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 10:31:48.356219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 10:31:48.356219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 10:31:48.356219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 10:31:48.356219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 10:31:48.356219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 10:31:48.356219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 10:31:48.356219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.356219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:48.356219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.356219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.356219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.357258 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.357258 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 10:31:48.357258 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 10:31:48.357258 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 10:31:48.357258 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.358897 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7523b387-d226-48c2-b568-0bfc2bc23a68 tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:48.360596 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7523b387-d226-48c2-b568-0bfc2bc23a68 tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-hosts/n-d-850468-6" status: 400 len: 199 microversion: 2.1 time: 0.022266 Jul 28 10:31:48.361898 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 225/399] 10.222.0.46 () {60 vars in 1187 bytes} [Thu Jul 28 10:31:48 2022] PUT /compute/v2.1/os-hosts/n-d-850468-6 => generated 199 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:31:48.378097 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-aec3afcd-61be-4641-a2f4-c2fa9bf05405 tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Action: 'update', calling method: .version_select at 0x7fa94bd8a160>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:48.384307 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-aec3afcd-61be-4641-a2f4-c2fa9bf05405 tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Request method failure captured: Jul 28 10:31:48.384307 n-d-850468-6 devstack@n-api.service[119464]: request: PUT /compute/v2.1/os-hosts/n-d-850468-6 HTTP/1.1 Jul 28 10:31:48.384307 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:31:48.384307 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:31:48.384307 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:31:48.384307 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 51 Jul 28 10:31:48.384307 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:31:48.384307 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:31:48.384307 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:31:48.384307 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:48.384307 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWRA8WUYp2b-Fh-cLEl1nrIa0AMzCkozvxTEc4clj3qaM2fj1m7wiuDBlV2amK844xWRCb2208IWGYQEtoOPEGa2xVFtPc-urQNe62Ofx-wIZXIo4Rb8nSSqq-O4lK7jRcnB8lblcI0DOTo7dty0SWhzvND2NvN2SODkfvlmxPZ8io Jul 28 10:31:48.384307 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:31:48.384307 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:31:48.384307 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:31:48.384307 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:31:48.384307 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:31:48.384307 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:31:48.384307 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: fef455a3ad294b5aa277e84c479f441f Jul 28 10:31:48.384307 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.384307 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:31:48.384307 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:31:48.386294 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fef455a3ad294b5aa277e84c479f441f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:48.386294 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.386294 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: fef455a3ad294b5aa277e84c479f441f Jul 28 10:31:48.386294 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.386294 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-HostsAdminNegativeTestJSON-427902840-project-admin Jul 28 10:31:48.386294 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:31:48.386294 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:31:48.386294 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 4337e1e6b6a748189a4cf2b3bb4a6184 Jul 28 10:31:48.386294 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-HostsAdminNegativeTestJSON-427902840-project-admin Jul 28 10:31:48.386294 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:31:48.386294 n-d-850468-6 devstack@n-api.service[119464]: {"status": "invalid", "maintenance_mode": "enable"} Jul 28 10:31:48.386294 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:31:48.386294 n-d-850468-6 devstack@n-api.service[119464]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'n-d-850468-6', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise error Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'disable', Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'Enable', Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'Disable', Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi On instance: Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'invalid' Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.387186 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.388858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.388858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:48.388858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:48.388858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:31:48.388858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:31:48.388858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:48.388858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:48.388858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 10:31:48.388858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 10:31:48.388858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 10:31:48.388858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 10:31:48.388858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 10:31:48.388858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 10:31:48.388858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 10:31:48.388858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.388858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:48.388858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.388858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.388858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.390248 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.390248 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 10:31:48.390248 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 10:31:48.390248 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 10:31:48.390248 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.390248 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-aec3afcd-61be-4641-a2f4-c2fa9bf05405 tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:48.391437 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-aec3afcd-61be-4641-a2f4-c2fa9bf05405 tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-hosts/n-d-850468-6" status: 400 len: 189 microversion: 2.1 time: 0.017435 Jul 28 10:31:48.400610 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 226/400] 10.222.0.46 () {60 vars in 1187 bytes} [Thu Jul 28 10:31:48 2022] PUT /compute/v2.1/os-hosts/n-d-850468-6 => generated 189 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:31:48.406594 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1f2f6b5f-3af8-4c7a-b52d-cc569ee34ad0 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Action: 'update', calling method: .version_select at 0x7fa94bda5af0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:48.410459 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:31:48.410459 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:31:48.412729 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-1f2f6b5f-3af8-4c7a-b52d-cc569ee34ad0 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'f03613a7c9164790ad86f4965bc709f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28236ff7f54d4b8a90ac3dad03d72884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:48.414724 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1f2f6b5f-3af8-4c7a-b52d-cc569ee34ad0 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Request method failure captured: Jul 28 10:31:48.414724 n-d-850468-6 devstack@n-api.service[119464]: request: PUT /compute/v2.1/os-hosts/n-d-850468-6 HTTP/1.1 Jul 28 10:31:48.414724 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:31:48.414724 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:31:48.414724 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:31:48.414724 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 50 Jul 28 10:31:48.414724 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:31:48.414724 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:31:48.414724 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:31:48.414724 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:48.414724 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWOuS6Ii21c3EG98eVwPlu-235aenOSvLlNIOS0B3dQFTltJHzBACzWo0Iff76nJg3eMIOyTl00p84zcnRtZwEtkBfZ2W5Bu-viOZiyLGvf1PatSWdlHQWSxm15S73sqkc0fv2IsaUnwVqFADBX-VNdpk10gJhoKSevQQpXmAr7T1U Jul 28 10:31:48.414724 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:31:48.414724 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:31:48.414724 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:31:48.414724 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:31:48.414724 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:31:48.414724 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:31:48.414724 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 28236ff7f54d4b8a90ac3dad03d72884 Jul 28 10:31:48.414724 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-856952922 Jul 28 10:31:48.414724 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:31:48.414724 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:31:48.416184 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/28236ff7f54d4b8a90ac3dad03d72884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/28236ff7f54d4b8a90ac3dad03d72884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/28236ff7f54d4b8a90ac3dad03d72884"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_28236ff7f54d4b8a90ac3dad03d72884", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:48.416184 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-HostsAdminNegativeTestJSON-856952922 Jul 28 10:31:48.416184 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 28236ff7f54d4b8a90ac3dad03d72884 Jul 28 10:31:48.416184 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-856952922 Jul 28 10:31:48.416184 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-HostsAdminNegativeTestJSON-856952922-project Jul 28 10:31:48.416184 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:31:48.416184 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:31:48.416184 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: f03613a7c9164790ad86f4965bc709f1 Jul 28 10:31:48.416184 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-HostsAdminNegativeTestJSON-856952922-project Jul 28 10:31:48.416184 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:31:48.416184 n-d-850468-6 devstack@n-api.service[119464]: {"status": "enable", "maintenance_mode": "enable"} Jul 28 10:31:48.416184 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:31:48.416184 n-d-850468-6 devstack@n-api.service[119464]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 28 10:31:48.416184 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'n-d-850468-6', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 28 10:31:48.417221 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:48.417221 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.417221 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.417221 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.417221 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:48.417221 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:48.417221 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:31:48.417221 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:31:48.417221 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:48.417221 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:48.417221 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:31:48.417221 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:31:48.417221 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 28 10:31:48.417221 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 28 10:31:48.417221 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:31:48.417221 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:31:48.417221 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:31:48.417221 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:31:48.417221 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:31:48.417221 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:31:48.418578 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:31:48.418578 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:31:48.418578 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:31:48.418578 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:31:48.418578 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:31:48.418578 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:31:48.418578 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:31:48.418578 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:31:48.418578 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 28 10:31:48.418578 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.418578 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:48.418578 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.418578 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.418578 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.418578 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.418578 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:31:48.418578 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:31:48.418578 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 28 10:31:48.418578 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.420095 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1f2f6b5f-3af8-4c7a-b52d-cc569ee34ad0 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:48.420095 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1f2f6b5f-3af8-4c7a-b52d-cc569ee34ad0 tempest-HostsAdminNegativeTestJSON-856952922 tempest-HostsAdminNegativeTestJSON-856952922-project] 10.222.0.46 "PUT /compute/v2.1/os-hosts/n-d-850468-6" status: 403 len: 111 microversion: 2.1 time: 0.015603 Jul 28 10:31:48.425230 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 227/401] 10.222.0.46 () {60 vars in 1187 bytes} [Thu Jul 28 10:31:48 2022] PUT /compute/v2.1/os-hosts/n-d-850468-6 => generated 111 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:31:48.433270 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-14c76de5-c910-4938-bb66-8589f34c7eb6 tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Action: 'update', calling method: .version_select at 0x7fa94bd968b0>, body: {"status": null, "maintenance_mode": null} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:48.439278 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-14c76de5-c910-4938-bb66-8589f34c7eb6 tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Request method failure captured: Jul 28 10:31:48.439278 n-d-850468-6 devstack@n-api.service[119464]: request: PUT /compute/v2.1/os-hosts/n-d-850468-6 HTTP/1.1 Jul 28 10:31:48.439278 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:31:48.439278 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:31:48.439278 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:31:48.439278 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 42 Jul 28 10:31:48.439278 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:31:48.439278 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:31:48.439278 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:31:48.439278 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:48.439278 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWRA8WUYp2b-Fh-cLEl1nrIa0AMzCkozvxTEc4clj3qaM2fj1m7wiuDBlV2amK844xWRCb2208IWGYQEtoOPEGa2xVFtPc-urQNe62Ofx-wIZXIo4Rb8nSSqq-O4lK7jRcnB8lblcI0DOTo7dty0SWhzvND2NvN2SODkfvlmxPZ8io Jul 28 10:31:48.439278 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:31:48.439278 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:31:48.439278 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:31:48.439278 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:31:48.439278 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:31:48.439278 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:31:48.439278 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: fef455a3ad294b5aa277e84c479f441f Jul 28 10:31:48.439278 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.439278 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:31:48.439278 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:31:48.441029 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fef455a3ad294b5aa277e84c479f441f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:48.441029 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.441029 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: fef455a3ad294b5aa277e84c479f441f Jul 28 10:31:48.441029 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.441029 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-HostsAdminNegativeTestJSON-427902840-project-admin Jul 28 10:31:48.441029 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:31:48.441029 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:31:48.441029 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 4337e1e6b6a748189a4cf2b3bb4a6184 Jul 28 10:31:48.441029 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-HostsAdminNegativeTestJSON-427902840-project-admin Jul 28 10:31:48.441029 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:31:48.441029 n-d-850468-6 devstack@n-api.service[119464]: {"status": null, "maintenance_mode": null} Jul 28 10:31:48.441029 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:31:48.441029 n-d-850468-6 devstack@n-api.service[119464]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 28 10:31:48.441029 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'n-d-850468-6', 'body': {'status': None, 'maintenance_mode': None}} Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise error Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'disable', Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'Enable', Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'Disable', Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi On instance: Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi None Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.443944 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.446798 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:48.446798 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:48.446798 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:31:48.446798 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:31:48.446798 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:48.446798 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:48.446798 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 10:31:48.446798 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 10:31:48.446798 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 10:31:48.446798 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 10:31:48.446798 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 10:31:48.446798 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 10:31:48.446798 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 28 10:31:48.446798 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.446798 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:48.446798 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.446798 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.446798 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.446798 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.448233 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 10:31:48.448233 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 10:31:48.448233 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 28 10:31:48.448233 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.450549 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-14c76de5-c910-4938-bb66-8589f34c7eb6 tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:48.452135 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-14c76de5-c910-4938-bb66-8589f34c7eb6 tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-hosts/n-d-850468-6" status: 400 len: 127 microversion: 2.1 time: 0.024649 Jul 28 10:31:48.460805 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 228/402] 10.222.0.46 () {60 vars in 1187 bytes} [Thu Jul 28 10:31:48 2022] PUT /compute/v2.1/os-hosts/n-d-850468-6 => generated 127 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:31:48.468565 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-36a9e329-3015-4ad2-aea0-ab61d6d14e1f tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Action: 'update', calling method: .version_select at 0x7fa9580c58b0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:48.477193 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.compute.hosts [None req-36a9e329-3015-4ad2-aea0-ab61d6d14e1f tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Enabling host nonexistent_hostname. Jul 28 10:31:48.500090 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-36a9e329-3015-4ad2-aea0-ab61d6d14e1f tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.502700 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-36a9e329-3015-4ad2-aea0-ab61d6d14e1f tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Request method failure captured: Jul 28 10:31:48.502700 n-d-850468-6 devstack@n-api.service[119464]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 28 10:31:48.502700 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:31:48.502700 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:31:48.502700 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:31:48.502700 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 50 Jul 28 10:31:48.502700 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:31:48.502700 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:31:48.502700 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:31:48.502700 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:48.502700 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWRA8WUYp2b-Fh-cLEl1nrIa0AMzCkozvxTEc4clj3qaM2fj1m7wiuDBlV2amK844xWRCb2208IWGYQEtoOPEGa2xVFtPc-urQNe62Ofx-wIZXIo4Rb8nSSqq-O4lK7jRcnB8lblcI0DOTo7dty0SWhzvND2NvN2SODkfvlmxPZ8io Jul 28 10:31:48.502700 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:31:48.502700 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:31:48.502700 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:31:48.502700 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:31:48.502700 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:31:48.502700 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:31:48.502700 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: fef455a3ad294b5aa277e84c479f441f Jul 28 10:31:48.502700 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.502700 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:31:48.502700 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:31:48.505242 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fef455a3ad294b5aa277e84c479f441f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fef455a3ad294b5aa277e84c479f441f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:48.505242 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.505242 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: fef455a3ad294b5aa277e84c479f441f Jul 28 10:31:48.505242 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-427902840 Jul 28 10:31:48.505242 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-HostsAdminNegativeTestJSON-427902840-project-admin Jul 28 10:31:48.505242 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:31:48.505242 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:31:48.505242 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 4337e1e6b6a748189a4cf2b3bb4a6184 Jul 28 10:31:48.505242 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-HostsAdminNegativeTestJSON-427902840-project-admin Jul 28 10:31:48.505242 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:31:48.505242 n-d-850468-6 devstack@n-api.service[119464]: {"status": "enable", "maintenance_mode": "enable"} Jul 28 10:31:48.505242 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:31:48.505242 n-d-850468-6 devstack@n-api.service[119464]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.505242 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 28 10:31:48.507217 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:48.507217 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.507217 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 28 10:31:48.507217 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 28 10:31:48.507217 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 10:31:48.507217 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 10:31:48.507217 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:31:48.507217 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:31:48.507217 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:31:48.507217 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:31:48.507217 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 10:31:48.507217 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 10:31:48.507217 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5941, in targeted Jul 28 10:31:48.507217 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 28 10:31:48.507217 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:31:48.507217 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:31:48.507217 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 28 10:31:48.507217 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 28 10:31:48.508307 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:31:48.508307 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:31:48.508307 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 28 10:31:48.508307 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 28 10:31:48.508307 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.508307 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.508307 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:48.508307 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.508307 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.508307 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.508307 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.508307 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:48.508307 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:48.508307 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:31:48.508307 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:31:48.508307 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:48.508307 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:48.508307 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:31:48.508307 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:31:48.508307 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 28 10:31:48.509493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 28 10:31:48.509493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 28 10:31:48.509493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:31:48.509493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.509493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.509493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:48.509493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.509493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:48.509493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:48.509493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:48.509493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:31:48.509493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:31:48.509493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 10:31:48.509493 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:48.512274 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-36a9e329-3015-4ad2-aea0-ab61d6d14e1f tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:48.515753 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-36a9e329-3015-4ad2-aea0-ab61d6d14e1f tempest-HostsAdminNegativeTestJSON-427902840 tempest-HostsAdminNegativeTestJSON-427902840-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.053540 Jul 28 10:31:48.517803 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 229/403] 10.222.0.46 () {60 vars in 1211 bytes} [Thu Jul 28 10:31:48 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:31:49.247353 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-22206243-6368-4027-a940-f65688ae07f7 tempest-SecurityGroupsTestAdminJSON-1787477959 tempest-SecurityGroupsTestAdminJSON-1787477959-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/17490d95-a610-4fc7-a642-36de5397e8f6" status: 202 len: 0 microversion: 2.1 time: 1.601147 Jul 28 10:31:49.248794 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 175/404] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:31:47 2022] DELETE /compute/v2.1/os-security-groups/17490d95-a610-4fc7-a642-36de5397e8f6 => generated 0 bytes in 1605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:31:49.259746 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f15d6fa7-a2e5-4e57-8e93-b8f2ee775ef3 tempest-SecurityGroupsTestAdminJSON-1963420539 tempest-SecurityGroupsTestAdminJSON-1963420539-project] Calling method '.version_select at 0x7fa95a5dba60>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:49.772036 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:50.136938 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f15d6fa7-a2e5-4e57-8e93-b8f2ee775ef3 tempest-SecurityGroupsTestAdminJSON-1963420539 tempest-SecurityGroupsTestAdminJSON-1963420539-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/7f4b49cd-33f0-4466-9a3e-29b3fbf9d7f1" status: 202 len: 0 microversion: 2.1 time: 0.879409 Jul 28 10:31:50.138531 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 230/405] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:31:49 2022] DELETE /compute/v2.1/os-security-groups/7f4b49cd-33f0-4466-9a3e-29b3fbf9d7f1 => generated 0 bytes in 886 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:31:50.152292 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0b950955-1e24-4afc-ab0c-4442b64af8d2 tempest-SecurityGroupsTestAdminJSON-1963420539 tempest-SecurityGroupsTestAdminJSON-1963420539-project] Calling method '.version_select at 0x7fa9585c7dc0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:51.240245 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-0b950955-1e24-4afc-ab0c-4442b64af8d2 tempest-SecurityGroupsTestAdminJSON-1963420539 tempest-SecurityGroupsTestAdminJSON-1963420539-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/2b1885ee-657c-4e17-aad7-96e4ed055165" status: 202 len: 0 microversion: 2.1 time: 1.096475 Jul 28 10:31:51.241299 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 176/406] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:31:50 2022] DELETE /compute/v2.1/os-security-groups/2b1885ee-657c-4e17-aad7-96e4ed055165 => generated 0 bytes in 1099 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:31:56.342360 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=12 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:56.761785 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=43,nova_cell0:UPDATE=7 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:56.762564 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=8 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:56.763390 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:56.779255 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:UPDATE=10,nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:31:56.924075 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5927d1a7-29f1-4d4a-9ea1-0e8c9fbf001a tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-2007261408", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": "none"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:57.016574 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5927d1a7-29f1-4d4a-9ea1-0e8c9fbf001a tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:31:57.017008 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5927d1a7-29f1-4d4a-9ea1-0e8c9fbf001a tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:31:57.017750 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5927d1a7-29f1-4d4a-9ea1-0e8c9fbf001a tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:31:57.018279 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5927d1a7-29f1-4d4a-9ea1-0e8c9fbf001a tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:31:57.018722 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5927d1a7-29f1-4d4a-9ea1-0e8c9fbf001a tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:31:57.032901 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5927d1a7-29f1-4d4a-9ea1-0e8c9fbf001a tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:57.033353 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5927d1a7-29f1-4d4a-9ea1-0e8c9fbf001a tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:57.039628 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5927d1a7-29f1-4d4a-9ea1-0e8c9fbf001a tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:57.040084 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5927d1a7-29f1-4d4a-9ea1-0e8c9fbf001a tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:57.067995 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-5927d1a7-29f1-4d4a-9ea1-0e8c9fbf001a tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Getting quotas for project bd770f94551945edbc610bba2ca5d780. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:31:57.073985 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-5927d1a7-29f1-4d4a-9ea1-0e8c9fbf001a tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Getting quotas for user 0089e849340246ae8707e1e13a59fe76 and project bd770f94551945edbc610bba2ca5d780. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:31:57.090340 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5927d1a7-29f1-4d4a-9ea1-0e8c9fbf001a tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:31:57.093466 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5927d1a7-29f1-4d4a-9ea1-0e8c9fbf001a tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] [instance: 646da62b-6a8b-4d28-97de-45ccf7b69e10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:31:57.171500 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-5927d1a7-29f1-4d4a-9ea1-0e8c9fbf001a tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.836944 Jul 28 10:31:57.173787 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 231/407] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Jul 28 10:31:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 28 10:31:57.191328 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-75685745-ca26-40c9-8376-328d4c964d5c tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:57.201077 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-75685745-ca26-40c9-8376-328d4c964d5c tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] [instance: 646da62b-6a8b-4d28-97de-45ccf7b69e10] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:31:57.407602 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-75685745-ca26-40c9-8376-328d4c964d5c tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0089e849340246ae8707e1e13a59fe76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd770f94551945edbc610bba2ca5d780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:57.420791 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-75685745-ca26-40c9-8376-328d4c964d5c tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0089e849340246ae8707e1e13a59fe76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd770f94551945edbc610bba2ca5d780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:57.426827 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-75685745-ca26-40c9-8376-328d4c964d5c tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0089e849340246ae8707e1e13a59fe76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd770f94551945edbc610bba2ca5d780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:57.446331 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-75685745-ca26-40c9-8376-328d4c964d5c tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] 10.222.0.46 "PUT /compute/v2.1/servers/646da62b-6a8b-4d28-97de-45ccf7b69e10" status: 200 len: 1359 microversion: 2.75 time: 0.261534 Jul 28 10:31:57.448429 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 232/408] 10.222.0.46 () {62 vars in 1297 bytes} [Thu Jul 28 10:31:57 2022] PUT /compute/v2.1/servers/646da62b-6a8b-4d28-97de-45ccf7b69e10 => generated 1359 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:31:57.472460 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d7941858-aafd-4d96-8af8-507ee6f94ee7 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:57.473590 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-d7941858-aafd-4d96-8af8-507ee6f94ee7 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] [instance: 646da62b-6a8b-4d28-97de-45ccf7b69e10] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:31:57.621481 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-d7941858-aafd-4d96-8af8-507ee6f94ee7 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0089e849340246ae8707e1e13a59fe76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd770f94551945edbc610bba2ca5d780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:57.641387 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-d7941858-aafd-4d96-8af8-507ee6f94ee7 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0089e849340246ae8707e1e13a59fe76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd770f94551945edbc610bba2ca5d780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:57.647102 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-d7941858-aafd-4d96-8af8-507ee6f94ee7 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0089e849340246ae8707e1e13a59fe76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd770f94551945edbc610bba2ca5d780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:57.661626 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-d7941858-aafd-4d96-8af8-507ee6f94ee7 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] 10.222.0.46 "GET /compute/v2.1/servers/646da62b-6a8b-4d28-97de-45ccf7b69e10" status: 200 len: 1359 microversion: 2.75 time: 0.193632 Jul 28 10:31:57.663594 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 233/409] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:31:57 2022] GET /compute/v2.1/servers/646da62b-6a8b-4d28-97de-45ccf7b69e10 => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:31:57.708571 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f475300d-d2ce-49d6-8071-47e6e9033033 tempest-FloatingIPsNegativeTestJSON-197756891 tempest-FloatingIPsNegativeTestJSON-197756891-project] Calling method '.version_select at 0x7fa94beec820>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:57.808233 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f475300d-d2ce-49d6-8071-47e6e9033033 tempest-FloatingIPsNegativeTestJSON-197756891 tempest-FloatingIPsNegativeTestJSON-197756891-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 1.050552 Jul 28 10:31:57.809098 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 177/410] 10.222.0.46 () {58 vars in 1149 bytes} [Thu Jul 28 10:31:56 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:31:57.839861 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-207df7ad-89fc-4b3c-bdf0-bcc844cc345c tempest-FloatingIPsNegativeTestJSON-197756891 tempest-FloatingIPsNegativeTestJSON-197756891-project] Action: 'create', calling method: .version_select at 0x7fa94bd8a5e0>, body: {"pool": "non_exist_pool"} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:57.938633 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-207df7ad-89fc-4b3c-bdf0-bcc844cc345c tempest-FloatingIPsNegativeTestJSON-197756891 tempest-FloatingIPsNegativeTestJSON-197756891-project] HTTP exception thrown: Floating IP pool not found. Jul 28 10:31:57.945122 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-207df7ad-89fc-4b3c-bdf0-bcc844cc345c tempest-FloatingIPsNegativeTestJSON-197756891 tempest-FloatingIPsNegativeTestJSON-197756891-project] Request method failure captured: Jul 28 10:31:57.945122 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 28 10:31:57.945122 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:31:57.945122 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:31:57.945122 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:31:57.945122 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 26 Jul 28 10:31:57.945122 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:31:57.945122 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:31:57.945122 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:31:57.945122 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:57.945122 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWcd2w9MVtQiEu9jn2x2yiijogFihL7mEV1HPCNhjrY2TGa9TbZjDRNRHyfsJB5d9Jksj1-wAX88ejjaIIRyV2pTLHrO8aLIZmwCuQSyo6SXqS4XgOTZ4rqW4A44gVczfaLK0YP6dxpObyiPhJCMZ7cJWq3DtxnsrOyzuovLPC1UC8 Jul 28 10:31:57.945122 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:31:57.945122 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:31:57.945122 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:31:57.945122 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:31:57.945122 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:31:57.945122 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:31:57.945122 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: f1a9c88f254242c0a0a2cd70a69834d4 Jul 28 10:31:57.945122 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-197756891 Jul 28 10:31:57.945122 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:31:57.945122 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:31:57.946366 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f1a9c88f254242c0a0a2cd70a69834d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f1a9c88f254242c0a0a2cd70a69834d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f1a9c88f254242c0a0a2cd70a69834d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f1a9c88f254242c0a0a2cd70a69834d4", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:57.946366 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-197756891 Jul 28 10:31:57.946366 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: f1a9c88f254242c0a0a2cd70a69834d4 Jul 28 10:31:57.946366 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-197756891 Jul 28 10:31:57.946366 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-FloatingIPsNegativeTestJSON-197756891-project Jul 28 10:31:57.946366 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:31:57.946366 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:31:57.946366 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 9321912e497646ea9c1a4d7684d5c1b0 Jul 28 10:31:57.946366 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-197756891-project Jul 28 10:31:57.946366 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:31:57.946366 n-d-850468-6 devstack@n-api.service[119464]: {"pool": "non_exist_pool"} Jul 28 10:31:57.946366 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:31:57.946366 n-d-850468-6 devstack@n-api.service[119464]: exception: Floating IP pool not found. Jul 28 10:31:57.946366 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 28 10:31:57.946366 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:57.947459 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:57.947459 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 28 10:31:57.947459 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 28 10:31:57.947459 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 28 10:31:57.947459 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 28 10:31:57.947459 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 28 10:31:57.947459 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 28 10:31:57.947459 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 28 10:31:57.947459 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:57.947459 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:57.947459 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:57.947459 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:57.947459 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:57.947459 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:57.947459 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:57.947459 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:57.947459 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:31:57.947459 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:31:57.947459 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:57.947459 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:57.948616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 28 10:31:57.948616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:31:57.948616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 28 10:31:57.948616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:57.948616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:57.948616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:57.948616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:57.948616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:57.948616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:57.948616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:31:57.948616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:31:57.948616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 28 10:31:57.948616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:31:57.948616 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-207df7ad-89fc-4b3c-bdf0-bcc844cc345c tempest-FloatingIPsNegativeTestJSON-197756891 tempest-FloatingIPsNegativeTestJSON-197756891-project] Returning 404 to user: Floating IP pool not found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:57.954295 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-207df7ad-89fc-4b3c-bdf0-bcc844cc345c tempest-FloatingIPsNegativeTestJSON-197756891 tempest-FloatingIPsNegativeTestJSON-197756891-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.124788 Jul 28 10:31:57.955533 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 234/411] 10.222.0.46 () {60 vars in 1170 bytes} [Thu Jul 28 10:31:57 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:31:57.966029 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0c2e3e84-26ae-441b-bd5d-e762d5606a20 tempest-FloatingIPsNegativeTestJSON-197756891 tempest-FloatingIPsNegativeTestJSON-197756891-project] Calling method '.version_select at 0x7fa94bf87310>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:58.021399 n-d-850468-6 devstack@n-api.service[119463]: DEBUG neutronclient.v2_0.client [None req-0c2e3e84-26ae-441b-bd5d-e762d5606a20 tempest-FloatingIPsNegativeTestJSON-197756891 tempest-FloatingIPsNegativeTestJSON-197756891-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e0a0ed32-379f-4a7e-9a39-03ad626e9e03 could not be found", "detail": ""}} {{(pid=119463) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 10:31:58.022306 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-0c2e3e84-26ae-441b-bd5d-e762d5606a20 tempest-FloatingIPsNegativeTestJSON-197756891 tempest-FloatingIPsNegativeTestJSON-197756891-project] HTTP exception thrown: Floating IP not found for ID e0a0ed32-379f-4a7e-9a39-03ad626e9e03 Jul 28 10:31:58.024191 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0c2e3e84-26ae-441b-bd5d-e762d5606a20 tempest-FloatingIPsNegativeTestJSON-197756891 tempest-FloatingIPsNegativeTestJSON-197756891-project] Request method failure captured: Jul 28 10:31:58.024191 n-d-850468-6 devstack@n-api.service[119463]: request: DELETE /compute/v2.1/os-floating-ips/e0a0ed32-379f-4a7e-9a39-03ad626e9e03 HTTP/1.1 Jul 28 10:31:58.024191 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:31:58.024191 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:31:58.024191 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:31:58.024191 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:31:58.024191 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:31:58.024191 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:31:58.024191 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:31:58.024191 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:31:58.024191 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mWcd2w9MVtQiEu9jn2x2yiijogFihL7mEV1HPCNhjrY2TGa9TbZjDRNRHyfsJB5d9Jksj1-wAX88ejjaIIRyV2pTLHrO8aLIZmwCuQSyo6SXqS4XgOTZ4rqW4A44gVczfaLK0YP6dxpObyiPhJCMZ7cJWq3DtxnsrOyzuovLPC1UC8 Jul 28 10:31:58.024191 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:31:58.024191 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:31:58.024191 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:31:58.024191 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:31:58.024191 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:31:58.024191 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:31:58.024191 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: f1a9c88f254242c0a0a2cd70a69834d4 Jul 28 10:31:58.024191 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-197756891 Jul 28 10:31:58.024191 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:31:58.024191 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:31:58.025661 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f1a9c88f254242c0a0a2cd70a69834d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f1a9c88f254242c0a0a2cd70a69834d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f1a9c88f254242c0a0a2cd70a69834d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f1a9c88f254242c0a0a2cd70a69834d4", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:31:58.025661 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-197756891 Jul 28 10:31:58.025661 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: f1a9c88f254242c0a0a2cd70a69834d4 Jul 28 10:31:58.025661 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-197756891 Jul 28 10:31:58.025661 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-FloatingIPsNegativeTestJSON-197756891-project Jul 28 10:31:58.025661 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:31:58.025661 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:31:58.025661 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 9321912e497646ea9c1a4d7684d5c1b0 Jul 28 10:31:58.025661 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-197756891-project Jul 28 10:31:58.025661 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:31:58.025661 n-d-850468-6 devstack@n-api.service[119463]: exception: Floating IP not found for ID e0a0ed32-379f-4a7e-9a39-03ad626e9e03 Jul 28 10:31:58.025661 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'e0a0ed32-379f-4a7e-9a39-03ad626e9e03'} Jul 28 10:31:58.025661 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:31:58.026514 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:58.026514 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 28 10:31:58.026514 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 28 10:31:58.026514 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:31:58.026514 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:31:58.026514 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 28 10:31:58.026514 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 28 10:31:58.026514 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:31:58.026514 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:31:58.026514 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 10:31:58.026514 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 10:31:58.026514 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:31:58.026514 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:31:58.026514 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 10:31:58.026514 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 10:31:58.026514 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:31:58.026514 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:31:58.026514 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 10:31:58.026514 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 10:31:58.027836 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:31:58.027836 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:31:58.027836 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 10:31:58.027836 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 10:31:58.027836 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 10:31:58.027836 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 10:31:58.027836 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e0a0ed32-379f-4a7e-9a39-03ad626e9e03 could not be found Jul 28 10:31:58.027836 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a72b304-f9bb-47d8-a207-6112d0c68af8'] Jul 28 10:31:58.027836 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:58.027836 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:58.027836 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:58.027836 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:58.027836 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 28 10:31:58.027836 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 28 10:31:58.027836 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 28 10:31:58.027836 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 28 10:31:58.027836 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e0a0ed32-379f-4a7e-9a39-03ad626e9e03. Jul 28 10:31:58.027836 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:58.027836 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:58.027836 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:58.029198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:58.029198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:58.029198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:58.029198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:31:58.029198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:31:58.029198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:31:58.029198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:31:58.029198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:31:58.029198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:31:58.029198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 28 10:31:58.029198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 10:31:58.029198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e0a0ed32-379f-4a7e-9a39-03ad626e9e03 Jul 28 10:31:58.029198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:58.029198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:31:58.029198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:58.029198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:31:58.029198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:31:58.029198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:31:58.029198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:31:58.029198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:31:58.031047 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e0a0ed32-379f-4a7e-9a39-03ad626e9e03 Jul 28 10:31:58.031047 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:31:58.031675 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0c2e3e84-26ae-441b-bd5d-e762d5606a20 tempest-FloatingIPsNegativeTestJSON-197756891 tempest-FloatingIPsNegativeTestJSON-197756891-project] Returning 404 to user: Floating IP not found for ID e0a0ed32-379f-4a7e-9a39-03ad626e9e03 {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:31:58.034092 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-0c2e3e84-26ae-441b-bd5d-e762d5606a20 tempest-FloatingIPsNegativeTestJSON-197756891 tempest-FloatingIPsNegativeTestJSON-197756891-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/e0a0ed32-379f-4a7e-9a39-03ad626e9e03" status: 404 len: 111 microversion: 2.1 time: 0.072351 Jul 28 10:31:58.035813 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 178/412] 10.222.0.46 () {58 vars in 1263 bytes} [Thu Jul 28 10:31:57 2022] DELETE /compute/v2.1/os-floating-ips/e0a0ed32-379f-4a7e-9a39-03ad626e9e03 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:31:58.695796 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-53a33e36-937f-44f1-9514-99db1e56de74 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:58.699430 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-53a33e36-937f-44f1-9514-99db1e56de74 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] [instance: 646da62b-6a8b-4d28-97de-45ccf7b69e10] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:31:58.727809 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-53a33e36-937f-44f1-9514-99db1e56de74 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:58.731540 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-53a33e36-937f-44f1-9514-99db1e56de74 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:58.738465 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-53a33e36-937f-44f1-9514-99db1e56de74 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:58.739473 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-53a33e36-937f-44f1-9514-99db1e56de74 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:58.885520 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-53a33e36-937f-44f1-9514-99db1e56de74 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:58.886420 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-53a33e36-937f-44f1-9514-99db1e56de74 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:58.887099 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-53a33e36-937f-44f1-9514-99db1e56de74 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lazy-loading 'fault' on Instance uuid 646da62b-6a8b-4d28-97de-45ccf7b69e10 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:31:59.155281 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-53a33e36-937f-44f1-9514-99db1e56de74 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0089e849340246ae8707e1e13a59fe76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd770f94551945edbc610bba2ca5d780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:59.165014 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-53a33e36-937f-44f1-9514-99db1e56de74 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0089e849340246ae8707e1e13a59fe76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd770f94551945edbc610bba2ca5d780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:59.172688 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-53a33e36-937f-44f1-9514-99db1e56de74 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0089e849340246ae8707e1e13a59fe76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd770f94551945edbc610bba2ca5d780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:31:59.187047 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-53a33e36-937f-44f1-9514-99db1e56de74 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] 10.222.0.46 "GET /compute/v2.1/servers/646da62b-6a8b-4d28-97de-45ccf7b69e10" status: 200 len: 1432 microversion: 2.75 time: 0.496789 Jul 28 10:31:59.193156 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 235/413] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:31:58 2022] GET /compute/v2.1/servers/646da62b-6a8b-4d28-97de-45ccf7b69e10 => generated 1432 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:31:59.216484 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-217c098f-3760-4d24-bd0b-d8a603ef3ed3 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:59.217892 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-217c098f-3760-4d24-bd0b-d8a603ef3ed3 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] [instance: 646da62b-6a8b-4d28-97de-45ccf7b69e10] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:31:59.231028 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-217c098f-3760-4d24-bd0b-d8a603ef3ed3 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:59.231940 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-217c098f-3760-4d24-bd0b-d8a603ef3ed3 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:59.232993 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-217c098f-3760-4d24-bd0b-d8a603ef3ed3 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:59.234561 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-217c098f-3760-4d24-bd0b-d8a603ef3ed3 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:59.293102 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-217c098f-3760-4d24-bd0b-d8a603ef3ed3 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] [instance: 646da62b-6a8b-4d28-97de-45ccf7b69e10] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:31:59.401549 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-217c098f-3760-4d24-bd0b-d8a603ef3ed3 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] [instance: 646da62b-6a8b-4d28-97de-45ccf7b69e10] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:31:59.406007 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-217c098f-3760-4d24-bd0b-d8a603ef3ed3 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:31:59.406645 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-217c098f-3760-4d24-bd0b-d8a603ef3ed3 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:31:59.407539 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-217c098f-3760-4d24-bd0b-d8a603ef3ed3 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] [instance: 646da62b-6a8b-4d28-97de-45ccf7b69e10] instance's host None is down, deleting from database Jul 28 10:31:59.418447 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-217c098f-3760-4d24-bd0b-d8a603ef3ed3 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] [instance: 646da62b-6a8b-4d28-97de-45ccf7b69e10] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:31:59.520588 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-217c098f-3760-4d24-bd0b-d8a603ef3ed3 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] [instance: 646da62b-6a8b-4d28-97de-45ccf7b69e10] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:31:59.527331 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-217c098f-3760-4d24-bd0b-d8a603ef3ed3 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] [instance: 646da62b-6a8b-4d28-97de-45ccf7b69e10] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:31:59.977503 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-217c098f-3760-4d24-bd0b-d8a603ef3ed3 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] 10.222.0.46 "DELETE /compute/v2.1/servers/646da62b-6a8b-4d28-97de-45ccf7b69e10" status: 204 len: 0 microversion: 2.75 time: 0.765375 Jul 28 10:31:59.980796 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 179/414] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:31:59 2022] DELETE /compute/v2.1/servers/646da62b-6a8b-4d28-97de-45ccf7b69e10 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:31:59.995953 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-da31467e-168d-44cf-b76f-0773ced3ea95 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:59.997057 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-da31467e-168d-44cf-b76f-0773ced3ea95 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] [instance: 646da62b-6a8b-4d28-97de-45ccf7b69e10] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:00.016438 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-da31467e-168d-44cf-b76f-0773ced3ea95 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:00.017807 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-da31467e-168d-44cf-b76f-0773ced3ea95 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:00.021211 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-da31467e-168d-44cf-b76f-0773ced3ea95 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:00.022210 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-da31467e-168d-44cf-b76f-0773ced3ea95 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:00.234819 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-da31467e-168d-44cf-b76f-0773ced3ea95 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] HTTP exception thrown: Instance 646da62b-6a8b-4d28-97de-45ccf7b69e10 could not be found. Jul 28 10:32:00.239954 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-da31467e-168d-44cf-b76f-0773ced3ea95 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Request method failure captured: Jul 28 10:32:00.239954 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/646da62b-6a8b-4d28-97de-45ccf7b69e10 HTTP/1.1 Jul 28 10:32:00.239954 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:32:00.239954 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:32:00.239954 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:32:00.239954 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:32:00.239954 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:32:00.239954 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:32:00.239954 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:32:00.239954 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:00.239954 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mWYTFme1gp5k8QAc4nVWILuCOsqrRLiSYl_OYUhCLs5Jt6e9HoAB5a1Qolla7GchHkbCIJ9w9wal_DEdy6QHbdklkcbn_uj8-x0WKt_1-HH82JMCRs5flZnNU3NlbS38QL7p3k4Mzw9jQVavUE-MR9EmFhXo2p7uHq-wG9zLYLjSyk Jul 28 10:32:00.239954 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:32:00.239954 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:32:00.239954 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:32:00.239954 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:32:00.239954 n-d-850468-6 devstack@n-api.service[119463]: X-Openstack-Nova-Api-Version: 2.75 Jul 28 10:32:00.239954 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:32:00.239954 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:32:00.239954 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: bd770f94551945edbc610bba2ca5d780 Jul 28 10:32:00.239954 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServersAdmin275Test-667277790 Jul 28 10:32:00.239954 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:32:00.239954 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:32:00.241561 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bd770f94551945edbc610bba2ca5d780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bd770f94551945edbc610bba2ca5d780"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bd770f94551945edbc610bba2ca5d780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bd770f94551945edbc610bba2ca5d780", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:00.241561 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServersAdmin275Test-667277790 Jul 28 10:32:00.241561 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: bd770f94551945edbc610bba2ca5d780 Jul 28 10:32:00.241561 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServersAdmin275Test-667277790 Jul 28 10:32:00.241561 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServersAdmin275Test-667277790-project Jul 28 10:32:00.241561 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:32:00.241561 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:32:00.241561 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 0089e849340246ae8707e1e13a59fe76 Jul 28 10:32:00.241561 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServersAdmin275Test-667277790-project Jul 28 10:32:00.241561 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:32:00.241561 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 646da62b-6a8b-4d28-97de-45ccf7b69e10 could not be found. Jul 28 10:32:00.241561 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '646da62b-6a8b-4d28-97de-45ccf7b69e10'} Jul 28 10:32:00.242471 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:00.242471 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:00.242471 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:32:00.242471 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:32:00.242471 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:32:00.242471 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:32:00.242471 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:32:00.242471 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:32:00.242471 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:32:00.242471 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:32:00.242471 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 646da62b-6a8b-4d28-97de-45ccf7b69e10 could not be found. Jul 28 10:32:00.242471 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:00.242471 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:00.242471 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:00.242471 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:00.242471 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:00.242471 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:00.242471 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:00.242471 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:00.242471 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:00.243872 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:00.243872 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:32:00.243872 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:32:00.243872 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:32:00.243872 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:32:00.243872 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:32:00.243872 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:32:00.243872 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 646da62b-6a8b-4d28-97de-45ccf7b69e10 could not be found. Jul 28 10:32:00.243872 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:00.243872 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:00.243872 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:00.243872 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:00.243872 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:00.243872 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:00.243872 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:00.243872 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:00.243872 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 646da62b-6a8b-4d28-97de-45ccf7b69e10 could not be found. Jul 28 10:32:00.243872 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:00.249381 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-da31467e-168d-44cf-b76f-0773ced3ea95 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] Returning 404 to user: Instance 646da62b-6a8b-4d28-97de-45ccf7b69e10 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:00.250466 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-da31467e-168d-44cf-b76f-0773ced3ea95 tempest-ServersAdmin275Test-667277790 tempest-ServersAdmin275Test-667277790-project] 10.222.0.46 "GET /compute/v2.1/servers/646da62b-6a8b-4d28-97de-45ccf7b69e10" status: 404 len: 111 microversion: 2.75 time: 0.266691 Jul 28 10:32:00.251235 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 180/415] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:31:59 2022] GET /compute/v2.1/servers/646da62b-6a8b-4d28-97de-45ccf7b69e10 => generated 111 bytes in 268 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 10:32:00.419208 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-22d2ff68-399d-4af9-a926-f2c8793de54f tempest-QuotaClassesAdminTestJSON-1778456586 tempest-QuotaClassesAdminTestJSON-1778456586-project-admin] Calling method '.version_select at 0x7fa94bd8ae50>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:00.422415 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:32:00.422415 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:32:00.466374 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-22d2ff68-399d-4af9-a926-f2c8793de54f tempest-QuotaClassesAdminTestJSON-1778456586 tempest-QuotaClassesAdminTestJSON-1778456586-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.740709 Jul 28 10:32:00.468180 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 236/416] 10.222.0.46 () {58 vars in 1185 bytes} [Thu Jul 28 10:31:59 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:00.481437 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4aa14772-b697-4931-b741-9108e90b84d8 tempest-QuotaClassesAdminTestJSON-1778456586 tempest-QuotaClassesAdminTestJSON-1778456586-project-admin] Action: 'update', calling method: .version_select at 0x7fa94be81b80>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:00.484842 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:32:00.484842 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:32:01.144780 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-4aa14772-b697-4931-b741-9108e90b84d8 tempest-QuotaClassesAdminTestJSON-1778456586 tempest-QuotaClassesAdminTestJSON-1778456586-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.662068 Jul 28 10:32:01.147443 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 181/417] 10.222.0.46 () {60 vars in 1206 bytes} [Thu Jul 28 10:32:00 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:01.169332 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f1898e5d-7708-4e1f-8098-4cfa99a4f3c4 tempest-QuotaClassesAdminTestJSON-1778456586 tempest-QuotaClassesAdminTestJSON-1778456586-project-admin] Calling method '.version_select at 0x7fa94bdcb3a0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:01.241676 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f1898e5d-7708-4e1f-8098-4cfa99a4f3c4 tempest-QuotaClassesAdminTestJSON-1778456586 tempest-QuotaClassesAdminTestJSON-1778456586-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.084428 Jul 28 10:32:01.244331 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 237/418] 10.222.0.46 () {58 vars in 1185 bytes} [Thu Jul 28 10:32:01 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:01.262190 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-de4c864b-0c7a-49f4-af70-881561a3ddb4 tempest-QuotaClassesAdminTestJSON-1778456586 tempest-QuotaClassesAdminTestJSON-1778456586-project-admin] Action: 'update', calling method: .version_select at 0x7fa94bfed9d0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:01.558450 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-de4c864b-0c7a-49f4-af70-881561a3ddb4 tempest-QuotaClassesAdminTestJSON-1778456586 tempest-QuotaClassesAdminTestJSON-1778456586-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.306772 Jul 28 10:32:01.559879 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 182/419] 10.222.0.46 () {60 vars in 1206 bytes} [Thu Jul 28 10:32:01 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:02.052343 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-60bcb8d7-5ad4-4a09-88f1-9f26fad7dc45 tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] Calling method '.version_select at 0x7fa9580c58b0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:02.097205 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-60bcb8d7-5ad4-4a09-88f1-9f26fad7dc45 tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] HTTP exception thrown: Image not found. Jul 28 10:32:02.109650 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-60bcb8d7-5ad4-4a09-88f1-9f26fad7dc45 tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] Request method failure captured: Jul 28 10:32:02.109650 n-d-850468-6 devstack@n-api.service[119464]: request: DELETE /compute/v2.1/images/5c4bb947-5ebe-4ddb-a9b7-1a40a92d020e/metadata/os_distro HTTP/1.1 Jul 28 10:32:02.109650 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:32:02.109650 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:32:02.109650 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:32:02.109650 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:32:02.109650 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:32:02.109650 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:32:02.109650 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:32:02.109650 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:02.109650 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWh--ZrS_gemVPg6TVQGnU8mPSmAWUBnl3yDjnQvDG-90f0t9yqjbr4dV--M_EaNj63dsuiCg7WgZ_7liPFmJHF6EmtA-FnrWWIZAER8wyQWOvHqO9uzEtECeLnv3PHDTZYdnvZ76sFB-1bvGAFPiAllFYPE9ZiGKfFX__jNxMXnhc Jul 28 10:32:02.109650 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:32:02.109650 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:32:02.109650 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:32:02.109650 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:32:02.109650 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:32:02.109650 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:32:02.109650 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 0eaafea849064964a1c49dcc8094758c Jul 28 10:32:02.109650 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1782954601 Jul 28 10:32:02.109650 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:32:02.109650 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:32:02.110892 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0eaafea849064964a1c49dcc8094758c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eaafea849064964a1c49dcc8094758c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eaafea849064964a1c49dcc8094758c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0eaafea849064964a1c49dcc8094758c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:02.110892 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1782954601 Jul 28 10:32:02.110892 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 0eaafea849064964a1c49dcc8094758c Jul 28 10:32:02.110892 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1782954601 Jul 28 10:32:02.110892 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ImagesMetadataNegativeTestJSON-1782954601-project Jul 28 10:32:02.110892 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:32:02.110892 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:32:02.110892 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 7873c5ed45c84d659c5dd740ef5edfc8 Jul 28 10:32:02.110892 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1782954601-project Jul 28 10:32:02.110892 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:32:02.110892 n-d-850468-6 devstack@n-api.service[119464]: exception: Image not found. Jul 28 10:32:02.110892 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'image_id': '5c4bb947-5ebe-4ddb-a9b7-1a40a92d020e', 'id': 'os_distro'} Jul 28 10:32:02.110892 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:02.111844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.111844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 10:32:02.111844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 10:32:02.111844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 10:32:02.111844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 10:32:02.111844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 10:32:02.111844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 10:32:02.111844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 10:32:02.111844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 10:32:02.111844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 10:32:02.111844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 10:32:02.111844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 10:32:02.111844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 10:32:02.111844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 10:32:02.111844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 10:32:02.111844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 10:32:02.111844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 10:32:02.111844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5c4bb947-5ebe-4ddb-a9b7-1a40a92d020e Jul 28 10:32:02.114088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.114088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:02.114088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.114088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.114088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 28 10:32:02.114088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 28 10:32:02.114088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 10:32:02.114088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 10:32:02.114088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 10:32:02.114088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 10:32:02.114088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 10:32:02.114088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 10:32:02.114088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 10:32:02.114088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 10:32:02.114088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 10:32:02.114088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 10:32:02.114088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 10:32:02.114088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 10:32:02.114088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 10:32:02.114088 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 10:32:02.115215 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 10:32:02.115215 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 10:32:02.115215 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 10:32:02.115215 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 10:32:02.115215 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 10:32:02.115215 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 10:32:02.115215 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 10:32:02.115215 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 10:32:02.115215 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5c4bb947-5ebe-4ddb-a9b7-1a40a92d020e could not be found. Jul 28 10:32:02.115215 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.115215 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:02.115215 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.115215 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.115215 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:02.115215 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:02.115215 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:02.115215 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:02.115215 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:32:02.115215 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:32:02.116301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:02.116301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:02.116301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 28 10:32:02.116301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 28 10:32:02.116301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 28 10:32:02.116301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 10:32:02.116301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 10:32:02.116301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.116301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:02.116301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.116301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.116301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:02.116301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:02.116301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:02.116301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:02.116301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 10:32:02.116301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.116301 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-60bcb8d7-5ad4-4a09-88f1-9f26fad7dc45 tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] Returning 404 to user: Image not found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:02.118721 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-60bcb8d7-5ad4-4a09-88f1-9f26fad7dc45 tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] 10.222.0.46 "DELETE /compute/v2.1/images/5c4bb947-5ebe-4ddb-a9b7-1a40a92d020e/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.587734 Jul 28 10:32:02.118721 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 238/420] 10.222.0.46 () {58 vars in 1293 bytes} [Thu Jul 28 10:32:01 2022] DELETE /compute/v2.1/images/5c4bb947-5ebe-4ddb-a9b7-1a40a92d020e/metadata/os_distro => generated 62 bytes in 595 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 28 10:32:02.124186 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-dce3aba4-f794-47f2-9d7c-98631da1c87b tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] Calling method '.version_select at 0x7fa94bfedf70>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:02.161015 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-dce3aba4-f794-47f2-9d7c-98631da1c87b tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] HTTP exception thrown: Image not found. Jul 28 10:32:02.172562 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-dce3aba4-f794-47f2-9d7c-98631da1c87b tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] Request method failure captured: Jul 28 10:32:02.172562 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/images/f654d5ca-44b7-4905-af55-b2aeab1c0705/metadata/os_version HTTP/1.1 Jul 28 10:32:02.172562 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:32:02.172562 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:32:02.172562 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:32:02.172562 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:32:02.172562 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:32:02.172562 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:32:02.172562 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:32:02.172562 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:02.172562 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mWh--ZrS_gemVPg6TVQGnU8mPSmAWUBnl3yDjnQvDG-90f0t9yqjbr4dV--M_EaNj63dsuiCg7WgZ_7liPFmJHF6EmtA-FnrWWIZAER8wyQWOvHqO9uzEtECeLnv3PHDTZYdnvZ76sFB-1bvGAFPiAllFYPE9ZiGKfFX__jNxMXnhc Jul 28 10:32:02.172562 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:32:02.172562 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:32:02.172562 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:32:02.172562 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:32:02.172562 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:32:02.172562 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:32:02.172562 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 0eaafea849064964a1c49dcc8094758c Jul 28 10:32:02.172562 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1782954601 Jul 28 10:32:02.172562 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:32:02.172562 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:32:02.174082 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0eaafea849064964a1c49dcc8094758c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eaafea849064964a1c49dcc8094758c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eaafea849064964a1c49dcc8094758c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0eaafea849064964a1c49dcc8094758c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:02.174082 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1782954601 Jul 28 10:32:02.174082 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 0eaafea849064964a1c49dcc8094758c Jul 28 10:32:02.174082 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1782954601 Jul 28 10:32:02.174082 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ImagesMetadataNegativeTestJSON-1782954601-project Jul 28 10:32:02.174082 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:32:02.174082 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:32:02.174082 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 7873c5ed45c84d659c5dd740ef5edfc8 Jul 28 10:32:02.174082 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1782954601-project Jul 28 10:32:02.174082 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:32:02.174082 n-d-850468-6 devstack@n-api.service[119463]: exception: Image not found. Jul 28 10:32:02.174082 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'image_id': 'f654d5ca-44b7-4905-af55-b2aeab1c0705', 'id': 'os_version'} Jul 28 10:32:02.174082 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:02.174877 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.174877 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 10:32:02.174877 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 10:32:02.174877 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 10:32:02.174877 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 10:32:02.174877 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 10:32:02.174877 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 10:32:02.174877 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 10:32:02.174877 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 10:32:02.174877 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 10:32:02.174877 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 10:32:02.174877 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 10:32:02.174877 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 10:32:02.174877 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 10:32:02.174877 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 10:32:02.174877 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 10:32:02.174877 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 10:32:02.174877 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f654d5ca-44b7-4905-af55-b2aeab1c0705 Jul 28 10:32:02.176143 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.176143 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:02.176143 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.176143 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.176143 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 28 10:32:02.176143 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 28 10:32:02.176143 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 10:32:02.176143 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 10:32:02.176143 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 10:32:02.176143 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 10:32:02.176143 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 10:32:02.176143 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 10:32:02.176143 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 10:32:02.176143 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 10:32:02.176143 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 10:32:02.176143 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 10:32:02.176143 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 10:32:02.176143 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 10:32:02.176143 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 10:32:02.176143 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 10:32:02.177227 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 10:32:02.177227 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 10:32:02.177227 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 10:32:02.177227 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 10:32:02.177227 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 10:32:02.177227 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 10:32:02.177227 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 10:32:02.177227 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 10:32:02.177227 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f654d5ca-44b7-4905-af55-b2aeab1c0705 could not be found. Jul 28 10:32:02.177227 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.177227 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:02.177227 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.177227 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.177227 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:02.177227 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:02.177227 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:02.177227 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:02.177227 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:32:02.177227 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:32:02.178276 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:02.178276 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:02.178276 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 28 10:32:02.178276 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 28 10:32:02.178276 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 28 10:32:02.178276 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 10:32:02.178276 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 10:32:02.178276 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.178276 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:02.178276 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.178276 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.178276 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:02.178276 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:02.178276 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:02.178276 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:02.178276 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 10:32:02.178276 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.178276 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-dce3aba4-f794-47f2-9d7c-98631da1c87b tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] Returning 404 to user: Image not found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:02.180098 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-dce3aba4-f794-47f2-9d7c-98631da1c87b tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] 10.222.0.46 "GET /compute/v2.1/images/f654d5ca-44b7-4905-af55-b2aeab1c0705/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.058979 Jul 28 10:32:02.186273 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 183/421] 10.222.0.46 () {58 vars in 1293 bytes} [Thu Jul 28 10:32:02 2022] GET /compute/v2.1/images/f654d5ca-44b7-4905-af55-b2aeab1c0705/metadata/os_version => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:32:02.195746 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ebb13ca1-309a-4c52-9325-c4ddb2473f60 tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] Calling method '.version_select at 0x7fa94bcdd310>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:02.236440 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-ebb13ca1-309a-4c52-9325-c4ddb2473f60 tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] HTTP exception thrown: Image not found. Jul 28 10:32:02.240445 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ebb13ca1-309a-4c52-9325-c4ddb2473f60 tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] Request method failure captured: Jul 28 10:32:02.240445 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/images/0763fb1c-ed3a-485b-9d83-3ff5144c8790/metadata HTTP/1.1 Jul 28 10:32:02.240445 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:32:02.240445 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:32:02.240445 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:32:02.240445 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:32:02.240445 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:32:02.240445 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:32:02.240445 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:32:02.240445 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:02.240445 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWh--ZrS_gemVPg6TVQGnU8mPSmAWUBnl3yDjnQvDG-90f0t9yqjbr4dV--M_EaNj63dsuiCg7WgZ_7liPFmJHF6EmtA-FnrWWIZAER8wyQWOvHqO9uzEtECeLnv3PHDTZYdnvZ76sFB-1bvGAFPiAllFYPE9ZiGKfFX__jNxMXnhc Jul 28 10:32:02.240445 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:32:02.240445 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:32:02.240445 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:32:02.240445 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:32:02.240445 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:32:02.240445 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:32:02.240445 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 0eaafea849064964a1c49dcc8094758c Jul 28 10:32:02.240445 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1782954601 Jul 28 10:32:02.240445 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:32:02.240445 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:32:02.241732 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0eaafea849064964a1c49dcc8094758c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eaafea849064964a1c49dcc8094758c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eaafea849064964a1c49dcc8094758c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0eaafea849064964a1c49dcc8094758c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:02.241732 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1782954601 Jul 28 10:32:02.241732 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 0eaafea849064964a1c49dcc8094758c Jul 28 10:32:02.241732 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1782954601 Jul 28 10:32:02.241732 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ImagesMetadataNegativeTestJSON-1782954601-project Jul 28 10:32:02.241732 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:32:02.241732 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:32:02.241732 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 7873c5ed45c84d659c5dd740ef5edfc8 Jul 28 10:32:02.241732 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1782954601-project Jul 28 10:32:02.241732 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:32:02.241732 n-d-850468-6 devstack@n-api.service[119464]: exception: Image not found. Jul 28 10:32:02.241732 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'image_id': '0763fb1c-ed3a-485b-9d83-3ff5144c8790'} Jul 28 10:32:02.241732 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:02.242557 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.242557 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 10:32:02.242557 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 10:32:02.242557 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 10:32:02.242557 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 10:32:02.242557 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 10:32:02.242557 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 10:32:02.242557 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 10:32:02.242557 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 10:32:02.242557 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 10:32:02.242557 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 10:32:02.242557 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 10:32:02.242557 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 10:32:02.242557 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 10:32:02.242557 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 10:32:02.242557 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 10:32:02.242557 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 10:32:02.242557 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0763fb1c-ed3a-485b-9d83-3ff5144c8790 Jul 28 10:32:02.243649 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.243649 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:02.243649 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.243649 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.243649 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 28 10:32:02.243649 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 28 10:32:02.243649 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 10:32:02.243649 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 10:32:02.243649 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 10:32:02.243649 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 10:32:02.243649 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 10:32:02.243649 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 10:32:02.243649 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 10:32:02.243649 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 10:32:02.243649 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 10:32:02.243649 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 10:32:02.243649 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 10:32:02.243649 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 10:32:02.243649 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 10:32:02.243649 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 10:32:02.252285 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 10:32:02.252285 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 10:32:02.252285 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 10:32:02.252285 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 10:32:02.252285 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 10:32:02.252285 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 10:32:02.252285 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 10:32:02.252285 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 10:32:02.252285 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0763fb1c-ed3a-485b-9d83-3ff5144c8790 could not be found. Jul 28 10:32:02.252285 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.252285 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:02.252285 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.252285 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.252285 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:02.252285 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:02.252285 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:02.252285 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:02.252285 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:32:02.252285 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:32:02.257335 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:02.257335 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:02.257335 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 28 10:32:02.257335 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 28 10:32:02.257335 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 28 10:32:02.257335 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 10:32:02.257335 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 10:32:02.257335 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.257335 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:02.257335 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.257335 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.257335 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:02.257335 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:02.257335 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:02.257335 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:02.257335 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 10:32:02.257335 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.257335 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ebb13ca1-309a-4c52-9325-c4ddb2473f60 tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] Returning 404 to user: Image not found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:02.262400 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ebb13ca1-309a-4c52-9325-c4ddb2473f60 tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] 10.222.0.46 "GET /compute/v2.1/images/0763fb1c-ed3a-485b-9d83-3ff5144c8790/metadata" status: 404 len: 62 microversion: 2.1 time: 0.055261 Jul 28 10:32:02.262400 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 239/422] 10.222.0.46 () {58 vars in 1260 bytes} [Thu Jul 28 10:32:02 2022] GET /compute/v2.1/images/0763fb1c-ed3a-485b-9d83-3ff5144c8790/metadata => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:32:02.262658 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-570290d2-31af-4e07-b0e3-d60bd51dfbea tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] Action: 'update_all', calling method: .version_select at 0x7fa94bebc940>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:02.294378 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-570290d2-31af-4e07-b0e3-d60bd51dfbea tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] HTTP exception thrown: Image not found. Jul 28 10:32:02.297294 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-570290d2-31af-4e07-b0e3-d60bd51dfbea tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] Request method failure captured: Jul 28 10:32:02.297294 n-d-850468-6 devstack@n-api.service[119463]: request: PUT /compute/v2.1/images/5a699ada-efaf-45dd-be6c-f79e9f70b8d4/metadata HTTP/1.1 Jul 28 10:32:02.297294 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:32:02.297294 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:32:02.297294 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:32:02.297294 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 57 Jul 28 10:32:02.297294 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:32:02.297294 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:32:02.297294 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:32:02.297294 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:02.297294 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mWh--ZrS_gemVPg6TVQGnU8mPSmAWUBnl3yDjnQvDG-90f0t9yqjbr4dV--M_EaNj63dsuiCg7WgZ_7liPFmJHF6EmtA-FnrWWIZAER8wyQWOvHqO9uzEtECeLnv3PHDTZYdnvZ76sFB-1bvGAFPiAllFYPE9ZiGKfFX__jNxMXnhc Jul 28 10:32:02.297294 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:32:02.297294 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:32:02.297294 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:32:02.297294 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:32:02.297294 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:32:02.297294 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:32:02.297294 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 0eaafea849064964a1c49dcc8094758c Jul 28 10:32:02.297294 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1782954601 Jul 28 10:32:02.297294 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:32:02.297294 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:32:02.298925 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0eaafea849064964a1c49dcc8094758c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eaafea849064964a1c49dcc8094758c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eaafea849064964a1c49dcc8094758c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0eaafea849064964a1c49dcc8094758c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:02.298925 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1782954601 Jul 28 10:32:02.298925 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 0eaafea849064964a1c49dcc8094758c Jul 28 10:32:02.298925 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1782954601 Jul 28 10:32:02.298925 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ImagesMetadataNegativeTestJSON-1782954601-project Jul 28 10:32:02.298925 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:32:02.298925 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:32:02.298925 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 7873c5ed45c84d659c5dd740ef5edfc8 Jul 28 10:32:02.298925 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1782954601-project Jul 28 10:32:02.298925 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:32:02.298925 n-d-850468-6 devstack@n-api.service[119463]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 28 10:32:02.298925 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:32:02.298925 n-d-850468-6 devstack@n-api.service[119463]: exception: Image not found. Jul 28 10:32:02.298925 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'image_id': '5a699ada-efaf-45dd-be6c-f79e9f70b8d4', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 28 10:32:02.299962 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:02.299962 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.299962 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 10:32:02.299962 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 10:32:02.299962 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 10:32:02.299962 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 10:32:02.299962 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 10:32:02.299962 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 10:32:02.299962 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 10:32:02.299962 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 10:32:02.299962 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 10:32:02.299962 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 10:32:02.299962 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 10:32:02.299962 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 10:32:02.299962 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 10:32:02.299962 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 10:32:02.299962 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 10:32:02.299962 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 10:32:02.300963 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5a699ada-efaf-45dd-be6c-f79e9f70b8d4 Jul 28 10:32:02.300963 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.300963 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:02.300963 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.300963 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.300963 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 28 10:32:02.300963 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 28 10:32:02.300963 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 10:32:02.300963 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 10:32:02.300963 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 10:32:02.300963 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 10:32:02.300963 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 10:32:02.300963 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 10:32:02.300963 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 10:32:02.300963 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 10:32:02.300963 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 10:32:02.300963 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 10:32:02.300963 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 10:32:02.300963 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 10:32:02.303241 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 10:32:02.303241 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 10:32:02.303241 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 10:32:02.303241 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 10:32:02.303241 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 10:32:02.303241 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 10:32:02.303241 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 10:32:02.303241 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 10:32:02.303241 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 10:32:02.303241 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 10:32:02.303241 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5a699ada-efaf-45dd-be6c-f79e9f70b8d4 could not be found. Jul 28 10:32:02.303241 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.303241 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:02.303241 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.303241 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.303241 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:02.303241 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:02.303241 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:02.303241 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:02.305090 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:32:02.305090 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:32:02.305090 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:02.305090 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:02.305090 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:02.305090 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:02.305090 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 28 10:32:02.305090 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 28 10:32:02.305090 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 28 10:32:02.305090 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 10:32:02.305090 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 10:32:02.305090 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.305090 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:02.305090 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.305090 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.305090 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:02.305090 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:02.305090 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:02.305090 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:02.305090 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 10:32:02.305090 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.309785 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-570290d2-31af-4e07-b0e3-d60bd51dfbea tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] Returning 404 to user: Image not found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:02.309785 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-570290d2-31af-4e07-b0e3-d60bd51dfbea tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] 10.222.0.46 "PUT /compute/v2.1/images/5a699ada-efaf-45dd-be6c-f79e9f70b8d4/metadata" status: 404 len: 62 microversion: 2.1 time: 0.051934 Jul 28 10:32:02.309785 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 184/423] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:32:02 2022] PUT /compute/v2.1/images/5a699ada-efaf-45dd-be6c-f79e9f70b8d4/metadata => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 28 10:32:02.314197 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1e13869a-a24c-4a25-81ff-be41bacfdad2 tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] Action: 'update', calling method: .version_select at 0x7fa94bdb79d0>, body: {"meta": {"os_distro": "alt"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:02.350789 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-1e13869a-a24c-4a25-81ff-be41bacfdad2 tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] HTTP exception thrown: Image not found. Jul 28 10:32:02.352926 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1e13869a-a24c-4a25-81ff-be41bacfdad2 tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] Request method failure captured: Jul 28 10:32:02.352926 n-d-850468-6 devstack@n-api.service[119464]: request: PUT /compute/v2.1/images/8f619746-d817-4712-823f-979dc61a8cf0/metadata/os_distro HTTP/1.1 Jul 28 10:32:02.352926 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:32:02.352926 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:32:02.352926 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:32:02.352926 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 30 Jul 28 10:32:02.352926 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:32:02.352926 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:32:02.352926 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:32:02.352926 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:02.352926 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWh--ZrS_gemVPg6TVQGnU8mPSmAWUBnl3yDjnQvDG-90f0t9yqjbr4dV--M_EaNj63dsuiCg7WgZ_7liPFmJHF6EmtA-FnrWWIZAER8wyQWOvHqO9uzEtECeLnv3PHDTZYdnvZ76sFB-1bvGAFPiAllFYPE9ZiGKfFX__jNxMXnhc Jul 28 10:32:02.352926 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:32:02.352926 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:32:02.352926 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:32:02.352926 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:32:02.352926 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:32:02.352926 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:32:02.352926 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 0eaafea849064964a1c49dcc8094758c Jul 28 10:32:02.352926 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1782954601 Jul 28 10:32:02.352926 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:32:02.352926 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:32:02.354201 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0eaafea849064964a1c49dcc8094758c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eaafea849064964a1c49dcc8094758c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eaafea849064964a1c49dcc8094758c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0eaafea849064964a1c49dcc8094758c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:02.354201 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1782954601 Jul 28 10:32:02.354201 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 0eaafea849064964a1c49dcc8094758c Jul 28 10:32:02.354201 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1782954601 Jul 28 10:32:02.354201 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ImagesMetadataNegativeTestJSON-1782954601-project Jul 28 10:32:02.354201 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:32:02.354201 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:32:02.354201 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 7873c5ed45c84d659c5dd740ef5edfc8 Jul 28 10:32:02.354201 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1782954601-project Jul 28 10:32:02.354201 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:32:02.354201 n-d-850468-6 devstack@n-api.service[119464]: {"meta": {"os_distro": "alt"}} Jul 28 10:32:02.354201 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:32:02.354201 n-d-850468-6 devstack@n-api.service[119464]: exception: Image not found. Jul 28 10:32:02.354201 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'image_id': '8f619746-d817-4712-823f-979dc61a8cf0', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 28 10:32:02.355160 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:02.355160 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.355160 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 10:32:02.355160 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 10:32:02.355160 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 10:32:02.355160 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 10:32:02.355160 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 10:32:02.355160 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 10:32:02.355160 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 10:32:02.355160 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 10:32:02.355160 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 10:32:02.355160 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 10:32:02.355160 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 10:32:02.355160 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 10:32:02.355160 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 10:32:02.355160 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 10:32:02.355160 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 10:32:02.355160 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 10:32:02.356137 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8f619746-d817-4712-823f-979dc61a8cf0 Jul 28 10:32:02.356137 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.356137 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:02.356137 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.356137 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.356137 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 28 10:32:02.356137 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 28 10:32:02.356137 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 10:32:02.356137 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 10:32:02.356137 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 10:32:02.356137 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 10:32:02.356137 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 10:32:02.356137 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 10:32:02.356137 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 10:32:02.356137 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 10:32:02.356137 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 10:32:02.356137 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 10:32:02.356137 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 10:32:02.356137 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 10:32:02.358500 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 10:32:02.358500 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 10:32:02.358500 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 10:32:02.358500 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 10:32:02.358500 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 10:32:02.358500 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 10:32:02.358500 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 10:32:02.358500 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 10:32:02.358500 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 10:32:02.358500 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 10:32:02.358500 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8f619746-d817-4712-823f-979dc61a8cf0 could not be found. Jul 28 10:32:02.358500 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.358500 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:02.358500 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.358500 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.358500 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:02.358500 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:02.358500 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:02.358500 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:02.360920 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:32:02.360920 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:32:02.360920 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:02.360920 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:02.360920 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:02.360920 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:02.360920 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 28 10:32:02.360920 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 28 10:32:02.360920 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 28 10:32:02.360920 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 10:32:02.360920 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 10:32:02.360920 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.360920 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:02.360920 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.360920 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.360920 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:02.360920 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:02.360920 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:02.360920 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:02.360920 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 10:32:02.360920 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.364235 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1e13869a-a24c-4a25-81ff-be41bacfdad2 tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] Returning 404 to user: Image not found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:02.364235 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1e13869a-a24c-4a25-81ff-be41bacfdad2 tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] 10.222.0.46 "PUT /compute/v2.1/images/8f619746-d817-4712-823f-979dc61a8cf0/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.044545 Jul 28 10:32:02.364235 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 240/424] 10.222.0.46 () {60 vars in 1310 bytes} [Thu Jul 28 10:32:02 2022] PUT /compute/v2.1/images/8f619746-d817-4712-823f-979dc61a8cf0/metadata/os_distro => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 28 10:32:02.370516 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-82028e75-22f2-4620-aaa6-bad471a6101b tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] Action: 'create', calling method: .version_select at 0x7fa94bebc3a0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:02.407428 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-82028e75-22f2-4620-aaa6-bad471a6101b tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] HTTP exception thrown: Image not found. Jul 28 10:32:02.410377 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-82028e75-22f2-4620-aaa6-bad471a6101b tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] Request method failure captured: Jul 28 10:32:02.410377 n-d-850468-6 devstack@n-api.service[119463]: request: POST /compute/v2.1/images/93ca7a63-8678-4c7a-9781-eeb1b6e05dbb/metadata HTTP/1.1 Jul 28 10:32:02.410377 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:32:02.410377 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:32:02.410377 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:32:02.410377 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 57 Jul 28 10:32:02.410377 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:32:02.410377 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:32:02.410377 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:32:02.410377 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:02.410377 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mWh--ZrS_gemVPg6TVQGnU8mPSmAWUBnl3yDjnQvDG-90f0t9yqjbr4dV--M_EaNj63dsuiCg7WgZ_7liPFmJHF6EmtA-FnrWWIZAER8wyQWOvHqO9uzEtECeLnv3PHDTZYdnvZ76sFB-1bvGAFPiAllFYPE9ZiGKfFX__jNxMXnhc Jul 28 10:32:02.410377 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:32:02.410377 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:32:02.410377 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:32:02.410377 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:32:02.410377 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:32:02.410377 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:32:02.410377 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 0eaafea849064964a1c49dcc8094758c Jul 28 10:32:02.410377 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1782954601 Jul 28 10:32:02.410377 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:32:02.410377 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:32:02.411928 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0eaafea849064964a1c49dcc8094758c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eaafea849064964a1c49dcc8094758c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eaafea849064964a1c49dcc8094758c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0eaafea849064964a1c49dcc8094758c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:02.411928 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1782954601 Jul 28 10:32:02.411928 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 0eaafea849064964a1c49dcc8094758c Jul 28 10:32:02.411928 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1782954601 Jul 28 10:32:02.411928 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ImagesMetadataNegativeTestJSON-1782954601-project Jul 28 10:32:02.411928 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:32:02.411928 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:32:02.411928 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 7873c5ed45c84d659c5dd740ef5edfc8 Jul 28 10:32:02.411928 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1782954601-project Jul 28 10:32:02.411928 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:32:02.411928 n-d-850468-6 devstack@n-api.service[119463]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 28 10:32:02.411928 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:32:02.411928 n-d-850468-6 devstack@n-api.service[119463]: exception: Image not found. Jul 28 10:32:02.411928 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'image_id': '93ca7a63-8678-4c7a-9781-eeb1b6e05dbb', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 28 10:32:02.413065 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:02.413065 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.413065 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 10:32:02.413065 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 10:32:02.413065 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 10:32:02.413065 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 10:32:02.413065 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 10:32:02.413065 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 10:32:02.413065 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 10:32:02.413065 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 10:32:02.413065 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 10:32:02.413065 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 10:32:02.413065 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 10:32:02.413065 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 10:32:02.413065 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 10:32:02.413065 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 10:32:02.413065 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 10:32:02.413065 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 10:32:02.414285 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 93ca7a63-8678-4c7a-9781-eeb1b6e05dbb Jul 28 10:32:02.414285 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.414285 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:02.414285 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.414285 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.414285 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 28 10:32:02.414285 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 28 10:32:02.414285 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 10:32:02.414285 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 10:32:02.414285 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 10:32:02.414285 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 10:32:02.414285 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 10:32:02.414285 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 10:32:02.414285 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 10:32:02.414285 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 10:32:02.414285 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 10:32:02.414285 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 10:32:02.414285 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 10:32:02.414285 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 10:32:02.415631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 10:32:02.415631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 10:32:02.415631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 10:32:02.415631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 10:32:02.415631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 10:32:02.415631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 10:32:02.415631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 10:32:02.415631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 10:32:02.415631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 10:32:02.415631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 10:32:02.415631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 93ca7a63-8678-4c7a-9781-eeb1b6e05dbb could not be found. Jul 28 10:32:02.415631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.415631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:02.415631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.415631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.415631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:02.415631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:02.415631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:02.415631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:02.417129 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:32:02.417129 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:32:02.417129 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:02.417129 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:02.417129 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:02.417129 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:02.417129 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 28 10:32:02.417129 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 28 10:32:02.417129 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 28 10:32:02.417129 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 10:32:02.417129 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 10:32:02.417129 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.417129 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:02.417129 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.417129 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:02.417129 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:02.417129 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:02.417129 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:02.417129 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:02.417129 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 10:32:02.417129 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:02.418813 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-82028e75-22f2-4620-aaa6-bad471a6101b tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] Returning 404 to user: Image not found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:02.418813 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-82028e75-22f2-4620-aaa6-bad471a6101b tempest-ImagesMetadataNegativeTestJSON-1782954601 tempest-ImagesMetadataNegativeTestJSON-1782954601-project] 10.222.0.46 "POST /compute/v2.1/images/93ca7a63-8678-4c7a-9781-eeb1b6e05dbb/metadata" status: 404 len: 62 microversion: 2.1 time: 0.050993 Jul 28 10:32:02.420626 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 185/425] 10.222.0.46 () {60 vars in 1281 bytes} [Thu Jul 28 10:32:02 2022] POST /compute/v2.1/images/93ca7a63-8678-4c7a-9781-eeb1b6e05dbb/metadata => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:32:05.131108 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-110dc5cc-9574-46a3-8479-d5945c5e4743 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Calling method '.version_select at 0x7fa94beec3a0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:05.132011 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:32:05.132011 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:32:05.133739 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-110dc5cc-9574-46a3-8479-d5945c5e4743 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:05.134379 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-110dc5cc-9574-46a3-8479-d5945c5e4743 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:05.177292 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-110dc5cc-9574-46a3-8479-d5945c5e4743 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:05.181951 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-110dc5cc-9574-46a3-8479-d5945c5e4743 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:05.211158 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-110dc5cc-9574-46a3-8479-d5945c5e4743 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:05.211605 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-110dc5cc-9574-46a3-8479-d5945c5e4743 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:05.233253 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-110dc5cc-9574-46a3-8479-d5945c5e4743 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.997467 Jul 28 10:32:05.234726 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 186/426] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:32:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:05.251403 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-fb5e5a46-cc70-4689-b3df-b59f7146c572 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Calling method '.version_select at 0x7fa94bfed160>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:05.253303 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:32:05.253303 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:32:05.255404 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fb5e5a46-cc70-4689-b3df-b59f7146c572 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:05.256362 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fb5e5a46-cc70-4689-b3df-b59f7146c572 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:05.297577 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fb5e5a46-cc70-4689-b3df-b59f7146c572 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:05.298601 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fb5e5a46-cc70-4689-b3df-b59f7146c572 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:05.343213 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fb5e5a46-cc70-4689-b3df-b59f7146c572 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:05.343833 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fb5e5a46-cc70-4689-b3df-b59f7146c572 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:05.362355 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-fb5e5a46-cc70-4689-b3df-b59f7146c572 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.113167 Jul 28 10:32:05.362355 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 187/427] 10.222.0.46 () {58 vars in 1167 bytes} [Thu Jul 28 10:32:05 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:05.365437 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2071782475", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:05.429987 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6568ea9e-ef39-445b-8517-970d4f717b3c tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Calling method '.version_select at 0x7fa94beecaf0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:05.432511 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:32:05.432511 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:32:05.462032 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6568ea9e-ef39-445b-8517-970d4f717b3c tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:05.462698 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6568ea9e-ef39-445b-8517-970d4f717b3c tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:05.511291 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6568ea9e-ef39-445b-8517-970d4f717b3c tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:05.515167 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6568ea9e-ef39-445b-8517-970d4f717b3c tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:05.551608 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6568ea9e-ef39-445b-8517-970d4f717b3c tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:05.552140 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6568ea9e-ef39-445b-8517-970d4f717b3c tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:05.591235 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6568ea9e-ef39-445b-8517-970d4f717b3c tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.205814 Jul 28 10:32:05.593288 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 188/428] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:32:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:05.608603 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1cde81ca-3347-4ba3-9995-bbb928a3f711 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Calling method '.version_select at 0x7fa94bf30ca0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:05.609692 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:32:05.609692 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:32:05.611912 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1cde81ca-3347-4ba3-9995-bbb928a3f711 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:05.613083 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1cde81ca-3347-4ba3-9995-bbb928a3f711 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:05.623793 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] validate_networks() for None {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:32:05.650507 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1cde81ca-3347-4ba3-9995-bbb928a3f711 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:05.651723 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1cde81ca-3347-4ba3-9995-bbb928a3f711 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:05.668388 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-1cde81ca-3347-4ba3-9995-bbb928a3f711 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.064228 Jul 28 10:32:05.684077 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 189/429] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:32:05 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:32:05.703878 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-edf625a2-a31d-4e78-914d-02af3a16481a tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Calling method '.version_select at 0x7fa94bf30f70>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:05.708099 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:32:05.708099 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:32:05.710865 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-edf625a2-a31d-4e78-914d-02af3a16481a tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:05.712739 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-edf625a2-a31d-4e78-914d-02af3a16481a tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:05.755086 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-edf625a2-a31d-4e78-914d-02af3a16481a tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.062852 Jul 28 10:32:05.756365 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 190/430] 10.222.0.46 () {58 vars in 1179 bytes} [Thu Jul 28 10:32:05 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:05.780971 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e7cadc9d-91f3-4b50-b1fe-5ccda86cea5e tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Calling method '.version_select at 0x7fa94beecb80>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:05.784403 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:32:05.784403 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:32:05.787766 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e7cadc9d-91f3-4b50-b1fe-5ccda86cea5e tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:05.789345 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e7cadc9d-91f3-4b50-b1fe-5ccda86cea5e tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:05.814905 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=25,nova_api:INSERT=7 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:05.828483 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e7cadc9d-91f3-4b50-b1fe-5ccda86cea5e tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:05.829555 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e7cadc9d-91f3-4b50-b1fe-5ccda86cea5e tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:05.848908 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e7cadc9d-91f3-4b50-b1fe-5ccda86cea5e tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:05.850325 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e7cadc9d-91f3-4b50-b1fe-5ccda86cea5e tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:05.857810 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e7cadc9d-91f3-4b50-b1fe-5ccda86cea5e tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.092718 Jul 28 10:32:05.859133 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 191/431] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:32:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:32:05.882482 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0a6012f1-c3e3-47cc-9d65-fac7855c50b1 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Calling method '.version_select at 0x7fa94bebcb80>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:05.887609 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:32:05.887609 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:32:05.890232 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0a6012f1-c3e3-47cc-9d65-fac7855c50b1 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:05.894021 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0a6012f1-c3e3-47cc-9d65-fac7855c50b1 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:05.931184 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0a6012f1-c3e3-47cc-9d65-fac7855c50b1 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:05.933492 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0a6012f1-c3e3-47cc-9d65-fac7855c50b1 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:05.952461 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-0a6012f1-c3e3-47cc-9d65-fac7855c50b1 tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.084204 Jul 28 10:32:05.963428 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 192/432] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:32:05 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:05.991294 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-081d6694-9626-4a53-869e-c6f333abfbfb tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Calling method '.version_select at 0x7fa94bebc820>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:05.991294 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:32:05.991294 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:32:05.991294 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-081d6694-9626-4a53-869e-c6f333abfbfb tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:05.991294 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-081d6694-9626-4a53-869e-c6f333abfbfb tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:06.058683 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-081d6694-9626-4a53-869e-c6f333abfbfb tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:06.059143 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-081d6694-9626-4a53-869e-c6f333abfbfb tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:06.079230 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-081d6694-9626-4a53-869e-c6f333abfbfb tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.113158 Jul 28 10:32:06.082811 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 193/433] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:32:05 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:06.108130 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5027496b-5ca3-4488-979a-0a543dd885df tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Calling method '.version_select at 0x7fa94bebcee0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:06.110406 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:32:06.110406 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:32:06.113240 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5027496b-5ca3-4488-979a-0a543dd885df tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:06.113732 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5027496b-5ca3-4488-979a-0a543dd885df tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:06.149673 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5027496b-5ca3-4488-979a-0a543dd885df tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:06.150314 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5027496b-5ca3-4488-979a-0a543dd885df tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:06.182674 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5027496b-5ca3-4488-979a-0a543dd885df tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:06.183119 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5027496b-5ca3-4488-979a-0a543dd885df tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:06.192086 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5027496b-5ca3-4488-979a-0a543dd885df tempest-HypervisorAdminTestJSON-2140284391 tempest-HypervisorAdminTestJSON-2140284391-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=119463) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 10:32:06.193246 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b35eae5a-65ab-4807-bb33-81160d77a4d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:06.193692 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b35eae5a-65ab-4807-bb33-81160d77a4d0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:06.196399 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b35eae5a-65ab-4807-bb33-81160d77a4d0 None None] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:06.196844 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b35eae5a-65ab-4807-bb33-81160d77a4d0 None None] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:06.216644 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.compute.rpcapi [None req-b35eae5a-65ab-4807-bb33-81160d77a4d0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 10:32:06.217582 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b35eae5a-65ab-4807-bb33-81160d77a4d0 None None] Releasing lock "compute-rpcapi-router" {{(pid=119463) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 10:32:06.242408 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:32:06.243109 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:32:06.247280 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:32:06.248459 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:32:06.249386 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:32:06.279061 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b35eae5a-65ab-4807-bb33-81160d77a4d0 None None] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.179329 Jul 28 10:32:06.283747 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:06.284350 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:06.285263 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:06.285960 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:06.288675 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 194/434] 10.222.0.46 () {58 vars in 1173 bytes} [Thu Jul 28 10:32:06 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:06.302152 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=21 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:06.346802 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Getting quotas for project 2de28d440728406b98e332b34dbb0fdf. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:06.360599 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Getting quotas for user 6f6af4d5f7d14d67b20860d3f7573385 and project 2de28d440728406b98e332b34dbb0fdf. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:06.385543 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:32:06.396149 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 3ff78b77-4c50-4b93-a035-c1b27ee8cdd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:32:06.459054 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ddd4e694-917c-41e2-bee4-ae1d712f1128 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.572039 Jul 28 10:32:06.465655 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 241/435] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:32:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:32:06.473154 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5818ab03-d9e4-4879-8ed2-faba5f5c2671 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:06.474217 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-5818ab03-d9e4-4879-8ed2-faba5f5c2671 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 3ff78b77-4c50-4b93-a035-c1b27ee8cdd8] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:06.576660 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-5818ab03-d9e4-4879-8ed2-faba5f5c2671 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6af4d5f7d14d67b20860d3f7573385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de28d440728406b98e332b34dbb0fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:06.603248 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-5818ab03-d9e4-4879-8ed2-faba5f5c2671 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] 10.222.0.46 "GET /compute/v2.1/servers/3ff78b77-4c50-4b93-a035-c1b27ee8cdd8" status: 200 len: 1219 microversion: 2.1 time: 0.133172 Jul 28 10:32:06.605004 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 195/436] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:06 2022] GET /compute/v2.1/servers/3ff78b77-4c50-4b93-a035-c1b27ee8cdd8 => generated 1219 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:07.417941 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1084140199", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:07.500573 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] validate_networks() for None {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:32:07.641958 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-215f7d5b-f060-4686-963d-a6350b69cc10 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:07.641958 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-215f7d5b-f060-4686-963d-a6350b69cc10 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 3ff78b77-4c50-4b93-a035-c1b27ee8cdd8] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:07.648439 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-215f7d5b-f060-4686-963d-a6350b69cc10 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:07.648966 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-215f7d5b-f060-4686-963d-a6350b69cc10 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:07.649822 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-215f7d5b-f060-4686-963d-a6350b69cc10 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:07.650299 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-215f7d5b-f060-4686-963d-a6350b69cc10 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:07.704060 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-215f7d5b-f060-4686-963d-a6350b69cc10 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:07.704515 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-215f7d5b-f060-4686-963d-a6350b69cc10 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:07.705041 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-215f7d5b-f060-4686-963d-a6350b69cc10 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lazy-loading 'fault' on Instance uuid 3ff78b77-4c50-4b93-a035-c1b27ee8cdd8 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:32:07.763759 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-215f7d5b-f060-4686-963d-a6350b69cc10 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6af4d5f7d14d67b20860d3f7573385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de28d440728406b98e332b34dbb0fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:07.776515 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-215f7d5b-f060-4686-963d-a6350b69cc10 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] 10.222.0.46 "GET /compute/v2.1/servers/3ff78b77-4c50-4b93-a035-c1b27ee8cdd8" status: 200 len: 1292 microversion: 2.1 time: 0.151215 Jul 28 10:32:07.777115 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 196/437] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:07 2022] GET /compute/v2.1/servers/3ff78b77-4c50-4b93-a035-c1b27ee8cdd8 => generated 1292 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:32:07.806229 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-15f8ed04-1811-4780-9ae9-93b0e26a6a85 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:07.812475 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-15f8ed04-1811-4780-9ae9-93b0e26a6a85 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 3ff78b77-4c50-4b93-a035-c1b27ee8cdd8] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:07.834588 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-15f8ed04-1811-4780-9ae9-93b0e26a6a85 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:07.835706 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-15f8ed04-1811-4780-9ae9-93b0e26a6a85 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:07.837052 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-15f8ed04-1811-4780-9ae9-93b0e26a6a85 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:07.837659 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-15f8ed04-1811-4780-9ae9-93b0e26a6a85 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:07.892834 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:32:07.894445 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:32:07.895511 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:32:07.897654 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:32:07.899270 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:32:07.905731 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:07.918694 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:07.919946 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:07.921684 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:07.922293 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-15f8ed04-1811-4780-9ae9-93b0e26a6a85 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 3ff78b77-4c50-4b93-a035-c1b27ee8cdd8] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:32:07.923263 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:07.957271 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Getting quotas for project 5c6b17f75c6d43baa95246f3ec82ac37. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:07.967205 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Getting quotas for user 4f9e1352ef7f43d998ccaad23b2492a9 and project 5c6b17f75c6d43baa95246f3ec82ac37. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:07.995276 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:32:08.004931 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] [instance: 818b9991-1d7c-411a-8046-841739c52c68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:32:08.070041 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-15f8ed04-1811-4780-9ae9-93b0e26a6a85 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 3ff78b77-4c50-4b93-a035-c1b27ee8cdd8] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:32:08.070770 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-15f8ed04-1811-4780-9ae9-93b0e26a6a85 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:08.071304 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-15f8ed04-1811-4780-9ae9-93b0e26a6a85 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:08.071869 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-15f8ed04-1811-4780-9ae9-93b0e26a6a85 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 3ff78b77-4c50-4b93-a035-c1b27ee8cdd8] instance's host None is down, deleting from database Jul 28 10:32:08.097394 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-15f8ed04-1811-4780-9ae9-93b0e26a6a85 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 3ff78b77-4c50-4b93-a035-c1b27ee8cdd8] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:32:08.139195 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0d51f4d6-ea05-423f-9203-597267f93f58 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.551959 Jul 28 10:32:08.141066 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 242/438] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:32:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:32:08.151096 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-15f8ed04-1811-4780-9ae9-93b0e26a6a85 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 3ff78b77-4c50-4b93-a035-c1b27ee8cdd8] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:32:08.158079 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-15f8ed04-1811-4780-9ae9-93b0e26a6a85 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 3ff78b77-4c50-4b93-a035-c1b27ee8cdd8] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:32:08.164133 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e148bdf2-22f6-4544-b922-aea736aca038 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:08.165887 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-e148bdf2-22f6-4544-b922-aea736aca038 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] [instance: 818b9991-1d7c-411a-8046-841739c52c68] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:08.358519 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-e148bdf2-22f6-4544-b922-aea736aca038 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9e1352ef7f43d998ccaad23b2492a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b17f75c6d43baa95246f3ec82ac37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:08.380029 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e148bdf2-22f6-4544-b922-aea736aca038 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] 10.222.0.46 "GET /compute/v2.1/servers/818b9991-1d7c-411a-8046-841739c52c68" status: 200 len: 1214 microversion: 2.1 time: 0.231197 Jul 28 10:32:08.380630 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 243/439] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:08 2022] GET /compute/v2.1/servers/818b9991-1d7c-411a-8046-841739c52c68 => generated 1214 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:08.491231 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-15f8ed04-1811-4780-9ae9-93b0e26a6a85 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3ff78b77-4c50-4b93-a035-c1b27ee8cdd8" status: 204 len: 0 microversion: 2.1 time: 0.691846 Jul 28 10:32:08.496450 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 197/440] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:32:07 2022] DELETE /compute/v2.1/servers/3ff78b77-4c50-4b93-a035-c1b27ee8cdd8 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:32:08.503301 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e4cb7d4b-2852-424e-ad7c-50d79c0f96d0 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:08.503954 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-e4cb7d4b-2852-424e-ad7c-50d79c0f96d0 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 3ff78b77-4c50-4b93-a035-c1b27ee8cdd8] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:08.514277 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e4cb7d4b-2852-424e-ad7c-50d79c0f96d0 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:08.514732 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e4cb7d4b-2852-424e-ad7c-50d79c0f96d0 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:08.517396 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e4cb7d4b-2852-424e-ad7c-50d79c0f96d0 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:08.517840 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e4cb7d4b-2852-424e-ad7c-50d79c0f96d0 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:08.552908 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-e4cb7d4b-2852-424e-ad7c-50d79c0f96d0 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] HTTP exception thrown: Instance 3ff78b77-4c50-4b93-a035-c1b27ee8cdd8 could not be found. Jul 28 10:32:08.554523 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e4cb7d4b-2852-424e-ad7c-50d79c0f96d0 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Request method failure captured: Jul 28 10:32:08.554523 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/3ff78b77-4c50-4b93-a035-c1b27ee8cdd8 HTTP/1.1 Jul 28 10:32:08.554523 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:32:08.554523 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:32:08.554523 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:32:08.554523 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:32:08.554523 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:32:08.554523 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:32:08.554523 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:32:08.554523 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:08.554523 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWfBICt-VPpQC-XfAJFruDqJUjW7C2xMsUzfrjEWQhGnANudoaP-XI_mnWdZF9rnHqPZzBuYmCu2THh4233ue6E0gnu8XPpfCtuD3TdCF2c2vTzbYGhmOVDj9RnB6hLAi3EYIYdxxb6GT53hH-4WOWiQtGDItbsE5Yvalp4BlZo0rI Jul 28 10:32:08.554523 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:32:08.554523 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:32:08.554523 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:32:08.554523 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:32:08.554523 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:32:08.554523 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:32:08.554523 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 2de28d440728406b98e332b34dbb0fdf Jul 28 10:32:08.554523 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-LiveMigrationNegativeTest-1566048892 Jul 28 10:32:08.554523 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:32:08.554523 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:32:08.555745 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2de28d440728406b98e332b34dbb0fdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2de28d440728406b98e332b34dbb0fdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2de28d440728406b98e332b34dbb0fdf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2de28d440728406b98e332b34dbb0fdf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:08.555745 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-LiveMigrationNegativeTest-1566048892 Jul 28 10:32:08.555745 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 2de28d440728406b98e332b34dbb0fdf Jul 28 10:32:08.555745 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1566048892 Jul 28 10:32:08.555745 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-LiveMigrationNegativeTest-1566048892-project Jul 28 10:32:08.555745 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:32:08.555745 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:32:08.555745 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 6f6af4d5f7d14d67b20860d3f7573385 Jul 28 10:32:08.555745 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-LiveMigrationNegativeTest-1566048892-project Jul 28 10:32:08.555745 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:32:08.555745 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 3ff78b77-4c50-4b93-a035-c1b27ee8cdd8 could not be found. Jul 28 10:32:08.555745 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '3ff78b77-4c50-4b93-a035-c1b27ee8cdd8'} Jul 28 10:32:08.556674 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:08.556674 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:08.556674 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:32:08.556674 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:32:08.556674 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:32:08.556674 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:32:08.556674 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:32:08.556674 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:32:08.556674 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:32:08.556674 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:32:08.556674 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ff78b77-4c50-4b93-a035-c1b27ee8cdd8 could not be found. Jul 28 10:32:08.556674 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:08.556674 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:08.556674 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:08.556674 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:08.556674 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:08.556674 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:08.556674 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:08.556674 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:08.556674 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:08.557820 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:08.557820 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:32:08.557820 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:32:08.557820 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:32:08.557820 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:32:08.557820 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:32:08.557820 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:32:08.557820 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ff78b77-4c50-4b93-a035-c1b27ee8cdd8 could not be found. Jul 28 10:32:08.557820 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:08.557820 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:08.557820 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:08.557820 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:08.557820 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:08.557820 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:08.557820 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:08.557820 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:08.557820 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ff78b77-4c50-4b93-a035-c1b27ee8cdd8 could not be found. Jul 28 10:32:08.557820 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:08.567757 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e4cb7d4b-2852-424e-ad7c-50d79c0f96d0 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Returning 404 to user: Instance 3ff78b77-4c50-4b93-a035-c1b27ee8cdd8 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:08.571109 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e4cb7d4b-2852-424e-ad7c-50d79c0f96d0 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] 10.222.0.46 "GET /compute/v2.1/servers/3ff78b77-4c50-4b93-a035-c1b27ee8cdd8" status: 404 len: 111 microversion: 2.1 time: 0.071338 Jul 28 10:32:08.572044 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 244/441] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:08 2022] GET /compute/v2.1/servers/3ff78b77-4c50-4b93-a035-c1b27ee8cdd8 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:32:08.881239 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-22754923", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:08.951605 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] validate_networks() for None {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:32:09.402158 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fe49860e-f83d-4c63-8c5e-2c945f40113d tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:09.403051 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-fe49860e-f83d-4c63-8c5e-2c945f40113d tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] [instance: 818b9991-1d7c-411a-8046-841739c52c68] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:09.421718 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fe49860e-f83d-4c63-8c5e-2c945f40113d tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:09.422682 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fe49860e-f83d-4c63-8c5e-2c945f40113d tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:09.426232 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fe49860e-f83d-4c63-8c5e-2c945f40113d tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:09.427090 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fe49860e-f83d-4c63-8c5e-2c945f40113d tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:09.434592 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:32:09.435202 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:32:09.435767 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:32:09.436284 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:32:09.436883 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:32:09.449010 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:09.449765 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:09.450928 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:09.451755 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:09.471242 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=62,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:09.490997 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Getting quotas for project 2de28d440728406b98e332b34dbb0fdf. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:09.503676 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fe49860e-f83d-4c63-8c5e-2c945f40113d tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:09.504849 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fe49860e-f83d-4c63-8c5e-2c945f40113d tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:09.505789 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-fe49860e-f83d-4c63-8c5e-2c945f40113d tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lazy-loading 'fault' on Instance uuid 818b9991-1d7c-411a-8046-841739c52c68 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:32:09.511268 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Getting quotas for user 6f6af4d5f7d14d67b20860d3f7573385 and project 2de28d440728406b98e332b34dbb0fdf. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:09.563668 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:32:09.569445 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 8e93b454-02d2-46eb-9413-f1009b26622a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:32:09.658028 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-fe49860e-f83d-4c63-8c5e-2c945f40113d tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9e1352ef7f43d998ccaad23b2492a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b17f75c6d43baa95246f3ec82ac37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:09.665694 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-33d4d2df-1866-4d6c-a522-3e999adbe74d tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791508 Jul 28 10:32:09.668489 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 198/442] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:32:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:32:09.684198 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-fe49860e-f83d-4c63-8c5e-2c945f40113d tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] 10.222.0.46 "GET /compute/v2.1/servers/818b9991-1d7c-411a-8046-841739c52c68" status: 200 len: 1287 microversion: 2.1 time: 0.286879 Jul 28 10:32:09.688553 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 245/443] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:09 2022] GET /compute/v2.1/servers/818b9991-1d7c-411a-8046-841739c52c68 => generated 1287 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:32:09.696486 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-805fca28-677c-43c4-9da5-58b589894231 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:09.697278 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-805fca28-677c-43c4-9da5-58b589894231 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 8e93b454-02d2-46eb-9413-f1009b26622a] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:09.718627 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-bd093198-72f4-4313-b60e-afc257adbbc3 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:09.719620 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-bd093198-72f4-4313-b60e-afc257adbbc3 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] [instance: 818b9991-1d7c-411a-8046-841739c52c68] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:09.731102 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-bd093198-72f4-4313-b60e-afc257adbbc3 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:09.734354 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-bd093198-72f4-4313-b60e-afc257adbbc3 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:09.739668 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-bd093198-72f4-4313-b60e-afc257adbbc3 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:09.746179 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-bd093198-72f4-4313-b60e-afc257adbbc3 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:09.793792 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-bd093198-72f4-4313-b60e-afc257adbbc3 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] [instance: 818b9991-1d7c-411a-8046-841739c52c68] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:32:09.858233 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-805fca28-677c-43c4-9da5-58b589894231 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6af4d5f7d14d67b20860d3f7573385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de28d440728406b98e332b34dbb0fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:09.871219 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-805fca28-677c-43c4-9da5-58b589894231 tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] 10.222.0.46 "GET /compute/v2.1/servers/8e93b454-02d2-46eb-9413-f1009b26622a" status: 200 len: 1217 microversion: 2.1 time: 0.193471 Jul 28 10:32:09.872078 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 199/444] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:09 2022] GET /compute/v2.1/servers/8e93b454-02d2-46eb-9413-f1009b26622a => generated 1217 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:32:09.892126 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-bd093198-72f4-4313-b60e-afc257adbbc3 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] [instance: 818b9991-1d7c-411a-8046-841739c52c68] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:32:09.894204 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-bd093198-72f4-4313-b60e-afc257adbbc3 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:09.896242 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-bd093198-72f4-4313-b60e-afc257adbbc3 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:09.897420 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-bd093198-72f4-4313-b60e-afc257adbbc3 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] [instance: 818b9991-1d7c-411a-8046-841739c52c68] instance's host None is down, deleting from database Jul 28 10:32:09.902819 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-bd093198-72f4-4313-b60e-afc257adbbc3 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] [instance: 818b9991-1d7c-411a-8046-841739c52c68] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:32:09.949349 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-bd093198-72f4-4313-b60e-afc257adbbc3 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] [instance: 818b9991-1d7c-411a-8046-841739c52c68] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:32:09.958151 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-bd093198-72f4-4313-b60e-afc257adbbc3 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] [instance: 818b9991-1d7c-411a-8046-841739c52c68] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:32:10.235253 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-bd093198-72f4-4313-b60e-afc257adbbc3 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] 10.222.0.46 "DELETE /compute/v2.1/servers/818b9991-1d7c-411a-8046-841739c52c68" status: 204 len: 0 microversion: 2.1 time: 0.521042 Jul 28 10:32:10.238945 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 246/445] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:32:09 2022] DELETE /compute/v2.1/servers/818b9991-1d7c-411a-8046-841739c52c68 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 10:32:10.247846 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-df3bbd7c-8bbd-4c9f-9884-17205aa64ed8 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:10.249141 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-df3bbd7c-8bbd-4c9f-9884-17205aa64ed8 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] [instance: 818b9991-1d7c-411a-8046-841739c52c68] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:10.257723 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-df3bbd7c-8bbd-4c9f-9884-17205aa64ed8 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:10.258483 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-df3bbd7c-8bbd-4c9f-9884-17205aa64ed8 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:10.259408 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-df3bbd7c-8bbd-4c9f-9884-17205aa64ed8 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:10.259941 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-df3bbd7c-8bbd-4c9f-9884-17205aa64ed8 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:10.277383 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-df3bbd7c-8bbd-4c9f-9884-17205aa64ed8 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] HTTP exception thrown: Instance 818b9991-1d7c-411a-8046-841739c52c68 could not be found. Jul 28 10:32:10.279065 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-df3bbd7c-8bbd-4c9f-9884-17205aa64ed8 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Request method failure captured: Jul 28 10:32:10.279065 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/818b9991-1d7c-411a-8046-841739c52c68 HTTP/1.1 Jul 28 10:32:10.279065 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:32:10.279065 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:32:10.279065 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:32:10.279065 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:32:10.279065 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:32:10.279065 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:32:10.279065 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:32:10.279065 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:10.279065 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWhPlRssD4q295vCLBTUUdLwOaVSqZoLxgaghRUZm1em5CmzXyL9qiAVMMlzObrH4f7zlH22TJ7KK-v0jFU7dp1THN8KRZiNfIpsVqfp8P_OgNkgKpMkyY_Zah1J5Qz7LHNHRaVKILhJ3LwVfev0MaJ38gr53AuqjNoRhzi7qQNUqE Jul 28 10:32:10.279065 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:32:10.279065 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:32:10.279065 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:32:10.279065 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:32:10.279065 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:32:10.279065 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:32:10.279065 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 5c6b17f75c6d43baa95246f3ec82ac37 Jul 28 10:32:10.279065 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-TenantUsagesTestJSON-1885050361 Jul 28 10:32:10.279065 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:32:10.279065 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:32:10.280598 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5c6b17f75c6d43baa95246f3ec82ac37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5c6b17f75c6d43baa95246f3ec82ac37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5c6b17f75c6d43baa95246f3ec82ac37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5c6b17f75c6d43baa95246f3ec82ac37", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:10.280598 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-TenantUsagesTestJSON-1885050361 Jul 28 10:32:10.280598 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 5c6b17f75c6d43baa95246f3ec82ac37 Jul 28 10:32:10.280598 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1885050361 Jul 28 10:32:10.280598 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-TenantUsagesTestJSON-1885050361-project Jul 28 10:32:10.280598 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:32:10.280598 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:32:10.280598 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 4f9e1352ef7f43d998ccaad23b2492a9 Jul 28 10:32:10.280598 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-TenantUsagesTestJSON-1885050361-project Jul 28 10:32:10.280598 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:32:10.280598 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 818b9991-1d7c-411a-8046-841739c52c68 could not be found. Jul 28 10:32:10.280598 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '818b9991-1d7c-411a-8046-841739c52c68'} Jul 28 10:32:10.281457 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:10.281457 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:10.281457 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:32:10.281457 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:32:10.281457 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:32:10.281457 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:32:10.281457 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:32:10.281457 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:32:10.281457 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:32:10.281457 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:32:10.281457 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 818b9991-1d7c-411a-8046-841739c52c68 could not be found. Jul 28 10:32:10.281457 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:10.281457 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:10.281457 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:10.281457 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:10.281457 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:10.281457 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:10.281457 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:10.281457 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:10.281457 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:10.283135 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:10.283135 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:32:10.283135 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:32:10.283135 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:32:10.283135 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:32:10.283135 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:32:10.283135 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:32:10.283135 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 818b9991-1d7c-411a-8046-841739c52c68 could not be found. Jul 28 10:32:10.283135 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:10.283135 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:10.283135 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:10.283135 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:10.283135 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:10.283135 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:10.283135 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:10.283135 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:10.283135 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 818b9991-1d7c-411a-8046-841739c52c68 could not be found. Jul 28 10:32:10.283135 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:10.284469 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-df3bbd7c-8bbd-4c9f-9884-17205aa64ed8 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] Returning 404 to user: Instance 818b9991-1d7c-411a-8046-841739c52c68 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:10.284688 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-df3bbd7c-8bbd-4c9f-9884-17205aa64ed8 tempest-TenantUsagesTestJSON-1885050361 tempest-TenantUsagesTestJSON-1885050361-project] 10.222.0.46 "GET /compute/v2.1/servers/818b9991-1d7c-411a-8046-841739c52c68" status: 404 len: 111 microversion: 2.1 time: 0.040089 Jul 28 10:32:10.285435 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 247/446] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:10 2022] GET /compute/v2.1/servers/818b9991-1d7c-411a-8046-841739c52c68 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:32:10.607226 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1534197002", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:10.711335 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] validate_networks() for None {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:32:10.894126 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7e016544-0438-4f7d-abde-ffb4e80cdaae tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:10.894933 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-7e016544-0438-4f7d-abde-ffb4e80cdaae tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 8e93b454-02d2-46eb-9413-f1009b26622a] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:10.907822 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7e016544-0438-4f7d-abde-ffb4e80cdaae tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:10.911390 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7e016544-0438-4f7d-abde-ffb4e80cdaae tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:10.913598 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7e016544-0438-4f7d-abde-ffb4e80cdaae tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:10.914534 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7e016544-0438-4f7d-abde-ffb4e80cdaae tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:10.983526 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7e016544-0438-4f7d-abde-ffb4e80cdaae tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:10.983982 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7e016544-0438-4f7d-abde-ffb4e80cdaae tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:10.987520 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-7e016544-0438-4f7d-abde-ffb4e80cdaae tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lazy-loading 'fault' on Instance uuid 8e93b454-02d2-46eb-9413-f1009b26622a {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:32:11.003116 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:32:11.003839 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:32:11.004508 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:32:11.005066 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:32:11.005627 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:32:11.022021 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:11.034860 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:11.038573 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:11.039050 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:11.094366 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Getting quotas for project 738f1914066c4e7eacd4234f88e32068. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:11.101593 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-7e016544-0438-4f7d-abde-ffb4e80cdaae tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6af4d5f7d14d67b20860d3f7573385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de28d440728406b98e332b34dbb0fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:11.116177 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Getting quotas for user a8fda7bee5c044c6824b7409e26f61bd and project 738f1914066c4e7eacd4234f88e32068. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:11.123706 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7e016544-0438-4f7d-abde-ffb4e80cdaae tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] 10.222.0.46 "GET /compute/v2.1/servers/8e93b454-02d2-46eb-9413-f1009b26622a" status: 200 len: 1290 microversion: 2.1 time: 0.234469 Jul 28 10:32:11.141239 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 248/447] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:10 2022] GET /compute/v2.1/servers/8e93b454-02d2-46eb-9413-f1009b26622a => generated 1290 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:11.146502 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:32:11.150657 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] [instance: 56239473-fc9f-4373-b5e0-7058520716b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:32:11.157126 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c18e746b-095f-4735-b465-af09e1249d1f tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:11.161093 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c18e746b-095f-4735-b465-af09e1249d1f tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 8e93b454-02d2-46eb-9413-f1009b26622a] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:11.176871 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c18e746b-095f-4735-b465-af09e1249d1f tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:11.179385 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c18e746b-095f-4735-b465-af09e1249d1f tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:11.182293 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c18e746b-095f-4735-b465-af09e1249d1f tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:11.184343 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c18e746b-095f-4735-b465-af09e1249d1f tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:11.256125 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c18e746b-095f-4735-b465-af09e1249d1f tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 8e93b454-02d2-46eb-9413-f1009b26622a] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:32:11.263080 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ca4094be-18ae-48cd-9c84-a4432dba6cd4 tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.190905 Jul 28 10:32:11.271519 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 200/448] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:32:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 10:32:11.294034 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7d48457b-3b12-40d6-b7bc-0d18deed2d6f tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:11.294939 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-7d48457b-3b12-40d6-b7bc-0d18deed2d6f tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] [instance: 56239473-fc9f-4373-b5e0-7058520716b0] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:11.397197 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c18e746b-095f-4735-b465-af09e1249d1f tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 8e93b454-02d2-46eb-9413-f1009b26622a] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:32:11.404500 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c18e746b-095f-4735-b465-af09e1249d1f tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:11.407641 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-7d48457b-3b12-40d6-b7bc-0d18deed2d6f tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fda7bee5c044c6824b7409e26f61bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738f1914066c4e7eacd4234f88e32068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:11.410059 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c18e746b-095f-4735-b465-af09e1249d1f tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:11.413852 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-c18e746b-095f-4735-b465-af09e1249d1f tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 8e93b454-02d2-46eb-9413-f1009b26622a] instance's host None is down, deleting from database Jul 28 10:32:11.417309 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-7d48457b-3b12-40d6-b7bc-0d18deed2d6f tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] 10.222.0.46 "GET /compute/v2.1/servers/56239473-fc9f-4373-b5e0-7058520716b0" status: 200 len: 1217 microversion: 2.1 time: 0.129955 Jul 28 10:32:11.418924 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 201/449] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:11 2022] GET /compute/v2.1/servers/56239473-fc9f-4373-b5e0-7058520716b0 => generated 1217 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:11.448336 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-c18e746b-095f-4735-b465-af09e1249d1f tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 8e93b454-02d2-46eb-9413-f1009b26622a] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:32:11.591156 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-c18e746b-095f-4735-b465-af09e1249d1f tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 8e93b454-02d2-46eb-9413-f1009b26622a] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:32:11.599230 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-c18e746b-095f-4735-b465-af09e1249d1f tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 8e93b454-02d2-46eb-9413-f1009b26622a] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:32:11.726688 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=76,nova_cell0:UPDATE=18,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:12.113781 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c18e746b-095f-4735-b465-af09e1249d1f tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8e93b454-02d2-46eb-9413-f1009b26622a" status: 204 len: 0 microversion: 2.1 time: 0.970239 Jul 28 10:32:12.116262 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 249/450] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:32:11 2022] DELETE /compute/v2.1/servers/8e93b454-02d2-46eb-9413-f1009b26622a => generated 0 bytes in 974 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:32:12.126976 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5a341cbb-8df9-405a-b34e-8474dc4a239c tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:12.128538 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-5a341cbb-8df9-405a-b34e-8474dc4a239c tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] [instance: 8e93b454-02d2-46eb-9413-f1009b26622a] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:12.140798 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5a341cbb-8df9-405a-b34e-8474dc4a239c tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:12.141753 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5a341cbb-8df9-405a-b34e-8474dc4a239c tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:12.142981 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5a341cbb-8df9-405a-b34e-8474dc4a239c tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:12.143633 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5a341cbb-8df9-405a-b34e-8474dc4a239c tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:12.169459 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-5a341cbb-8df9-405a-b34e-8474dc4a239c tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] HTTP exception thrown: Instance 8e93b454-02d2-46eb-9413-f1009b26622a could not be found. Jul 28 10:32:12.171807 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5a341cbb-8df9-405a-b34e-8474dc4a239c tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Request method failure captured: Jul 28 10:32:12.171807 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/8e93b454-02d2-46eb-9413-f1009b26622a HTTP/1.1 Jul 28 10:32:12.171807 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:32:12.171807 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:32:12.171807 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:32:12.171807 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:32:12.171807 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:32:12.171807 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:32:12.171807 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:32:12.171807 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:12.171807 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mWfBICt-VPpQC-XfAJFruDqJUjW7C2xMsUzfrjEWQhGnANudoaP-XI_mnWdZF9rnHqPZzBuYmCu2THh4233ue6E0gnu8XPpfCtuD3TdCF2c2vTzbYGhmOVDj9RnB6hLAi3EYIYdxxb6GT53hH-4WOWiQtGDItbsE5Yvalp4BlZo0rI Jul 28 10:32:12.171807 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:32:12.171807 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:32:12.171807 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:32:12.171807 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:32:12.171807 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:32:12.171807 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:32:12.171807 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 2de28d440728406b98e332b34dbb0fdf Jul 28 10:32:12.171807 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-LiveMigrationNegativeTest-1566048892 Jul 28 10:32:12.171807 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:32:12.171807 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:32:12.173308 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2de28d440728406b98e332b34dbb0fdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2de28d440728406b98e332b34dbb0fdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2de28d440728406b98e332b34dbb0fdf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2de28d440728406b98e332b34dbb0fdf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:12.173308 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-LiveMigrationNegativeTest-1566048892 Jul 28 10:32:12.173308 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 2de28d440728406b98e332b34dbb0fdf Jul 28 10:32:12.173308 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1566048892 Jul 28 10:32:12.173308 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-LiveMigrationNegativeTest-1566048892-project Jul 28 10:32:12.173308 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:32:12.173308 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:32:12.173308 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 6f6af4d5f7d14d67b20860d3f7573385 Jul 28 10:32:12.173308 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-LiveMigrationNegativeTest-1566048892-project Jul 28 10:32:12.173308 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:32:12.173308 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 8e93b454-02d2-46eb-9413-f1009b26622a could not be found. Jul 28 10:32:12.173308 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '8e93b454-02d2-46eb-9413-f1009b26622a'} Jul 28 10:32:12.174121 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:12.174121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:12.174121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:32:12.174121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:32:12.174121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:32:12.174121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:32:12.174121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:32:12.174121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:32:12.174121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:32:12.174121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:32:12.174121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e93b454-02d2-46eb-9413-f1009b26622a could not be found. Jul 28 10:32:12.174121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:12.174121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:12.174121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:12.174121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:12.174121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:12.174121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:12.174121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:12.174121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:12.174121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:12.175864 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:12.175864 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:32:12.175864 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:32:12.175864 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:32:12.175864 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:32:12.175864 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:32:12.175864 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:32:12.175864 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e93b454-02d2-46eb-9413-f1009b26622a could not be found. Jul 28 10:32:12.175864 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:12.175864 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:12.175864 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:12.175864 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:12.175864 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:12.175864 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:12.175864 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:12.175864 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:12.175864 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e93b454-02d2-46eb-9413-f1009b26622a could not be found. Jul 28 10:32:12.175864 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:12.179160 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5a341cbb-8df9-405a-b34e-8474dc4a239c tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] Returning 404 to user: Instance 8e93b454-02d2-46eb-9413-f1009b26622a could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:12.180189 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-5a341cbb-8df9-405a-b34e-8474dc4a239c tempest-LiveMigrationNegativeTest-1566048892 tempest-LiveMigrationNegativeTest-1566048892-project] 10.222.0.46 "GET /compute/v2.1/servers/8e93b454-02d2-46eb-9413-f1009b26622a" status: 404 len: 111 microversion: 2.1 time: 0.057123 Jul 28 10:32:12.181229 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 202/451] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:12 2022] GET /compute/v2.1/servers/8e93b454-02d2-46eb-9413-f1009b26622a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:32:12.473444 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1eb7100c-e70c-4598-9052-5ccc62779d6e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:12.478126 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-1eb7100c-e70c-4598-9052-5ccc62779d6e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] [instance: 56239473-fc9f-4373-b5e0-7058520716b0] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:12.495465 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1eb7100c-e70c-4598-9052-5ccc62779d6e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:12.497310 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1eb7100c-e70c-4598-9052-5ccc62779d6e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:12.501126 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1eb7100c-e70c-4598-9052-5ccc62779d6e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:12.502770 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1eb7100c-e70c-4598-9052-5ccc62779d6e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:12.583323 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1eb7100c-e70c-4598-9052-5ccc62779d6e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:12.584139 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1eb7100c-e70c-4598-9052-5ccc62779d6e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:12.585770 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-1eb7100c-e70c-4598-9052-5ccc62779d6e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lazy-loading 'fault' on Instance uuid 56239473-fc9f-4373-b5e0-7058520716b0 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:32:12.709740 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-1eb7100c-e70c-4598-9052-5ccc62779d6e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fda7bee5c044c6824b7409e26f61bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738f1914066c4e7eacd4234f88e32068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:12.728715 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1eb7100c-e70c-4598-9052-5ccc62779d6e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] 10.222.0.46 "GET /compute/v2.1/servers/56239473-fc9f-4373-b5e0-7058520716b0" status: 200 len: 1290 microversion: 2.1 time: 0.274145 Jul 28 10:32:12.729495 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 250/452] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:12 2022] GET /compute/v2.1/servers/56239473-fc9f-4373-b5e0-7058520716b0 => generated 1290 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:12.758242 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a0bf5639-79fc-4a4a-9697-ecca39e1ef4e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:12.759398 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a0bf5639-79fc-4a4a-9697-ecca39e1ef4e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] [instance: 56239473-fc9f-4373-b5e0-7058520716b0] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:12.773299 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a0bf5639-79fc-4a4a-9697-ecca39e1ef4e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:12.775316 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a0bf5639-79fc-4a4a-9697-ecca39e1ef4e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:12.778998 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a0bf5639-79fc-4a4a-9697-ecca39e1ef4e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:12.780512 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a0bf5639-79fc-4a4a-9697-ecca39e1ef4e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:12.860332 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a0bf5639-79fc-4a4a-9697-ecca39e1ef4e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] [instance: 56239473-fc9f-4373-b5e0-7058520716b0] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:32:13.006001 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a0bf5639-79fc-4a4a-9697-ecca39e1ef4e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] [instance: 56239473-fc9f-4373-b5e0-7058520716b0] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:32:13.008146 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a0bf5639-79fc-4a4a-9697-ecca39e1ef4e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:13.010498 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a0bf5639-79fc-4a4a-9697-ecca39e1ef4e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:13.011196 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-a0bf5639-79fc-4a4a-9697-ecca39e1ef4e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] [instance: 56239473-fc9f-4373-b5e0-7058520716b0] instance's host None is down, deleting from database Jul 28 10:32:13.021201 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-a0bf5639-79fc-4a4a-9697-ecca39e1ef4e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] [instance: 56239473-fc9f-4373-b5e0-7058520716b0] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:32:13.085924 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-a0bf5639-79fc-4a4a-9697-ecca39e1ef4e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] [instance: 56239473-fc9f-4373-b5e0-7058520716b0] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:32:13.103083 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-a0bf5639-79fc-4a4a-9697-ecca39e1ef4e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] [instance: 56239473-fc9f-4373-b5e0-7058520716b0] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:32:13.303063 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-837d0421-2fc5-462a-ab2b-a66e755cc114 tempest-TenantUsagesNegativeTestJSON-2120882348 tempest-TenantUsagesNegativeTestJSON-2120882348-project-admin] 10.222.0.46 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-27T10%3A32%3A12.528826&end=2022-07-29T10%3A32%3A12.528826" status: 404 len: 112 microversion: - time: 0.769121 Jul 28 10:32:13.304646 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 203/453] 10.222.0.46 () {58 vars in 1316 bytes} [Thu Jul 28 10:32:12 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-27T10%3A32%3A12.528826&end=2022-07-29T10%3A32%3A12.528826 => generated 112 bytes in 771 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 10:32:13.562065 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a0bf5639-79fc-4a4a-9697-ecca39e1ef4e tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] 10.222.0.46 "DELETE /compute/v2.1/servers/56239473-fc9f-4373-b5e0-7058520716b0" status: 204 len: 0 microversion: 2.1 time: 0.808374 Jul 28 10:32:13.563044 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 251/454] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:32:12 2022] DELETE /compute/v2.1/servers/56239473-fc9f-4373-b5e0-7058520716b0 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 10:32:13.582560 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-04ed028d-cf72-4af0-9bbf-9ddb1ea710c0 tempest-TenantUsagesNegativeTestJSON-2120882348 tempest-TenantUsagesNegativeTestJSON-2120882348-project-admin] Calling method '.version_select at 0x7fa94bec81f0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:13.597700 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-04ed028d-cf72-4af0-9bbf-9ddb1ea710c0 tempest-TenantUsagesNegativeTestJSON-2120882348 tempest-TenantUsagesNegativeTestJSON-2120882348-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 28 10:32:13.599891 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-04ed028d-cf72-4af0-9bbf-9ddb1ea710c0 tempest-TenantUsagesNegativeTestJSON-2120882348 tempest-TenantUsagesNegativeTestJSON-2120882348-project-admin] Request method failure captured: Jul 28 10:32:13.599891 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-simple-tenant-usage/63839af1e0c542058d20df37d726ba37?start=2022-07-29T10%3A32%3A12.528826&end=2022-07-27T10%3A32%3A12.528826 HTTP/1.1 Jul 28 10:32:13.599891 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:32:13.599891 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:32:13.599891 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:32:13.599891 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:32:13.599891 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:32:13.599891 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:32:13.599891 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:32:13.599891 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:13.599891 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWseiYik6o4zz9AfxRQYjj3n4VKAUA5hpCMv44fC1V-SZHO0p-BN5GqDjEJZ-FWVNUp6QXGf9DbmuPG5duAae9OqdWZNtwNkjoRDVCCNaB9okhNNuRa1QuxfVsf9P3ARgZFgsnM8hPQtfEaETmcG_yp0Rw1kF1YbJLGuNiSKLMjHho Jul 28 10:32:13.599891 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:32:13.599891 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:32:13.599891 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:32:13.599891 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:32:13.599891 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:32:13.599891 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:32:13.599891 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 5b7cff898fee4239a7ad45c3a073ff3d Jul 28 10:32:13.599891 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2120882348 Jul 28 10:32:13.599891 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:32:13.599891 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:32:13.601604 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5b7cff898fee4239a7ad45c3a073ff3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5b7cff898fee4239a7ad45c3a073ff3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5b7cff898fee4239a7ad45c3a073ff3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5b7cff898fee4239a7ad45c3a073ff3d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:13.601604 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2120882348 Jul 28 10:32:13.601604 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 5b7cff898fee4239a7ad45c3a073ff3d Jul 28 10:32:13.601604 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2120882348 Jul 28 10:32:13.601604 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-TenantUsagesNegativeTestJSON-2120882348-project-admin Jul 28 10:32:13.601604 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:32:13.601604 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:32:13.601604 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 018edac5abc04cf798b4c246bebb63da Jul 28 10:32:13.601604 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2120882348-project-admin Jul 28 10:32:13.601604 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:32:13.601604 n-d-850468-6 devstack@n-api.service[119464]: exception: Invalid start time. The start time cannot occur after the end time. Jul 28 10:32:13.601604 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '63839af1e0c542058d20df37d726ba37'} Jul 28 10:32:13.602878 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:13.602878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:13.602878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:13.602878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:13.602878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:13.602878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:13.602878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:32:13.602878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:32:13.602878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 10:32:13.602878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:13.602878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:13.602878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:13.602878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 28 10:32:13.602878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 28 10:32:13.602878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 28 10:32:13.602878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 28 10:32:13.602878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 28 10:32:13.602878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 28 10:32:13.602878 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 28 10:32:13.603992 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:13.603992 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:13.603992 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:13.603992 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:13.603992 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:13.603992 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:13.603992 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:13.603992 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:13.603992 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 28 10:32:13.603992 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:13.603992 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-04ed028d-cf72-4af0-9bbf-9ddb1ea710c0 tempest-TenantUsagesNegativeTestJSON-2120882348 tempest-TenantUsagesNegativeTestJSON-2120882348-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:13.603992 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-04ed028d-cf72-4af0-9bbf-9ddb1ea710c0 tempest-TenantUsagesNegativeTestJSON-2120882348 tempest-TenantUsagesNegativeTestJSON-2120882348-project-admin] 10.222.0.46 "GET /compute/v2.1/os-simple-tenant-usage/63839af1e0c542058d20df37d726ba37?start=2022-07-29T10%3A32%3A12.528826&end=2022-07-27T10%3A32%3A12.528826" status: 400 len: 111 microversion: 2.1 time: 0.036929 Jul 28 10:32:13.606607 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 252/455] 10.222.0.46 () {58 vars in 1412 bytes} [Thu Jul 28 10:32:13 2022] GET /compute/v2.1/os-simple-tenant-usage/63839af1e0c542058d20df37d726ba37?start=2022-07-29T10%3A32%3A12.528826&end=2022-07-27T10%3A32%3A12.528826 => generated 111 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:32:13.612849 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ddef916b-97ce-4e1c-85c0-021efd2a2b3c tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:13.613480 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ddef916b-97ce-4e1c-85c0-021efd2a2b3c tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] [instance: 56239473-fc9f-4373-b5e0-7058520716b0] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:13.621536 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ddef916b-97ce-4e1c-85c0-021efd2a2b3c tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:13.622026 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ddef916b-97ce-4e1c-85c0-021efd2a2b3c tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:13.623011 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ddef916b-97ce-4e1c-85c0-021efd2a2b3c tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:13.623450 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ddef916b-97ce-4e1c-85c0-021efd2a2b3c tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:13.659230 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-ddef916b-97ce-4e1c-85c0-021efd2a2b3c tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] HTTP exception thrown: Instance 56239473-fc9f-4373-b5e0-7058520716b0 could not be found. Jul 28 10:32:13.660949 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ddef916b-97ce-4e1c-85c0-021efd2a2b3c tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Request method failure captured: Jul 28 10:32:13.660949 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/56239473-fc9f-4373-b5e0-7058520716b0 HTTP/1.1 Jul 28 10:32:13.660949 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:32:13.660949 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:32:13.660949 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:32:13.660949 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:32:13.660949 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:32:13.660949 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:32:13.660949 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:32:13.660949 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:13.660949 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWpg3Zbk3iV8mP-2bLyNlVFxfE7WPCZSinywvPJDCuEphe_RKYYm1FTqZkAHW_geN3i-T5L2ujkB3SZtjgWMHBhAVkUh3BoTSqyUxwtFX-vVRJpk1e77HZN6wzltanZqqcGy_QES2twDdftBdm6afI8mw1j1S1UyUzrOT5SMNeB5OY Jul 28 10:32:13.660949 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:32:13.660949 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:32:13.660949 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:32:13.660949 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:32:13.660949 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:32:13.660949 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:32:13.660949 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 738f1914066c4e7eacd4234f88e32068 Jul 28 10:32:13.660949 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ImagesOneServerTestJSON-1109024356 Jul 28 10:32:13.660949 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:32:13.660949 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:32:13.662509 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/738f1914066c4e7eacd4234f88e32068"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/738f1914066c4e7eacd4234f88e32068"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/738f1914066c4e7eacd4234f88e32068"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_738f1914066c4e7eacd4234f88e32068", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:13.662509 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ImagesOneServerTestJSON-1109024356 Jul 28 10:32:13.662509 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 738f1914066c4e7eacd4234f88e32068 Jul 28 10:32:13.662509 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1109024356 Jul 28 10:32:13.662509 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ImagesOneServerTestJSON-1109024356-project Jul 28 10:32:13.662509 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:32:13.662509 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:32:13.662509 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: a8fda7bee5c044c6824b7409e26f61bd Jul 28 10:32:13.662509 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ImagesOneServerTestJSON-1109024356-project Jul 28 10:32:13.662509 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:32:13.662509 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 56239473-fc9f-4373-b5e0-7058520716b0 could not be found. Jul 28 10:32:13.662509 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '56239473-fc9f-4373-b5e0-7058520716b0'} Jul 28 10:32:13.663363 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:13.663363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:13.663363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:32:13.663363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:32:13.663363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:32:13.663363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:32:13.663363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:32:13.663363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:32:13.663363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:32:13.663363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:32:13.663363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56239473-fc9f-4373-b5e0-7058520716b0 could not be found. Jul 28 10:32:13.663363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:13.663363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:13.663363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:13.663363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:13.663363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:13.663363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:13.663363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:13.663363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:13.663363 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:13.664744 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:13.664744 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:32:13.664744 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:32:13.664744 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:32:13.664744 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:32:13.664744 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:32:13.664744 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:32:13.664744 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56239473-fc9f-4373-b5e0-7058520716b0 could not be found. Jul 28 10:32:13.664744 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:13.664744 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:13.664744 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:13.664744 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:13.664744 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:13.664744 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:13.664744 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:13.664744 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:13.664744 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56239473-fc9f-4373-b5e0-7058520716b0 could not be found. Jul 28 10:32:13.664744 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:13.666009 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ddef916b-97ce-4e1c-85c0-021efd2a2b3c tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] Returning 404 to user: Instance 56239473-fc9f-4373-b5e0-7058520716b0 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:13.666822 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ddef916b-97ce-4e1c-85c0-021efd2a2b3c tempest-ImagesOneServerTestJSON-1109024356 tempest-ImagesOneServerTestJSON-1109024356-project] 10.222.0.46 "GET /compute/v2.1/servers/56239473-fc9f-4373-b5e0-7058520716b0" status: 404 len: 111 microversion: 2.1 time: 0.063835 Jul 28 10:32:13.671147 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 253/456] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:13 2022] GET /compute/v2.1/servers/56239473-fc9f-4373-b5e0-7058520716b0 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:32:13.944787 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d2f39270-f016-4475-a83c-4c7e93e347ef tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Calling method '.version_select at 0x7fa94bfedf70>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:14.365165 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-54dbbde5-59e8-4a0d-bb12-32168bc4fe6a tempest-TenantUsagesNegativeTestJSON-1056227443 tempest-TenantUsagesNegativeTestJSON-1056227443-project] Calling method '.version_select at 0x7fa94bc733a0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:14.371873 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-54dbbde5-59e8-4a0d-bb12-32168bc4fe6a tempest-TenantUsagesNegativeTestJSON-1056227443 tempest-TenantUsagesNegativeTestJSON-1056227443-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'e027382bfda54b4b82bc9deaedbfa5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63839af1e0c542058d20df37d726ba37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:14.373635 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-54dbbde5-59e8-4a0d-bb12-32168bc4fe6a tempest-TenantUsagesNegativeTestJSON-1056227443 tempest-TenantUsagesNegativeTestJSON-1056227443-project] Request method failure captured: Jul 28 10:32:14.373635 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-27T10%3A32%3A12.528826&end=2022-07-29T10%3A32%3A12.528826&detailed=1 HTTP/1.1 Jul 28 10:32:14.373635 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:32:14.373635 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:32:14.373635 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:32:14.373635 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:32:14.373635 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:32:14.373635 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:32:14.373635 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:32:14.373635 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:14.373635 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mWpPFCfSJB4wil-fCvEpeyWqNE3rbHGsibWr_WIF1zCbx5rLH4SPjUbKdWoOkc1zc9mLv7QQdu2wJoAqcinJ_jUWOoSIncdxqmg8LaMewTRx53mTilaLZW50K6umqdQcQAerQ8v9A5nifEbkVPaR7V822sySW8yRO6ppsRilHbmLS0 Jul 28 10:32:14.373635 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:32:14.373635 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:32:14.373635 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:32:14.373635 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:32:14.373635 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:32:14.373635 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:32:14.373635 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 63839af1e0c542058d20df37d726ba37 Jul 28 10:32:14.373635 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1056227443 Jul 28 10:32:14.373635 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:32:14.373635 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:32:14.375069 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/63839af1e0c542058d20df37d726ba37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/63839af1e0c542058d20df37d726ba37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/63839af1e0c542058d20df37d726ba37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_63839af1e0c542058d20df37d726ba37", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:14.375069 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1056227443 Jul 28 10:32:14.375069 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 63839af1e0c542058d20df37d726ba37 Jul 28 10:32:14.375069 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1056227443 Jul 28 10:32:14.375069 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-TenantUsagesNegativeTestJSON-1056227443-project Jul 28 10:32:14.375069 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:32:14.375069 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:32:14.375069 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: e027382bfda54b4b82bc9deaedbfa5ea Jul 28 10:32:14.375069 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1056227443-project Jul 28 10:32:14.375069 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:32:14.375069 n-d-850468-6 devstack@n-api.service[119464]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 28 10:32:14.375069 n-d-850468-6 devstack@n-api.service[119464]: action_args: {} Jul 28 10:32:14.375069 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:14.376028 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:14.376028 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:14.376028 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:14.376028 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:14.376028 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:14.376028 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:32:14.376028 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:32:14.376028 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 10:32:14.376028 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:14.376028 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:14.376028 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:14.376028 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 28 10:32:14.376028 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 28 10:32:14.376028 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 28 10:32:14.376028 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 28 10:32:14.376028 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:32:14.376028 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:32:14.376028 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:32:14.376028 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:32:14.377423 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:32:14.377423 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:32:14.377423 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:32:14.377423 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:32:14.377423 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:32:14.377423 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:32:14.377423 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:32:14.377423 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:32:14.377423 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:32:14.377423 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:32:14.377423 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 28 10:32:14.377423 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:14.377423 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:14.377423 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:14.377423 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:14.377423 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:14.377423 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:14.377423 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:32:14.377423 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:32:14.380401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 28 10:32:14.380401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:14.380401 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-54dbbde5-59e8-4a0d-bb12-32168bc4fe6a tempest-TenantUsagesNegativeTestJSON-1056227443 tempest-TenantUsagesNegativeTestJSON-1056227443-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:14.381500 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-54dbbde5-59e8-4a0d-bb12-32168bc4fe6a tempest-TenantUsagesNegativeTestJSON-1056227443 tempest-TenantUsagesNegativeTestJSON-1056227443-project] 10.222.0.46 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-27T10%3A32%3A12.528826&end=2022-07-29T10%3A32%3A12.528826&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.711198 Jul 28 10:32:14.387125 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 254/457] 10.222.0.46 () {58 vars in 1335 bytes} [Thu Jul 28 10:32:13 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-27T10%3A32%3A12.528826&end=2022-07-29T10%3A32%3A12.528826&detailed=1 => generated 123 bytes in 718 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:32:14.822750 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d2f39270-f016-4475-a83c-4c7e93e347ef tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/1bae7d999d904322aa22e76ac004ba16" status: 200 len: 371 microversion: 2.1 time: 1.516699 Jul 28 10:32:14.838608 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-50e0c314-5920-4e80-bf1d-eb238c78a575 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Action: 'update', calling method: .version_select at 0x7fa94bc234c0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:14.842410 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 204/458] 10.222.0.46 () {58 vars in 1242 bytes} [Thu Jul 28 10:32:13 2022] GET /compute/v2.1/os-quota-sets/1bae7d999d904322aa22e76ac004ba16 => generated 371 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:15.968055 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-50e0c314-5920-4e80-bf1d-eb238c78a575 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:15.969129 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-50e0c314-5920-4e80-bf1d-eb238c78a575 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:15.970347 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-50e0c314-5920-4e80-bf1d-eb238c78a575 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:15.974521 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-50e0c314-5920-4e80-bf1d-eb238c78a575 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:16.168090 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-50e0c314-5920-4e80-bf1d-eb238c78a575 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/1bae7d999d904322aa22e76ac004ba16" status: 200 len: 328 microversion: 2.1 time: 1.334094 Jul 28 10:32:16.169428 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 255/459] 10.222.0.46 () {60 vars in 1262 bytes} [Thu Jul 28 10:32:14 2022] PUT /compute/v2.1/os-quota-sets/1bae7d999d904322aa22e76ac004ba16 => generated 328 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:32:17.492213 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-901d4adb-78ab-4bb8-a6e5-f09d7b7341ab tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1269896998", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:17.616997 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-901d4adb-78ab-4bb8-a6e5-f09d7b7341ab tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] validate_networks() for None {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:32:17.974929 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-901d4adb-78ab-4bb8-a6e5-f09d7b7341ab tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:32:17.975464 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-901d4adb-78ab-4bb8-a6e5-f09d7b7341ab tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:32:17.977001 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-901d4adb-78ab-4bb8-a6e5-f09d7b7341ab tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:32:17.977754 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-901d4adb-78ab-4bb8-a6e5-f09d7b7341ab tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:32:17.978196 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-901d4adb-78ab-4bb8-a6e5-f09d7b7341ab tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:32:18.003076 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-901d4adb-78ab-4bb8-a6e5-f09d7b7341ab tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:18.006222 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-901d4adb-78ab-4bb8-a6e5-f09d7b7341ab tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:18.008791 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-901d4adb-78ab-4bb8-a6e5-f09d7b7341ab tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:18.010970 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-901d4adb-78ab-4bb8-a6e5-f09d7b7341ab tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:18.067092 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-901d4adb-78ab-4bb8-a6e5-f09d7b7341ab tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Getting quotas for project 1bae7d999d904322aa22e76ac004ba16. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:18.075771 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-901d4adb-78ab-4bb8-a6e5-f09d7b7341ab tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Getting quotas for user 6a78ad5e1e4d49c98ec79d4551c6bdab and project 1bae7d999d904322aa22e76ac004ba16. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:18.097939 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.utils [None req-901d4adb-78ab-4bb8-a6e5-f09d7b7341ab tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] cores quota exceeded for 1bae7d999d904322aa22e76ac004ba16, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119463) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 28 10:32:18.100024 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-901d4adb-78ab-4bb8-a6e5-f09d7b7341ab tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 28 10:32:18.104996 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-901d4adb-78ab-4bb8-a6e5-f09d7b7341ab tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Request method failure captured: Jul 28 10:32:18.104996 n-d-850468-6 devstack@n-api.service[119463]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 10:32:18.104996 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:32:18.104996 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:32:18.104996 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:32:18.104996 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 145 Jul 28 10:32:18.104996 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:32:18.104996 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:32:18.104996 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:32:18.104996 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:18.104996 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mWqxNitjSEj2v-lHc_VPpBBXVyqX_oMtGzjr8orWAk7bA-kfPJhOO96-6AqFA4ZZnHy4bCVYeYlnQmfUfIY-TOx1V8rX3PzqMFs8lq01KwIKSwKnaTnF4R3u5Lw4pHYVw14YyJU1_DsinrmKF-tvMTkaKlmLnwuJqMSEgSlkW7-Fjg Jul 28 10:32:18.104996 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:32:18.104996 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:32:18.104996 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:32:18.104996 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:32:18.104996 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:32:18.104996 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:32:18.104996 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 1bae7d999d904322aa22e76ac004ba16 Jul 28 10:32:18.104996 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-QuotasAdminNegativeTest-1501188797 Jul 28 10:32:18.104996 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:32:18.104996 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:32:18.106549 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1bae7d999d904322aa22e76ac004ba16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1bae7d999d904322aa22e76ac004ba16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1bae7d999d904322aa22e76ac004ba16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1bae7d999d904322aa22e76ac004ba16", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:18.106549 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-QuotasAdminNegativeTest-1501188797 Jul 28 10:32:18.106549 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 1bae7d999d904322aa22e76ac004ba16 Jul 28 10:32:18.106549 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1501188797 Jul 28 10:32:18.106549 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-QuotasAdminNegativeTest-1501188797-project Jul 28 10:32:18.106549 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:32:18.106549 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:32:18.106549 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 6a78ad5e1e4d49c98ec79d4551c6bdab Jul 28 10:32:18.106549 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-QuotasAdminNegativeTest-1501188797-project Jul 28 10:32:18.106549 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:32:18.106549 n-d-850468-6 devstack@n-api.service[119463]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1269896998", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} Jul 28 10:32:18.106549 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:32:18.107414 n-d-850468-6 devstack@n-api.service[119463]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 28 10:32:18.107414 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1269896998', 'imageRef': 'eff4a889-87b7-4a4c-be7a-77433dc25faf', 'flavorRef': '452'}}} Jul 28 10:32:18.107414 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:18.107414 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:18.107414 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 28 10:32:18.107414 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 28 10:32:18.107414 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:32:18.107414 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:32:18.107414 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 28 10:32:18.107414 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc Jul 28 10:32:18.107414 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 28 10:32:18.107414 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 28 10:32:18.107414 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:32:18.107414 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:32:18.107414 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 28 10:32:18.107414 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 28 10:32:18.107414 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 28 10:32:18.107414 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 28 10:32:18.108530 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 28 10:32:18.108530 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 28 10:32:18.108530 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 28 10:32:18.108530 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:18.108530 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:18.108530 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:18.108530 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:18.108530 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 28 10:32:18.108530 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 28 10:32:18.108530 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2152, in create Jul 28 10:32:18.108530 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 28 10:32:18.108530 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1679, in _create_instance Jul 28 10:32:18.108530 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 28 10:32:18.108530 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1351, in _provision_instances Jul 28 10:32:18.108530 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 28 10:32:18.108530 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 28 10:32:18.108530 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 28 10:32:18.108530 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 28 10:32:18.108530 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:18.108530 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:18.108530 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:18.109790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:18.109790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:18.109790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:18.109790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:18.109790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:18.109790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:18.109790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:18.109790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:18.109790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:18.109790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:18.109790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:18.109790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:18.109790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:18.109790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 10:32:18.109790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 28 10:32:18.109790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 28 10:32:18.109790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 28 10:32:18.109790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:18.109790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:18.109790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:18.109790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:18.115388 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:18.115388 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:18.115388 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:18.115388 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:18.115388 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 28 10:32:18.115388 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:18.118408 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-901d4adb-78ab-4bb8-a6e5-f09d7b7341ab tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:18.119678 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-901d4adb-78ab-4bb8-a6e5-f09d7b7341ab tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.559684 Jul 28 10:32:18.124389 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 205/460] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:32:16 2022] POST /compute/v2.1/servers => generated 111 bytes in 1565 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:32:18.133569 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6c4c6f65-b4af-46b3-961c-be334120cf66 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Action: 'update', calling method: .version_select at 0x7fa94bdcb790>, body: {"quota_set": {"cores": 20}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:18.726688 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6c4c6f65-b4af-46b3-961c-be334120cf66 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:18.727949 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6c4c6f65-b4af-46b3-961c-be334120cf66 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:18.729354 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6c4c6f65-b4af-46b3-961c-be334120cf66 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:18.731152 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6c4c6f65-b4af-46b3-961c-be334120cf66 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:18.769501 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8c014d88-7546-480d-a2d4-80d599b4f07c tempest-InstanceUsageAuditLogNegativeTestJSON-217027384 tempest-InstanceUsageAuditLogNegativeTestJSON-217027384-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:18.770442 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:32:18.770442 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:32:18.771317 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-8c014d88-7546-480d-a2d4-80d599b4f07c tempest-InstanceUsageAuditLogNegativeTestJSON-217027384 tempest-InstanceUsageAuditLogNegativeTestJSON-217027384-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 28 10:32:18.783323 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8c014d88-7546-480d-a2d4-80d599b4f07c tempest-InstanceUsageAuditLogNegativeTestJSON-217027384 tempest-InstanceUsageAuditLogNegativeTestJSON-217027384-project-admin] Request method failure captured: Jul 28 10:32:18.783323 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 28 10:32:18.783323 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:32:18.783323 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:32:18.783323 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:32:18.783323 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:32:18.783323 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:32:18.783323 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:32:18.783323 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:32:18.783323 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:18.783323 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mWySrfMF-_FFC4jmEsTy21B_YceTAn_puKRn9WzcwPc2LZZ-2E87UmMDUSapX0j5QIC-ec6xyzlB6twbGsXayB2xZk1AFd1C1x3zVkqq198a2r1UoSSDQJJkzAR1UZs8hrVgOs1gQ2_ZV33GPv_7EyPou_RHjaLyqTniwgIwy-TLPY Jul 28 10:32:18.783323 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:32:18.783323 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:32:18.783323 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:32:18.783323 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:32:18.783323 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:32:18.783323 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:32:18.783323 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: efdfa03564c544dda7e6f65e7ff5f781 Jul 28 10:32:18.783323 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-217027384 Jul 28 10:32:18.783323 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member,admin Jul 28 10:32:18.783323 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member,admin Jul 28 10:32:18.784642 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/efdfa03564c544dda7e6f65e7ff5f781"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/efdfa03564c544dda7e6f65e7ff5f781"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/efdfa03564c544dda7e6f65e7ff5f781"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_efdfa03564c544dda7e6f65e7ff5f781", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:18.784642 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-217027384 Jul 28 10:32:18.784642 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: efdfa03564c544dda7e6f65e7ff5f781 Jul 28 10:32:18.784642 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-217027384 Jul 28 10:32:18.784642 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-217027384-project-admin Jul 28 10:32:18.784642 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:32:18.784642 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:32:18.784642 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 807bc61b96214580a49f937f243a6832 Jul 28 10:32:18.784642 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-217027384-project-admin Jul 28 10:32:18.784642 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:32:18.784642 n-d-850468-6 devstack@n-api.service[119463]: exception: Invalid timestamp for date invalid_time Jul 28 10:32:18.784642 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'invalid_time'} Jul 28 10:32:18.785445 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:18.785445 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:18.785445 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 28 10:32:18.785445 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 28 10:32:18.785445 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 28 10:32:18.785445 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 28 10:32:18.785445 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 28 10:32:18.785445 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 28 10:32:18.785445 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 28 10:32:18.785445 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:18.785445 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:18.785445 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:18.785445 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:18.785445 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:18.785445 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:18.785445 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:18.785445 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:18.785445 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:18.785445 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:18.785445 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 28 10:32:18.786669 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 28 10:32:18.786669 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 28 10:32:18.786669 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:18.786669 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:18.786669 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:18.786669 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:18.786669 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:18.786669 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:18.786669 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:18.786669 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:18.786669 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 28 10:32:18.786669 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:18.786669 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8c014d88-7546-480d-a2d4-80d599b4f07c tempest-InstanceUsageAuditLogNegativeTestJSON-217027384 tempest-InstanceUsageAuditLogNegativeTestJSON-217027384-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:18.789502 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-8c014d88-7546-480d-a2d4-80d599b4f07c tempest-InstanceUsageAuditLogNegativeTestJSON-217027384 tempest-InstanceUsageAuditLogNegativeTestJSON-217027384-project-admin] 10.222.0.46 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.558511 Jul 28 10:32:18.790103 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 206/461] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Jul 28 10:32:18 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 560 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 28 10:32:18.871626 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-6c4c6f65-b4af-46b3-961c-be334120cf66 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/1bae7d999d904322aa22e76ac004ba16" status: 200 len: 329 microversion: 2.1 time: 0.745197 Jul 28 10:32:18.873504 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 256/462] 10.222.0.46 () {60 vars in 1262 bytes} [Thu Jul 28 10:32:18 2022] PUT /compute/v2.1/os-quota-sets/1bae7d999d904322aa22e76ac004ba16 => generated 329 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:18.893666 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9e76dd6a-0981-40af-aebc-88fff224377c tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Calling method '.version_select at 0x7fa94bc6de50>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:19.576587 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-dca4126b-50b1-4578-89e9-57386dea8812 tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005 tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:19.577625 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:32:19.577625 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:32:19.579012 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-dca4126b-50b1-4578-89e9-57386dea8812 tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005 tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'ed467cd49a134af59c9a62d6914e773b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c282c3a6f54409ac618f166f7fb121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:19.582847 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-dca4126b-50b1-4578-89e9-57386dea8812 tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005 tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005-project] Request method failure captured: Jul 28 10:32:19.582847 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 28 10:32:19.582847 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:32:19.582847 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:32:19.582847 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:32:19.582847 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:32:19.582847 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:32:19.582847 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:32:19.582847 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:32:19.582847 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:19.582847 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mWt-FSFPso1bQmJ4u1_B7p0iE_58zrA3f9-ovOAAU8zuYWj6m6qswvk46RLUJZgSwsdId3O_qQgsnTdYnXG10KA_Ps7ddNlp0n4B3hxSrEsPqix_QeNE48cBnJVzM--H73vB4QG5QYwSsAccdZiUljk_PTIMYOnK77ucsi-ZBS5QRQ Jul 28 10:32:19.582847 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:32:19.582847 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:32:19.582847 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:32:19.582847 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:32:19.582847 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:32:19.582847 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:32:19.582847 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 07c282c3a6f54409ac618f166f7fb121 Jul 28 10:32:19.582847 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005 Jul 28 10:32:19.582847 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:32:19.582847 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:32:19.584412 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/07c282c3a6f54409ac618f166f7fb121"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/07c282c3a6f54409ac618f166f7fb121"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/07c282c3a6f54409ac618f166f7fb121"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_07c282c3a6f54409ac618f166f7fb121", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:19.584412 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005 Jul 28 10:32:19.584412 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 07c282c3a6f54409ac618f166f7fb121 Jul 28 10:32:19.584412 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005 Jul 28 10:32:19.584412 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005-project Jul 28 10:32:19.584412 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:32:19.584412 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:32:19.584412 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: ed467cd49a134af59c9a62d6914e773b Jul 28 10:32:19.584412 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005-project Jul 28 10:32:19.584412 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:32:19.584412 n-d-850468-6 devstack@n-api.service[119463]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 28 10:32:19.585234 n-d-850468-6 devstack@n-api.service[119463]: action_args: {} Jul 28 10:32:19.585234 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:19.585234 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:19.585234 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:19.585234 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:19.585234 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:19.585234 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:19.585234 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:19.585234 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:19.585234 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 28 10:32:19.585234 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 28 10:32:19.585234 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:32:19.585234 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:32:19.585234 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:32:19.585234 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:32:19.585234 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:32:19.585234 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:32:19.585234 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:32:19.585234 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:32:19.585234 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:32:19.587491 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:32:19.587491 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:32:19.587491 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:32:19.587491 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:32:19.587491 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:32:19.587491 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 28 10:32:19.587491 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:19.587491 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:19.587491 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:19.587491 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:19.587491 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:19.587491 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:19.587491 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:32:19.587491 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:32:19.587491 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 28 10:32:19.587491 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:19.593637 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-dca4126b-50b1-4578-89e9-57386dea8812 tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005 tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:19.599006 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-dca4126b-50b1-4578-89e9-57386dea8812 tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005 tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005-project] 10.222.0.46 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.801430 Jul 28 10:32:19.600120 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 207/463] 10.222.0.46 () {58 vars in 1185 bytes} [Thu Jul 28 10:32:18 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 803 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:32:19.613229 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-42de7cd1-7193-4ab1-82bd-61746b906fa3 tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005 tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:19.618643 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-42de7cd1-7193-4ab1-82bd-61746b906fa3 tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005 tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'ed467cd49a134af59c9a62d6914e773b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c282c3a6f54409ac618f166f7fb121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:19.624309 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-42de7cd1-7193-4ab1-82bd-61746b906fa3 tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005 tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005-project] Request method failure captured: Jul 28 10:32:19.624309 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-28%2010:32:19 HTTP/1.1 Jul 28 10:32:19.624309 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:32:19.624309 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:32:19.624309 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:32:19.624309 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:32:19.624309 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:32:19.624309 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:32:19.624309 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:32:19.624309 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:19.624309 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mWt-FSFPso1bQmJ4u1_B7p0iE_58zrA3f9-ovOAAU8zuYWj6m6qswvk46RLUJZgSwsdId3O_qQgsnTdYnXG10KA_Ps7ddNlp0n4B3hxSrEsPqix_QeNE48cBnJVzM--H73vB4QG5QYwSsAccdZiUljk_PTIMYOnK77ucsi-ZBS5QRQ Jul 28 10:32:19.624309 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:32:19.624309 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:32:19.624309 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:32:19.624309 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:32:19.624309 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:32:19.624309 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:32:19.624309 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 07c282c3a6f54409ac618f166f7fb121 Jul 28 10:32:19.624309 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005 Jul 28 10:32:19.624309 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:32:19.624309 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:32:19.625652 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/07c282c3a6f54409ac618f166f7fb121"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/07c282c3a6f54409ac618f166f7fb121"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/07c282c3a6f54409ac618f166f7fb121"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_07c282c3a6f54409ac618f166f7fb121", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:19.625652 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005 Jul 28 10:32:19.625652 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 07c282c3a6f54409ac618f166f7fb121 Jul 28 10:32:19.625652 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005 Jul 28 10:32:19.625652 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005-project Jul 28 10:32:19.625652 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:32:19.625652 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:32:19.625652 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: ed467cd49a134af59c9a62d6914e773b Jul 28 10:32:19.625652 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005-project Jul 28 10:32:19.625652 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:32:19.625652 n-d-850468-6 devstack@n-api.service[119463]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 28 10:32:19.627701 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '2022-07-28 10:32:19'} Jul 28 10:32:19.627701 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:19.627701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:19.627701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:19.627701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:19.627701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:19.627701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:19.627701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:19.627701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:19.627701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 28 10:32:19.627701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 28 10:32:19.627701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:32:19.627701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:32:19.627701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:32:19.627701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:32:19.627701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:32:19.627701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:32:19.627701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:32:19.627701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:32:19.627701 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:32:19.629208 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:32:19.629208 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:32:19.629208 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:32:19.629208 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:32:19.629208 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:32:19.629208 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 28 10:32:19.629208 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:19.629208 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:19.629208 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:19.629208 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:19.629208 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:19.629208 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:19.629208 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:32:19.629208 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:32:19.629208 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 28 10:32:19.629208 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:19.634926 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-42de7cd1-7193-4ab1-82bd-61746b906fa3 tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005 tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:19.636148 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-42de7cd1-7193-4ab1-82bd-61746b906fa3 tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005 tempest-InstanceUsageAuditLogNegativeTestJSON-1185700005-project] 10.222.0.46 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-28 10:32:19" status: 403 len: 128 microversion: 2.1 time: 0.031785 Jul 28 10:32:19.640131 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 208/464] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Jul 28 10:32:19 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-28%2010%3A32%3A19 => generated 128 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:32:20.039032 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9e76dd6a-0981-40af-aebc-88fff224377c tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/1bae7d999d904322aa22e76ac004ba16" status: 200 len: 371 microversion: 2.1 time: 1.152810 Jul 28 10:32:20.040276 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 257/465] 10.222.0.46 () {58 vars in 1242 bytes} [Thu Jul 28 10:32:18 2022] GET /compute/v2.1/os-quota-sets/1bae7d999d904322aa22e76ac004ba16 => generated 371 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:20.052426 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ffc04c7d-a8cf-4588-8240-07878141438e tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Action: 'update', calling method: .version_select at 0x7fa94bd308b0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:20.730933 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ffc04c7d-a8cf-4588-8240-07878141438e tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:20.731427 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ffc04c7d-a8cf-4588-8240-07878141438e tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:20.732234 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ffc04c7d-a8cf-4588-8240-07878141438e tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:20.732673 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ffc04c7d-a8cf-4588-8240-07878141438e tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:20.907567 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:20.918175 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ffc04c7d-a8cf-4588-8240-07878141438e tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/1bae7d999d904322aa22e76ac004ba16" status: 200 len: 328 microversion: 2.1 time: 0.869455 Jul 28 10:32:20.920424 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 209/466] 10.222.0.46 () {60 vars in 1262 bytes} [Thu Jul 28 10:32:20 2022] PUT /compute/v2.1/os-quota-sets/1bae7d999d904322aa22e76ac004ba16 => generated 328 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:21.104965 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-442194688", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "477601da-c9a1-45cc-8baf-39206a635eab"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:21.162404 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:UPDATE=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:21.308954 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] validate_networks() for [('477601da-c9a1-45cc-8baf-39206a635eab', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:32:21.574264 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-684a023e-3b6b-4579-9e57-d42cfa0f5f80 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1523871763", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:21.835623 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-684a023e-3b6b-4579-9e57-d42cfa0f5f80 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] validate_networks() for None {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:32:22.780618 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-684a023e-3b6b-4579-9e57-d42cfa0f5f80 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:32:22.781938 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-684a023e-3b6b-4579-9e57-d42cfa0f5f80 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:32:22.782444 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-684a023e-3b6b-4579-9e57-d42cfa0f5f80 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:32:22.783261 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-684a023e-3b6b-4579-9e57-d42cfa0f5f80 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:32:22.783363 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-684a023e-3b6b-4579-9e57-d42cfa0f5f80 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:32:22.829096 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-684a023e-3b6b-4579-9e57-d42cfa0f5f80 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:22.834845 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-684a023e-3b6b-4579-9e57-d42cfa0f5f80 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:22.836093 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-684a023e-3b6b-4579-9e57-d42cfa0f5f80 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:22.837950 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-684a023e-3b6b-4579-9e57-d42cfa0f5f80 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:22.955603 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:32:22.956173 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:32:22.956648 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:32:22.957052 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:32:22.957462 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:32:22.964862 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-684a023e-3b6b-4579-9e57-d42cfa0f5f80 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Getting quotas for project 1bae7d999d904322aa22e76ac004ba16. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:22.982154 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:22.982363 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:22.986309 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:22.986719 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:22.998593 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-684a023e-3b6b-4579-9e57-d42cfa0f5f80 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Getting quotas for user 6a78ad5e1e4d49c98ec79d4551c6bdab and project 1bae7d999d904322aa22e76ac004ba16. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:23.036012 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.utils [None req-684a023e-3b6b-4579-9e57-d42cfa0f5f80 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] instances quota exceeded for 1bae7d999d904322aa22e76ac004ba16, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119463) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 28 10:32:23.036573 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-684a023e-3b6b-4579-9e57-d42cfa0f5f80 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 28 10:32:23.043517 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-684a023e-3b6b-4579-9e57-d42cfa0f5f80 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Request method failure captured: Jul 28 10:32:23.043517 n-d-850468-6 devstack@n-api.service[119463]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 10:32:23.043517 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:32:23.043517 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:32:23.043517 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:32:23.043517 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 145 Jul 28 10:32:23.043517 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:32:23.043517 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:32:23.043517 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:32:23.043517 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:23.043517 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mWqxNitjSEj2v-lHc_VPpBBXVyqX_oMtGzjr8orWAk7bA-kfPJhOO96-6AqFA4ZZnHy4bCVYeYlnQmfUfIY-TOx1V8rX3PzqMFs8lq01KwIKSwKnaTnF4R3u5Lw4pHYVw14YyJU1_DsinrmKF-tvMTkaKlmLnwuJqMSEgSlkW7-Fjg Jul 28 10:32:23.043517 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:32:23.043517 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:32:23.043517 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:32:23.043517 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:32:23.043517 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:32:23.043517 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:32:23.043517 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 1bae7d999d904322aa22e76ac004ba16 Jul 28 10:32:23.043517 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-QuotasAdminNegativeTest-1501188797 Jul 28 10:32:23.043517 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:32:23.043517 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:32:23.045152 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1bae7d999d904322aa22e76ac004ba16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1bae7d999d904322aa22e76ac004ba16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1bae7d999d904322aa22e76ac004ba16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1bae7d999d904322aa22e76ac004ba16", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:23.045152 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-QuotasAdminNegativeTest-1501188797 Jul 28 10:32:23.045152 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 1bae7d999d904322aa22e76ac004ba16 Jul 28 10:32:23.045152 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1501188797 Jul 28 10:32:23.045152 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-QuotasAdminNegativeTest-1501188797-project Jul 28 10:32:23.045152 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:32:23.045152 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:32:23.045152 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 6a78ad5e1e4d49c98ec79d4551c6bdab Jul 28 10:32:23.045152 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-QuotasAdminNegativeTest-1501188797-project Jul 28 10:32:23.045152 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:32:23.045152 n-d-850468-6 devstack@n-api.service[119463]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1523871763", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} Jul 28 10:32:23.045152 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:32:23.045982 n-d-850468-6 devstack@n-api.service[119463]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 28 10:32:23.045982 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1523871763', 'imageRef': 'eff4a889-87b7-4a4c-be7a-77433dc25faf', 'flavorRef': '452'}}} Jul 28 10:32:23.045982 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:23.045982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:23.045982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 28 10:32:23.045982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 28 10:32:23.045982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:32:23.045982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:32:23.045982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 28 10:32:23.045982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc Jul 28 10:32:23.045982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 28 10:32:23.045982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 28 10:32:23.045982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:32:23.045982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:32:23.045982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 28 10:32:23.045982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 28 10:32:23.045982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 28 10:32:23.045982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 28 10:32:23.047253 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 28 10:32:23.047253 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 28 10:32:23.047253 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 28 10:32:23.047253 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:23.047253 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:23.047253 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:23.047253 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:23.047253 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 28 10:32:23.047253 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 28 10:32:23.047253 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2152, in create Jul 28 10:32:23.047253 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 28 10:32:23.047253 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1679, in _create_instance Jul 28 10:32:23.047253 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 28 10:32:23.047253 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1351, in _provision_instances Jul 28 10:32:23.047253 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 28 10:32:23.047253 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 28 10:32:23.047253 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 28 10:32:23.047253 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 28 10:32:23.047253 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:23.047253 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:23.047253 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:23.048982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:23.048982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:23.048982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:23.048982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:23.048982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:23.048982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:23.048982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:23.048982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:23.048982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:23.048982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:23.048982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:23.048982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:23.048982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:23.048982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 10:32:23.048982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 28 10:32:23.048982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 28 10:32:23.048982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 28 10:32:23.048982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:23.048982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:23.048982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:23.048982 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:23.050521 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:23.050521 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:23.050521 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:23.050521 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:23.050521 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 28 10:32:23.050521 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:23.050521 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-684a023e-3b6b-4579-9e57-d42cfa0f5f80 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:23.050521 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-684a023e-3b6b-4579-9e57-d42cfa0f5f80 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.478440 Jul 28 10:32:23.050521 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 210/467] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:32:21 2022] POST /compute/v2.1/servers => generated 119 bytes in 1482 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:32:23.077481 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Getting quotas for project 5fb90e03403f4c0a9d9de4902a0a7ca9. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:23.117312 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Getting quotas for user aa4dec286d7c45bba6614c14b733168a and project 5fb90e03403f4c0a9d9de4902a0a7ca9. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:23.155174 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:32:23.157921 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] [instance: e98d4b6b-a8c4-4461-be6b-93d6a9a9915a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:32:23.288611 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-27f55cd0-7f1e-4a8e-990e-33d975ab1fdf tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.846457 Jul 28 10:32:23.289818 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 258/468] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:32:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:32:23.306697 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-583fcfb9-90c5-4b97-859c-8fec17a70b8b tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Action: 'update', calling method: .version_select at 0x7fa94bced160>, body: {"quota_set": {"instances": 10}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:23.747384 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-28e23fa0-5f75-437a-be9a-8dac57df2a50 tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:23.796307 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-28e23fa0-5f75-437a-be9a-8dac57df2a50 tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.745569 Jul 28 10:32:23.803416 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 211/469] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 10:32:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:23.824331 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-eebdc41d-3a5b-426a-b407-f836d1b6632e tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:23.831831 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-eebdc41d-3a5b-426a-b407-f836d1b6632e tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] [instance: e98d4b6b-a8c4-4461-be6b-93d6a9a9915a] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:23.848225 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-eebdc41d-3a5b-426a-b407-f836d1b6632e tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:23.850893 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-eebdc41d-3a5b-426a-b407-f836d1b6632e tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:23.852774 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-eebdc41d-3a5b-426a-b407-f836d1b6632e tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:23.854418 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-eebdc41d-3a5b-426a-b407-f836d1b6632e tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:24.004437 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-eebdc41d-3a5b-426a-b407-f836d1b6632e tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4dec286d7c45bba6614c14b733168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb90e03403f4c0a9d9de4902a0a7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:24.018502 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-eebdc41d-3a5b-426a-b407-f836d1b6632e tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] 10.222.0.46 "GET /compute/v2.1/servers/e98d4b6b-a8c4-4461-be6b-93d6a9a9915a" status: 200 len: 1215 microversion: 2.1 time: 0.208254 Jul 28 10:32:24.021974 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 212/470] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:23 2022] GET /compute/v2.1/servers/e98d4b6b-a8c4-4461-be6b-93d6a9a9915a => generated 1215 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:24.041878 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2716258e-b329-4a38-a5ab-ad95507e7df2 tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:24.112545 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-2716258e-b329-4a38-a5ab-ad95507e7df2 tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] 10.222.0.46 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.085214 Jul 28 10:32:24.115972 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 213/471] 10.222.0.46 () {58 vars in 1125 bytes} [Thu Jul 28 10:32:24 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:24.134063 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a7d15b91-eea3-4134-adca-f263160399df tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:24.156173 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a7d15b91-eea3-4134-adca-f263160399df tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025413 Jul 28 10:32:24.162402 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 214/472] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 10:32:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:24.190758 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-432046947", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "1c87581d-6ea4-480a-85dd-94af3087f3e2"}], "block_device_mapping_v2": [{"uuid": "aa85c6e2-453f-4494-9ded-cf4e1ddd89dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:24.307993 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-583fcfb9-90c5-4b97-859c-8fec17a70b8b tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:24.308478 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-583fcfb9-90c5-4b97-859c-8fec17a70b8b tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:24.309247 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-583fcfb9-90c5-4b97-859c-8fec17a70b8b tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:24.309662 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-583fcfb9-90c5-4b97-859c-8fec17a70b8b tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:24.373564 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] validate_networks() for [('1c87581d-6ea4-480a-85dd-94af3087f3e2', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:32:24.451303 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-583fcfb9-90c5-4b97-859c-8fec17a70b8b tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/1bae7d999d904322aa22e76ac004ba16" status: 200 len: 329 microversion: 2.1 time: 1.158295 Jul 28 10:32:24.457508 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 259/473] 10.222.0.46 () {60 vars in 1262 bytes} [Thu Jul 28 10:32:23 2022] PUT /compute/v2.1/os-quota-sets/1bae7d999d904322aa22e76ac004ba16 => generated 329 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:24.465983 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-010c37ee-24fa-403b-8d74-6aa48f964d6c tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:24.494769 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-010c37ee-24fa-403b-8d74-6aa48f964d6c tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034577 Jul 28 10:32:24.495575 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 260/474] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 10:32:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:24.842455 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-821171950", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:24.916278 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] validate_networks() for None {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:32:25.214851 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:32:25.215352 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:32:25.215875 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:32:25.216302 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:32:25.216719 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:32:25.237607 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:25.238128 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:25.238993 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:25.239438 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:25.301070 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Getting quotas for project 07e2042b56704e9fb5195d43d8116494. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:25.306720 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Getting quotas for user 5a46f399714c4124a253c57a26f77a0b and project 07e2042b56704e9fb5195d43d8116494. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:25.455451 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:32:25.457429 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3e5d3f71-0a17-4e98-9158-a92944492744] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aa85c6e2-453f-4494-9ded-cf4e1ddd89dd',volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:32:25.547003 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:32:25.548097 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:32:25.548810 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:32:25.549385 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:32:25.549972 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:32:25.564938 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:25.569362 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:25.570611 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:25.572201 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:25.611649 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Getting quotas for project 5a82c16499174675a06d390a1417fab3. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:25.618588 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Getting quotas for user fa34881c00984288b5f9c29dba8d8885 and project 5a82c16499174675a06d390a1417fab3. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:25.636659 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:32:25.639820 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] [instance: 1bf10c19-7f3f-4ef1-99bf-83fc47308b28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:32:25.728304 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-040bcbc6-62b4-435c-90ec-d8d38d44f940 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.231391 Jul 28 10:32:25.729540 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 261/475] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:32:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:32:25.736748 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b2789b60-69f6-4df7-9cba-7b2cb07bff62 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Calling method '.version_select at 0x7fa94bc73f70>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:25.899073 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-90f3d8b7-d06b-4ff9-9178-695f361ca234 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.724358 Jul 28 10:32:25.907156 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 215/476] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Jul 28 10:32:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 10:32:25.922828 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d92cedc8-9466-40cf-bf6e-28f6275f26f6 tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:25.997221 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d92cedc8-9466-40cf-bf6e-28f6275f26f6 tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.086921 Jul 28 10:32:26.000746 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 216/477] 10.222.0.46 () {58 vars in 1165 bytes} [Thu Jul 28 10:32:25 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:26.015313 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-9f553424-c33c-47a8-b92c-61992cb8af99 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Calling method '.version_select at 0x7fa94bce8a60>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:26.112790 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-9f553424-c33c-47a8-b92c-61992cb8af99 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] 10.222.0.46 "GET /compute/v2.1/images/ad393c8a-f154-47a5-beb3-ce83eb79ec3a" status: 200 len: 662 microversion: 2.1 time: 0.110248 Jul 28 10:32:26.116309 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 217/478] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Jul 28 10:32:26 2022] GET /compute/v2.1/images/ad393c8a-f154-47a5-beb3-ce83eb79ec3a => generated 662 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:26.139304 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6197ec8b-2310-4e92-bc6e-962d095027a1 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:26.141014 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-6197ec8b-2310-4e92-bc6e-962d095027a1 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] [instance: e98d4b6b-a8c4-4461-be6b-93d6a9a9915a] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:26.165132 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6197ec8b-2310-4e92-bc6e-962d095027a1 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:26.166394 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6197ec8b-2310-4e92-bc6e-962d095027a1 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:26.167695 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6197ec8b-2310-4e92-bc6e-962d095027a1 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:26.168777 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6197ec8b-2310-4e92-bc6e-962d095027a1 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:26.294718 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6197ec8b-2310-4e92-bc6e-962d095027a1 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:26.295911 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6197ec8b-2310-4e92-bc6e-962d095027a1 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:26.296693 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-6197ec8b-2310-4e92-bc6e-962d095027a1 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lazy-loading 'fault' on Instance uuid e98d4b6b-a8c4-4461-be6b-93d6a9a9915a {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:32:26.323689 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b2789b60-69f6-4df7-9cba-7b2cb07bff62 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/1bae7d999d904322aa22e76ac004ba16" status: 200 len: 371 microversion: 2.1 time: 0.590070 Jul 28 10:32:26.331638 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 262/479] 10.222.0.46 () {58 vars in 1242 bytes} [Thu Jul 28 10:32:25 2022] GET /compute/v2.1/os-quota-sets/1bae7d999d904322aa22e76ac004ba16 => generated 371 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:26.331638 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8b226eb1-5b9e-44a1-a373-4f2d9003d2a6 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:26.332305 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-8b226eb1-5b9e-44a1-a373-4f2d9003d2a6 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] [instance: 1bf10c19-7f3f-4ef1-99bf-83fc47308b28] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:26.348467 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8b226eb1-5b9e-44a1-a373-4f2d9003d2a6 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:26.349100 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8b226eb1-5b9e-44a1-a373-4f2d9003d2a6 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:26.350177 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8b226eb1-5b9e-44a1-a373-4f2d9003d2a6 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:26.350778 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8b226eb1-5b9e-44a1-a373-4f2d9003d2a6 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:26.398464 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-6197ec8b-2310-4e92-bc6e-962d095027a1 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4dec286d7c45bba6614c14b733168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb90e03403f4c0a9d9de4902a0a7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:26.419485 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6197ec8b-2310-4e92-bc6e-962d095027a1 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] 10.222.0.46 "GET /compute/v2.1/servers/e98d4b6b-a8c4-4461-be6b-93d6a9a9915a" status: 200 len: 1288 microversion: 2.1 time: 0.297533 Jul 28 10:32:26.420411 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 218/480] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:26 2022] GET /compute/v2.1/servers/e98d4b6b-a8c4-4461-be6b-93d6a9a9915a => generated 1288 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:26.426332 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8b226eb1-5b9e-44a1-a373-4f2d9003d2a6 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:26.426800 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8b226eb1-5b9e-44a1-a373-4f2d9003d2a6 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:26.427270 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-8b226eb1-5b9e-44a1-a373-4f2d9003d2a6 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lazy-loading 'fault' on Instance uuid 1bf10c19-7f3f-4ef1-99bf-83fc47308b28 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:32:26.435197 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-24b4e6b3-320a-425a-8a47-ec0d8e37d953 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:26.436606 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-24b4e6b3-320a-425a-8a47-ec0d8e37d953 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3e5d3f71-0a17-4e98-9158-a92944492744] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:26.444281 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-24b4e6b3-320a-425a-8a47-ec0d8e37d953 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:26.444757 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-24b4e6b3-320a-425a-8a47-ec0d8e37d953 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:26.445583 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-24b4e6b3-320a-425a-8a47-ec0d8e37d953 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:26.446046 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-24b4e6b3-320a-425a-8a47-ec0d8e37d953 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:26.529740 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-24b4e6b3-320a-425a-8a47-ec0d8e37d953 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:26.540851 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-24b4e6b3-320a-425a-8a47-ec0d8e37d953 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:26.542805 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-24b4e6b3-320a-425a-8a47-ec0d8e37d953 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:26.544571 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-24b4e6b3-320a-425a-8a47-ec0d8e37d953 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] 10.222.0.46 "GET /compute/v2.1/servers/3e5d3f71-0a17-4e98-9158-a92944492744" status: 200 len: 1180 microversion: 2.25 time: 0.122372 Jul 28 10:32:26.545385 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 219/481] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:32:26 2022] GET /compute/v2.1/servers/3e5d3f71-0a17-4e98-9158-a92944492744 => generated 1180 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:32:26.562932 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c5c31007-997a-4721-8c55-8211ac0ad398 tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:26.567814 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-8b226eb1-5b9e-44a1-a373-4f2d9003d2a6 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa34881c00984288b5f9c29dba8d8885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a82c16499174675a06d390a1417fab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:26.573106 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c5c31007-997a-4721-8c55-8211ac0ad398 tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021959 Jul 28 10:32:26.574100 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 220/482] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 10:32:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:26.579457 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1a812a25-3593-4787-887e-787f8723573a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Calling method '.version_select at 0x7fa94bcf10d0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:26.586467 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-8b226eb1-5b9e-44a1-a373-4f2d9003d2a6 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] 10.222.0.46 "GET /compute/v2.1/servers/1bf10c19-7f3f-4ef1-99bf-83fc47308b28" status: 200 len: 1295 microversion: 2.1 time: 0.259916 Jul 28 10:32:26.601580 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 263/483] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:26 2022] GET /compute/v2.1/servers/1bf10c19-7f3f-4ef1-99bf-83fc47308b28 => generated 1295 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:26.608914 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4ab93ae9-c9cc-4316-a761-5e9d55facce5 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Action: 'update', calling method: .version_select at 0x7fa94bde2f70>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:26.635378 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-1a812a25-3593-4787-887e-787f8723573a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] 10.222.0.46 "GET /compute/v2.1/images/ad393c8a-f154-47a5-beb3-ce83eb79ec3a" status: 200 len: 662 microversion: 2.1 time: 0.059926 Jul 28 10:32:26.636817 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 221/484] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Jul 28 10:32:26 2022] GET /compute/v2.1/images/ad393c8a-f154-47a5-beb3-ce83eb79ec3a => generated 662 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:26.644117 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-fd399379-ba2e-456c-89cf-7f405635e07f tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:26.644824 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-fd399379-ba2e-456c-89cf-7f405635e07f tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] [instance: e98d4b6b-a8c4-4461-be6b-93d6a9a9915a] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:26.670979 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fd399379-ba2e-456c-89cf-7f405635e07f tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:26.671685 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fd399379-ba2e-456c-89cf-7f405635e07f tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:26.672627 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fd399379-ba2e-456c-89cf-7f405635e07f tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:26.673221 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fd399379-ba2e-456c-89cf-7f405635e07f tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:26.715606 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-fd399379-ba2e-456c-89cf-7f405635e07f tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] [instance: e98d4b6b-a8c4-4461-be6b-93d6a9a9915a] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:32:26.821144 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-fd399379-ba2e-456c-89cf-7f405635e07f tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] [instance: e98d4b6b-a8c4-4461-be6b-93d6a9a9915a] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:32:26.823089 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fd399379-ba2e-456c-89cf-7f405635e07f tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:26.824139 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fd399379-ba2e-456c-89cf-7f405635e07f tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:26.825474 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-fd399379-ba2e-456c-89cf-7f405635e07f tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] [instance: e98d4b6b-a8c4-4461-be6b-93d6a9a9915a] instance's host None is down, deleting from database Jul 28 10:32:26.832085 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-fd399379-ba2e-456c-89cf-7f405635e07f tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] [instance: e98d4b6b-a8c4-4461-be6b-93d6a9a9915a] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:32:26.889724 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-fd399379-ba2e-456c-89cf-7f405635e07f tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] [instance: e98d4b6b-a8c4-4461-be6b-93d6a9a9915a] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:32:26.897492 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-fd399379-ba2e-456c-89cf-7f405635e07f tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] [instance: e98d4b6b-a8c4-4461-be6b-93d6a9a9915a] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:32:26.909823 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=69 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:26.911407 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4ab93ae9-c9cc-4316-a761-5e9d55facce5 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:26.911859 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4ab93ae9-c9cc-4316-a761-5e9d55facce5 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:26.912662 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4ab93ae9-c9cc-4316-a761-5e9d55facce5 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:26.913098 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4ab93ae9-c9cc-4316-a761-5e9d55facce5 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:27.069779 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-4ab93ae9-c9cc-4316-a761-5e9d55facce5 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/1bae7d999d904322aa22e76ac004ba16" status: 200 len: 325 microversion: 2.1 time: 0.467010 Jul 28 10:32:27.071141 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 264/485] 10.222.0.46 () {60 vars in 1262 bytes} [Thu Jul 28 10:32:26 2022] PUT /compute/v2.1/os-quota-sets/1bae7d999d904322aa22e76ac004ba16 => generated 325 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:27.076585 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6047f445-1e2e-4657-bb0e-e9942f12bcf8 tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:27.120770 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-6047f445-1e2e-4657-bb0e-e9942f12bcf8 tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.048240 Jul 28 10:32:27.122268 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 265/486] 10.222.0.46 () {58 vars in 1169 bytes} [Thu Jul 28 10:32:27 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:27.137685 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-fd399379-ba2e-456c-89cf-7f405635e07f tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e98d4b6b-a8c4-4461-be6b-93d6a9a9915a" status: 204 len: 0 microversion: 2.1 time: 0.497416 Jul 28 10:32:27.140706 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 222/487] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:32:26 2022] DELETE /compute/v2.1/servers/e98d4b6b-a8c4-4461-be6b-93d6a9a9915a => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:32:27.151344 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f56fce54-793e-40f1-bd37-c7e09b360131 tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:27.153427 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-bf9c7e57-7960-44b1-83b2-1b54b4f81f34 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:27.155497 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-bf9c7e57-7960-44b1-83b2-1b54b4f81f34 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] [instance: e98d4b6b-a8c4-4461-be6b-93d6a9a9915a] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:27.182759 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bf9c7e57-7960-44b1-83b2-1b54b4f81f34 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:27.183225 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bf9c7e57-7960-44b1-83b2-1b54b4f81f34 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:27.184034 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bf9c7e57-7960-44b1-83b2-1b54b4f81f34 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:27.193884 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bf9c7e57-7960-44b1-83b2-1b54b4f81f34 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:27.194084 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f56fce54-793e-40f1-bd37-c7e09b360131 tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.055067 Jul 28 10:32:27.203719 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 266/488] 10.222.0.46 () {58 vars in 1161 bytes} [Thu Jul 28 10:32:27 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:27.211300 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c609e147-9a8a-40b9-82db-b7b4eca24601 tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:27.231398 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-bf9c7e57-7960-44b1-83b2-1b54b4f81f34 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] HTTP exception thrown: Instance e98d4b6b-a8c4-4461-be6b-93d6a9a9915a could not be found. Jul 28 10:32:27.232964 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-bf9c7e57-7960-44b1-83b2-1b54b4f81f34 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Request method failure captured: Jul 28 10:32:27.232964 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/e98d4b6b-a8c4-4461-be6b-93d6a9a9915a HTTP/1.1 Jul 28 10:32:27.232964 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:32:27.232964 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:32:27.232964 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:32:27.232964 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:32:27.232964 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:32:27.232964 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:32:27.232964 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:32:27.232964 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:27.232964 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mW0qLLgwgsUJTa8bbhkcrgYT7NeDQhx2LDUaBrwtcLFgXcpTopMPJXXyQfAlOTmXxOPHm_ZAp8X-LaIIzZj6CoK9qycQfdIxAusI7d_R_uiUxE6uC7NssxpwD8tz6vaOCwQdCf5Gdrl1-AsL0z8SKc-EE5wVj0IN5rcKmZKdqDI6lA Jul 28 10:32:27.232964 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:32:27.232964 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:32:27.232964 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:32:27.232964 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:32:27.232964 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:32:27.232964 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:32:27.232964 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 5fb90e03403f4c0a9d9de4902a0a7ca9 Jul 28 10:32:27.232964 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ImagesNegativeTestJSON-1148644311 Jul 28 10:32:27.232964 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:32:27.232964 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:32:27.234549 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5fb90e03403f4c0a9d9de4902a0a7ca9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5fb90e03403f4c0a9d9de4902a0a7ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5fb90e03403f4c0a9d9de4902a0a7ca9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5fb90e03403f4c0a9d9de4902a0a7ca9", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:27.234549 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ImagesNegativeTestJSON-1148644311 Jul 28 10:32:27.234549 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 5fb90e03403f4c0a9d9de4902a0a7ca9 Jul 28 10:32:27.234549 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1148644311 Jul 28 10:32:27.234549 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ImagesNegativeTestJSON-1148644311-project Jul 28 10:32:27.234549 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:32:27.234549 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:32:27.234549 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: aa4dec286d7c45bba6614c14b733168a Jul 28 10:32:27.234549 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ImagesNegativeTestJSON-1148644311-project Jul 28 10:32:27.234549 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:32:27.234549 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance e98d4b6b-a8c4-4461-be6b-93d6a9a9915a could not be found. Jul 28 10:32:27.234549 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'e98d4b6b-a8c4-4461-be6b-93d6a9a9915a'} Jul 28 10:32:27.235429 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:27.235429 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:27.235429 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:32:27.235429 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:32:27.235429 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:32:27.235429 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:32:27.235429 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:32:27.235429 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:32:27.235429 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:32:27.235429 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:32:27.235429 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e98d4b6b-a8c4-4461-be6b-93d6a9a9915a could not be found. Jul 28 10:32:27.235429 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.235429 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:27.235429 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.235429 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:27.235429 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:27.235429 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:27.235429 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:27.235429 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:27.235429 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:27.236883 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:27.236883 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:32:27.236883 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:32:27.236883 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:32:27.236883 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:32:27.236883 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:32:27.236883 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:32:27.236883 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e98d4b6b-a8c4-4461-be6b-93d6a9a9915a could not be found. Jul 28 10:32:27.236883 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.236883 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:27.236883 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.236883 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:27.236883 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:27.236883 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:27.236883 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:27.236883 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:27.236883 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e98d4b6b-a8c4-4461-be6b-93d6a9a9915a could not be found. Jul 28 10:32:27.236883 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.239409 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c609e147-9a8a-40b9-82db-b7b4eca24601 tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024657 Jul 28 10:32:27.242742 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 267/489] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 10:32:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:27.260223 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-bf9c7e57-7960-44b1-83b2-1b54b4f81f34 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Returning 404 to user: Instance e98d4b6b-a8c4-4461-be6b-93d6a9a9915a could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:27.272279 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-bf9c7e57-7960-44b1-83b2-1b54b4f81f34 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] 10.222.0.46 "GET /compute/v2.1/servers/e98d4b6b-a8c4-4461-be6b-93d6a9a9915a" status: 404 len: 111 microversion: 2.1 time: 0.115196 Jul 28 10:32:27.274364 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 223/490] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:27 2022] GET /compute/v2.1/servers/e98d4b6b-a8c4-4461-be6b-93d6a9a9915a => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:32:27.286118 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e8f08ede-ad42-4670-94af-9cd3133b37de tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:27.293356 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3bff3842-af9d-4d14-a1fc-2afd6aab7e4c tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1376718002", "metadata": {"image_type": "test"}}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:27.295826 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3bff3842-af9d-4d14-a1fc-2afd6aab7e4c tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Failed to fetch instance by id tempest-invalid-1972870068 {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2929}} Jul 28 10:32:27.309308 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-3bff3842-af9d-4d14-a1fc-2afd6aab7e4c tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] HTTP exception thrown: Instance tempest-invalid-1972870068 could not be found. Jul 28 10:32:27.315309 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3bff3842-af9d-4d14-a1fc-2afd6aab7e4c tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Request method failure captured: Jul 28 10:32:27.315309 n-d-850468-6 devstack@n-api.service[119463]: request: POST /compute/v2.1/servers/tempest-invalid-1972870068/action HTTP/1.1 Jul 28 10:32:27.315309 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:32:27.315309 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:32:27.315309 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:32:27.315309 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 112 Jul 28 10:32:27.315309 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:32:27.315309 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:32:27.315309 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:32:27.315309 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:27.315309 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mW0qLLgwgsUJTa8bbhkcrgYT7NeDQhx2LDUaBrwtcLFgXcpTopMPJXXyQfAlOTmXxOPHm_ZAp8X-LaIIzZj6CoK9qycQfdIxAusI7d_R_uiUxE6uC7NssxpwD8tz6vaOCwQdCf5Gdrl1-AsL0z8SKc-EE5wVj0IN5rcKmZKdqDI6lA Jul 28 10:32:27.315309 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:32:27.315309 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:32:27.315309 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:32:27.315309 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:32:27.315309 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:32:27.315309 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:32:27.315309 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 5fb90e03403f4c0a9d9de4902a0a7ca9 Jul 28 10:32:27.315309 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ImagesNegativeTestJSON-1148644311 Jul 28 10:32:27.315309 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:32:27.315309 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:32:27.316968 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5fb90e03403f4c0a9d9de4902a0a7ca9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5fb90e03403f4c0a9d9de4902a0a7ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5fb90e03403f4c0a9d9de4902a0a7ca9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5fb90e03403f4c0a9d9de4902a0a7ca9", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:27.316968 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ImagesNegativeTestJSON-1148644311 Jul 28 10:32:27.316968 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 5fb90e03403f4c0a9d9de4902a0a7ca9 Jul 28 10:32:27.316968 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1148644311 Jul 28 10:32:27.316968 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ImagesNegativeTestJSON-1148644311-project Jul 28 10:32:27.316968 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:32:27.316968 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:32:27.316968 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: aa4dec286d7c45bba6614c14b733168a Jul 28 10:32:27.316968 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ImagesNegativeTestJSON-1148644311-project Jul 28 10:32:27.316968 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:32:27.316968 n-d-850468-6 devstack@n-api.service[119463]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1376718002", "metadata": {"image_type": "test"}}} Jul 28 10:32:27.316968 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:32:27.316968 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance tempest-invalid-1972870068 could not be found. Jul 28 10:32:27.318400 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'tempest-invalid-1972870068', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1376718002', 'metadata': {'image_type': 'test'}}}} Jul 28 10:32:27.318400 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:27.318400 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:27.318400 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:32:27.318400 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:32:27.318400 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2930, in get Jul 28 10:32:27.318400 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 28 10:32:27.318400 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1972870068 could not be found. Jul 28 10:32:27.318400 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.318400 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:27.318400 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.318400 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:27.318400 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:27.318400 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:27.318400 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:27.318400 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:27.318400 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:27.318400 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:27.318400 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:27.318400 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:27.322406 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:27.322406 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:27.322406 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 28 10:32:27.322406 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 28 10:32:27.322406 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:32:27.322406 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:32:27.322406 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:32:27.322406 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:32:27.322406 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1972870068 could not be found. Jul 28 10:32:27.322406 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.322406 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:27.322406 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.322406 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:27.322406 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:27.322406 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:27.322406 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:27.322406 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:27.322406 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1972870068 could not be found. Jul 28 10:32:27.322406 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.323741 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3bff3842-af9d-4d14-a1fc-2afd6aab7e4c tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Returning 404 to user: Instance tempest-invalid-1972870068 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:27.323741 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3bff3842-af9d-4d14-a1fc-2afd6aab7e4c tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] 10.222.0.46 "POST /compute/v2.1/servers/tempest-invalid-1972870068/action" status: 404 len: 101 microversion: 2.1 time: 0.035146 Jul 28 10:32:27.330762 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 224/491] 10.222.0.46 () {60 vars in 1249 bytes} [Thu Jul 28 10:32:27 2022] POST /compute/v2.1/servers/tempest-invalid-1972870068/action => generated 101 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:32:27.335704 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-63b1a584-b649-41f7-9b4c-e7572f168246 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1422229819", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:27.368867 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e8f08ede-ad42-4670-94af-9cd3133b37de tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.105917 Jul 28 10:32:27.369976 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 268/492] 10.222.0.46 () {58 vars in 1167 bytes} [Thu Jul 28 10:32:27 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:27.390563 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a5549f90-6c2d-4b25-af4c-8c02dfedfe77 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2063710360"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:27.393093 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a5549f90-6c2d-4b25-af4c-8c02dfedfe77 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2929}} Jul 28 10:32:27.393679 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-a5549f90-6c2d-4b25-af4c-8c02dfedfe77 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 10:32:27.395303 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a5549f90-6c2d-4b25-af4c-8c02dfedfe77 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Request method failure captured: Jul 28 10:32:27.395303 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 28 10:32:27.395303 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:32:27.395303 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:32:27.395303 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:32:27.395303 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 57 Jul 28 10:32:27.395303 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:32:27.395303 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:32:27.395303 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:32:27.395303 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:27.395303 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mW0qLLgwgsUJTa8bbhkcrgYT7NeDQhx2LDUaBrwtcLFgXcpTopMPJXXyQfAlOTmXxOPHm_ZAp8X-LaIIzZj6CoK9qycQfdIxAusI7d_R_uiUxE6uC7NssxpwD8tz6vaOCwQdCf5Gdrl1-AsL0z8SKc-EE5wVj0IN5rcKmZKdqDI6lA Jul 28 10:32:27.395303 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:32:27.395303 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:32:27.395303 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:32:27.395303 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:32:27.395303 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:32:27.395303 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:32:27.395303 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 5fb90e03403f4c0a9d9de4902a0a7ca9 Jul 28 10:32:27.395303 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ImagesNegativeTestJSON-1148644311 Jul 28 10:32:27.395303 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:32:27.395303 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:32:27.396547 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5fb90e03403f4c0a9d9de4902a0a7ca9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5fb90e03403f4c0a9d9de4902a0a7ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5fb90e03403f4c0a9d9de4902a0a7ca9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5fb90e03403f4c0a9d9de4902a0a7ca9", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:27.396547 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ImagesNegativeTestJSON-1148644311 Jul 28 10:32:27.396547 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 5fb90e03403f4c0a9d9de4902a0a7ca9 Jul 28 10:32:27.396547 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1148644311 Jul 28 10:32:27.396547 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ImagesNegativeTestJSON-1148644311-project Jul 28 10:32:27.396547 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:32:27.396547 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:32:27.396547 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: aa4dec286d7c45bba6614c14b733168a Jul 28 10:32:27.396547 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ImagesNegativeTestJSON-1148644311-project Jul 28 10:32:27.396547 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:32:27.396547 n-d-850468-6 devstack@n-api.service[119464]: {"createImage": {"name": "tempest-test-snap-2063710360"}} Jul 28 10:32:27.396547 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:32:27.396547 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 10:32:27.397364 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2063710360'}}} Jul 28 10:32:27.397364 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:27.397364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:27.397364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:32:27.397364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:32:27.397364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2930, in get Jul 28 10:32:27.397364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 28 10:32:27.397364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 10:32:27.397364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.397364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:27.397364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.397364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:27.397364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:27.397364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:27.397364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:27.397364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:27.397364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:27.397364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:27.397364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:27.397364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:27.398544 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:27.398544 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:27.398544 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 28 10:32:27.398544 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 28 10:32:27.398544 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:32:27.398544 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:32:27.398544 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:32:27.398544 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:32:27.398544 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 10:32:27.398544 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.398544 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:27.398544 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.398544 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:27.398544 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:27.398544 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:27.398544 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:27.398544 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:27.398544 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 10:32:27.398544 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.399655 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a5549f90-6c2d-4b25-af4c-8c02dfedfe77 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:27.401448 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a5549f90-6c2d-4b25-af4c-8c02dfedfe77 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] 10.222.0.46 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.025943 Jul 28 10:32:27.416733 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 269/493] 10.222.0.46 () {60 vars in 1275 bytes} [Thu Jul 28 10:32:27 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:32:27.427648 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f1fa81fc-d1f7-444e-a2e9-866165a584cd tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:27.438001 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-63b1a584-b649-41f7-9b4c-e7572f168246 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] validate_networks() for None {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:32:27.440025 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f1fa81fc-d1f7-444e-a2e9-866165a584cd tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019522 Jul 28 10:32:27.440758 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 270/494] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 10:32:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:27.456464 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-437be02c-6889-4508-a8e3-891d2ac91b87 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-290609496"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:27.459809 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-437be02c-6889-4508-a8e3-891d2ac91b87 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2929}} Jul 28 10:32:27.460496 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-437be02c-6889-4508-a8e3-891d2ac91b87 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 10:32:27.462264 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-437be02c-6889-4508-a8e3-891d2ac91b87 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Request method failure captured: Jul 28 10:32:27.462264 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 28 10:32:27.462264 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:32:27.462264 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:32:27.462264 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:32:27.462264 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 56 Jul 28 10:32:27.462264 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:32:27.462264 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:32:27.462264 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:32:27.462264 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:27.462264 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mW0qLLgwgsUJTa8bbhkcrgYT7NeDQhx2LDUaBrwtcLFgXcpTopMPJXXyQfAlOTmXxOPHm_ZAp8X-LaIIzZj6CoK9qycQfdIxAusI7d_R_uiUxE6uC7NssxpwD8tz6vaOCwQdCf5Gdrl1-AsL0z8SKc-EE5wVj0IN5rcKmZKdqDI6lA Jul 28 10:32:27.462264 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:32:27.462264 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:32:27.462264 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:32:27.462264 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:32:27.462264 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:32:27.462264 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:32:27.462264 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 5fb90e03403f4c0a9d9de4902a0a7ca9 Jul 28 10:32:27.462264 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ImagesNegativeTestJSON-1148644311 Jul 28 10:32:27.462264 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:32:27.462264 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:32:27.463608 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5fb90e03403f4c0a9d9de4902a0a7ca9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5fb90e03403f4c0a9d9de4902a0a7ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5fb90e03403f4c0a9d9de4902a0a7ca9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5fb90e03403f4c0a9d9de4902a0a7ca9", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:27.463608 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ImagesNegativeTestJSON-1148644311 Jul 28 10:32:27.463608 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 5fb90e03403f4c0a9d9de4902a0a7ca9 Jul 28 10:32:27.463608 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1148644311 Jul 28 10:32:27.463608 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ImagesNegativeTestJSON-1148644311-project Jul 28 10:32:27.463608 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:32:27.463608 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:32:27.463608 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: aa4dec286d7c45bba6614c14b733168a Jul 28 10:32:27.463608 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ImagesNegativeTestJSON-1148644311-project Jul 28 10:32:27.463608 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:32:27.463608 n-d-850468-6 devstack@n-api.service[119464]: {"createImage": {"name": "tempest-test-snap-290609496"}} Jul 28 10:32:27.463608 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:32:27.463608 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 10:32:27.464486 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-290609496'}}} Jul 28 10:32:27.464486 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:27.464486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:27.464486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:32:27.464486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:32:27.464486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2930, in get Jul 28 10:32:27.464486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 28 10:32:27.464486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 10:32:27.464486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.464486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:27.464486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.464486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:27.464486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:27.464486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:27.464486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:27.464486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:27.464486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:27.464486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:27.464486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:27.464486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:27.465894 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:27.465894 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:27.465894 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 28 10:32:27.465894 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 28 10:32:27.465894 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:32:27.465894 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:32:27.465894 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:32:27.465894 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:32:27.465894 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 10:32:27.465894 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.465894 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:27.465894 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.465894 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:27.465894 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:27.465894 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:27.465894 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:27.465894 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:27.465894 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 10:32:27.465894 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.469549 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-437be02c-6889-4508-a8e3-891d2ac91b87 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:27.471703 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-437be02c-6889-4508-a8e3-891d2ac91b87 tempest-ImagesNegativeTestJSON-1148644311 tempest-ImagesNegativeTestJSON-1148644311-project] 10.222.0.46 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.028870 Jul 28 10:32:27.476834 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 271/495] 10.222.0.46 () {60 vars in 1281 bytes} [Thu Jul 28 10:32:27 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:32:27.483157 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-972268e8-4d70-4280-9072-ffe78078f5a4 tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:27.521820 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-972268e8-4d70-4280-9072-ffe78078f5a4 tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] 10.222.0.46 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.042911 Jul 28 10:32:27.522436 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 272/496] 10.222.0.46 () {58 vars in 1144 bytes} [Thu Jul 28 10:32:27 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:27.543578 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-65cbabfd-862a-424d-af22-b66bcdd9e3ae tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:27.554190 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-65cbabfd-862a-424d-af22-b66bcdd9e3ae tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017390 Jul 28 10:32:27.554998 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 273/497] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 10:32:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:32:27.568220 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-415f7c96-d9c5-4f83-a674-d92cd18faf04 tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:27.587308 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-415f7c96-d9c5-4f83-a674-d92cd18faf04 tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] 10.222.0.46 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.024072 Jul 28 10:32:27.591578 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 274/498] 10.222.0.46 () {58 vars in 1148 bytes} [Thu Jul 28 10:32:27 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:32:27.603917 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d16f9e57-8e13-41ea-8dbb-cfde28d68e94 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:27.604835 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-d16f9e57-8e13-41ea-8dbb-cfde28d68e94 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3e5d3f71-0a17-4e98-9158-a92944492744] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:27.614042 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d16f9e57-8e13-41ea-8dbb-cfde28d68e94 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:27.614759 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d16f9e57-8e13-41ea-8dbb-cfde28d68e94 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:27.615883 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d16f9e57-8e13-41ea-8dbb-cfde28d68e94 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:27.616467 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d16f9e57-8e13-41ea-8dbb-cfde28d68e94 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:27.667747 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d16f9e57-8e13-41ea-8dbb-cfde28d68e94 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:27.668464 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d16f9e57-8e13-41ea-8dbb-cfde28d68e94 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:27.669116 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-d16f9e57-8e13-41ea-8dbb-cfde28d68e94 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lazy-loading 'fault' on Instance uuid 3e5d3f71-0a17-4e98-9158-a92944492744 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:32:27.709427 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-63b1a584-b649-41f7-9b4c-e7572f168246 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:32:27.709841 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-63b1a584-b649-41f7-9b4c-e7572f168246 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:32:27.710347 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-63b1a584-b649-41f7-9b4c-e7572f168246 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:32:27.710759 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-63b1a584-b649-41f7-9b4c-e7572f168246 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:32:27.711205 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-63b1a584-b649-41f7-9b4c-e7572f168246 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:32:27.719337 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=72,nova_cell0:UPDATE=7 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:27.724283 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-63b1a584-b649-41f7-9b4c-e7572f168246 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:27.724734 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-63b1a584-b649-41f7-9b4c-e7572f168246 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:27.725707 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-63b1a584-b649-41f7-9b4c-e7572f168246 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:27.726176 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-63b1a584-b649-41f7-9b4c-e7572f168246 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:27.734818 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=59 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:27.748470 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-63b1a584-b649-41f7-9b4c-e7572f168246 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Getting quotas for project 1bae7d999d904322aa22e76ac004ba16. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:27.753565 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-d16f9e57-8e13-41ea-8dbb-cfde28d68e94 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:27.757103 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=67,nova_cell0:UPDATE=27,nova_cell0:DELETE=4,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:27.765234 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-d16f9e57-8e13-41ea-8dbb-cfde28d68e94 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:27.766771 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-d16f9e57-8e13-41ea-8dbb-cfde28d68e94 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a46f399714c4124a253c57a26f77a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e2042b56704e9fb5195d43d8116494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:27.768293 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-d16f9e57-8e13-41ea-8dbb-cfde28d68e94 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] 10.222.0.46 "GET /compute/v2.1/servers/3e5d3f71-0a17-4e98-9158-a92944492744" status: 200 len: 1253 microversion: 2.25 time: 0.174481 Jul 28 10:32:27.769397 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 275/499] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:32:27 2022] GET /compute/v2.1/servers/3e5d3f71-0a17-4e98-9158-a92944492744 => generated 1253 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:32:27.772722 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-63b1a584-b649-41f7-9b4c-e7572f168246 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Getting quotas for user 6a78ad5e1e4d49c98ec79d4551c6bdab and project 1bae7d999d904322aa22e76ac004ba16. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:27.774629 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-3ce160be-d890-4e72-b6c4-a953419181a3 tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:27.789926 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-3ce160be-d890-4e72-b6c4-a953419181a3 tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] 10.222.0.46 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.018609 Jul 28 10:32:27.800946 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 276/500] 10.222.0.46 () {58 vars in 1140 bytes} [Thu Jul 28 10:32:27 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:27.801751 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.utils [None req-63b1a584-b649-41f7-9b4c-e7572f168246 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] ram quota exceeded for 1bae7d999d904322aa22e76ac004ba16, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119463) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 28 10:32:27.802387 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-63b1a584-b649-41f7-9b4c-e7572f168246 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 28 10:32:27.805537 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-63b1a584-b649-41f7-9b4c-e7572f168246 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Request method failure captured: Jul 28 10:32:27.805537 n-d-850468-6 devstack@n-api.service[119463]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 10:32:27.805537 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:32:27.805537 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:32:27.805537 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:32:27.805537 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 145 Jul 28 10:32:27.805537 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:32:27.805537 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:32:27.805537 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:32:27.805537 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:27.805537 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mWqxNitjSEj2v-lHc_VPpBBXVyqX_oMtGzjr8orWAk7bA-kfPJhOO96-6AqFA4ZZnHy4bCVYeYlnQmfUfIY-TOx1V8rX3PzqMFs8lq01KwIKSwKnaTnF4R3u5Lw4pHYVw14YyJU1_DsinrmKF-tvMTkaKlmLnwuJqMSEgSlkW7-Fjg Jul 28 10:32:27.805537 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:32:27.805537 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:32:27.805537 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:32:27.805537 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:32:27.805537 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:32:27.805537 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:32:27.805537 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 1bae7d999d904322aa22e76ac004ba16 Jul 28 10:32:27.805537 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-QuotasAdminNegativeTest-1501188797 Jul 28 10:32:27.805537 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:32:27.805537 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:32:27.807129 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1bae7d999d904322aa22e76ac004ba16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1bae7d999d904322aa22e76ac004ba16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1bae7d999d904322aa22e76ac004ba16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1bae7d999d904322aa22e76ac004ba16", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:27.807129 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-QuotasAdminNegativeTest-1501188797 Jul 28 10:32:27.807129 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 1bae7d999d904322aa22e76ac004ba16 Jul 28 10:32:27.807129 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1501188797 Jul 28 10:32:27.807129 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-QuotasAdminNegativeTest-1501188797-project Jul 28 10:32:27.807129 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:32:27.807129 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:32:27.807129 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 6a78ad5e1e4d49c98ec79d4551c6bdab Jul 28 10:32:27.807129 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-QuotasAdminNegativeTest-1501188797-project Jul 28 10:32:27.807129 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:32:27.807129 n-d-850468-6 devstack@n-api.service[119463]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1422229819", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} Jul 28 10:32:27.807129 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:32:27.807946 n-d-850468-6 devstack@n-api.service[119463]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 28 10:32:27.807946 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1422229819', 'imageRef': 'eff4a889-87b7-4a4c-be7a-77433dc25faf', 'flavorRef': '452'}}} Jul 28 10:32:27.807946 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:27.807946 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:27.807946 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 28 10:32:27.807946 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 28 10:32:27.807946 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:32:27.807946 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:32:27.807946 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 28 10:32:27.807946 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc Jul 28 10:32:27.807946 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 28 10:32:27.807946 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 28 10:32:27.807946 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:32:27.807946 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:32:27.807946 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 28 10:32:27.807946 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 28 10:32:27.807946 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 28 10:32:27.807946 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 28 10:32:27.809219 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 28 10:32:27.809219 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 28 10:32:27.809219 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 28 10:32:27.809219 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.809219 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:27.809219 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.809219 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:27.809219 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 28 10:32:27.809219 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 28 10:32:27.809219 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2152, in create Jul 28 10:32:27.809219 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 28 10:32:27.809219 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1679, in _create_instance Jul 28 10:32:27.809219 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 28 10:32:27.809219 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1351, in _provision_instances Jul 28 10:32:27.809219 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 28 10:32:27.809219 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 28 10:32:27.809219 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 28 10:32:27.809219 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 28 10:32:27.809219 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.809219 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:27.809219 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.811261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:27.811261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:27.811261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:27.811261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:27.811261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:27.811261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:27.811261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:27.811261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:27.811261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:27.811261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:27.811261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:27.811261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:27.811261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:27.811261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 10:32:27.811261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 28 10:32:27.811261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 28 10:32:27.811261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 28 10:32:27.811261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.811261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:27.811261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.811261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:27.812670 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:27.812670 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:27.812670 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:27.812670 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:27.812670 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 28 10:32:27.812670 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:27.814705 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-58a697e5-109c-470d-a4af-7c937975a086 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:27.815493 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-58a697e5-109c-470d-a4af-7c937975a086 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] [instance: 1bf10c19-7f3f-4ef1-99bf-83fc47308b28] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:27.818507 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-63b1a584-b649-41f7-9b4c-e7572f168246 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:27.821364 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-63b1a584-b649-41f7-9b4c-e7572f168246 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.487571 Jul 28 10:32:27.823582 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-58a697e5-109c-470d-a4af-7c937975a086 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:27.824218 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-58a697e5-109c-470d-a4af-7c937975a086 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:27.825565 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-58a697e5-109c-470d-a4af-7c937975a086 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:27.826235 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-58a697e5-109c-470d-a4af-7c937975a086 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:27.831936 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 225/501] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:32:27 2022] POST /compute/v2.1/servers => generated 110 bytes in 500 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:32:27.867485 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-58a697e5-109c-470d-a4af-7c937975a086 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:27.868311 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-58a697e5-109c-470d-a4af-7c937975a086 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:27.869053 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-58a697e5-109c-470d-a4af-7c937975a086 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lazy-loading 'fault' on Instance uuid 1bf10c19-7f3f-4ef1-99bf-83fc47308b28 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:32:27.873389 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5e05a7fe-6acf-414e-bcad-bae9e479e808 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:27.873968 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-5e05a7fe-6acf-414e-bcad-bae9e479e808 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3e5d3f71-0a17-4e98-9158-a92944492744] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:27.887880 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5e05a7fe-6acf-414e-bcad-bae9e479e808 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:27.888342 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5e05a7fe-6acf-414e-bcad-bae9e479e808 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:27.889761 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5e05a7fe-6acf-414e-bcad-bae9e479e808 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:27.890235 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5e05a7fe-6acf-414e-bcad-bae9e479e808 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:27.928261 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-5e05a7fe-6acf-414e-bcad-bae9e479e808 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3e5d3f71-0a17-4e98-9158-a92944492744] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:32:27.999921 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-5e05a7fe-6acf-414e-bcad-bae9e479e808 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3e5d3f71-0a17-4e98-9158-a92944492744] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:32:28.000744 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5e05a7fe-6acf-414e-bcad-bae9e479e808 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:28.001236 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5e05a7fe-6acf-414e-bcad-bae9e479e808 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:28.002388 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-5e05a7fe-6acf-414e-bcad-bae9e479e808 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3e5d3f71-0a17-4e98-9158-a92944492744] instance's host None is down, deleting from database Jul 28 10:32:28.006587 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-5e05a7fe-6acf-414e-bcad-bae9e479e808 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3e5d3f71-0a17-4e98-9158-a92944492744] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:32:28.068299 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-5e05a7fe-6acf-414e-bcad-bae9e479e808 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3e5d3f71-0a17-4e98-9158-a92944492744] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:32:28.083579 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-5e05a7fe-6acf-414e-bcad-bae9e479e808 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3e5d3f71-0a17-4e98-9158-a92944492744] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:32:28.151789 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-58a697e5-109c-470d-a4af-7c937975a086 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa34881c00984288b5f9c29dba8d8885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a82c16499174675a06d390a1417fab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:28.162496 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-58a697e5-109c-470d-a4af-7c937975a086 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] 10.222.0.46 "GET /compute/v2.1/servers/1bf10c19-7f3f-4ef1-99bf-83fc47308b28" status: 200 len: 1295 microversion: 2.1 time: 0.359893 Jul 28 10:32:28.166912 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 277/502] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:27 2022] GET /compute/v2.1/servers/1bf10c19-7f3f-4ef1-99bf-83fc47308b28 => generated 1295 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:28.182686 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ee47e082-1c7a-4c42-9331-66ffbcea3a5e tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:28.207553 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ee47e082-1c7a-4c42-9331-66ffbcea3a5e tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038911 Jul 28 10:32:28.208547 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 278/503] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 10:32:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:28.220910 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ff58ff21-649b-484e-8c84-2cd42387f040 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Action: 'update', calling method: .version_select at 0x7fa94bde2f70>, body: {"quota_set": {"ram": 51200}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:28.307375 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:28.323696 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ff58ff21-649b-484e-8c84-2cd42387f040 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:28.324259 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ff58ff21-649b-484e-8c84-2cd42387f040 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:28.333301 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ff58ff21-649b-484e-8c84-2cd42387f040 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:28.334175 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ff58ff21-649b-484e-8c84-2cd42387f040 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:28.477164 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ff58ff21-649b-484e-8c84-2cd42387f040 tempest-QuotasAdminNegativeTest-1220606905 tempest-QuotasAdminNegativeTest-1220606905-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/1bae7d999d904322aa22e76ac004ba16" status: 200 len: 329 microversion: 2.1 time: 0.260484 Jul 28 10:32:28.488253 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 279/504] 10.222.0.46 () {60 vars in 1262 bytes} [Thu Jul 28 10:32:28 2022] PUT /compute/v2.1/os-quota-sets/1bae7d999d904322aa22e76ac004ba16 => generated 329 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:28.497197 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0683dad3-649e-4d3e-b945-65eb1b0d1a29 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:28.499167 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0683dad3-649e-4d3e-b945-65eb1b0d1a29 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] [instance: 1bf10c19-7f3f-4ef1-99bf-83fc47308b28] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:28.523352 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0683dad3-649e-4d3e-b945-65eb1b0d1a29 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:28.523730 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0683dad3-649e-4d3e-b945-65eb1b0d1a29 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:28.524540 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0683dad3-649e-4d3e-b945-65eb1b0d1a29 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:28.524974 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0683dad3-649e-4d3e-b945-65eb1b0d1a29 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:28.562481 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=76,nova_cell0:UPDATE=18,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:28.563524 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0683dad3-649e-4d3e-b945-65eb1b0d1a29 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] [instance: 1bf10c19-7f3f-4ef1-99bf-83fc47308b28] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:32:28.640567 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0683dad3-649e-4d3e-b945-65eb1b0d1a29 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] [instance: 1bf10c19-7f3f-4ef1-99bf-83fc47308b28] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:32:28.641703 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0683dad3-649e-4d3e-b945-65eb1b0d1a29 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:28.643225 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0683dad3-649e-4d3e-b945-65eb1b0d1a29 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:28.644357 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-0683dad3-649e-4d3e-b945-65eb1b0d1a29 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] [instance: 1bf10c19-7f3f-4ef1-99bf-83fc47308b28] instance's host None is down, deleting from database Jul 28 10:32:28.652961 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0683dad3-649e-4d3e-b945-65eb1b0d1a29 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] [instance: 1bf10c19-7f3f-4ef1-99bf-83fc47308b28] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:32:28.784015 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-5e05a7fe-6acf-414e-bcad-bae9e479e808 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3e5d3f71-0a17-4e98-9158-a92944492744" status: 204 len: 0 microversion: 2.25 time: 0.935326 Jul 28 10:32:28.788303 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 226/505] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:32:27 2022] DELETE /compute/v2.1/servers/3e5d3f71-0a17-4e98-9158-a92944492744 => generated 0 bytes in 952 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:32:28.793268 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f7fa0e68-a5ca-40c8-9956-301381bd105c tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:28.837980 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f7fa0e68-a5ca-40c8-9956-301381bd105c tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] 10.222.0.46 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.048027 Jul 28 10:32:28.839038 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 227/506] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:32:28 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:28.851944 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1da41953-7f53-4ec6-b20f-4f5360489113 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Action: 'update', calling method: .version_select at 0x7fa94bcdfc10>, body: {"quota_set": {"ram": 0}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:28.859992 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-1da41953-7f53-4ec6-b20f-4f5360489113 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '6a78ad5e1e4d49c98ec79d4551c6bdab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae7d999d904322aa22e76ac004ba16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:28.862098 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1da41953-7f53-4ec6-b20f-4f5360489113 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Request method failure captured: Jul 28 10:32:28.862098 n-d-850468-6 devstack@n-api.service[119463]: request: PUT /compute/v2.1/os-quota-sets/1bae7d999d904322aa22e76ac004ba16 HTTP/1.1 Jul 28 10:32:28.862098 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:32:28.862098 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:32:28.862098 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:32:28.862098 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 25 Jul 28 10:32:28.862098 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:32:28.862098 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:32:28.862098 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:32:28.862098 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:28.862098 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mWqxNitjSEj2v-lHc_VPpBBXVyqX_oMtGzjr8orWAk7bA-kfPJhOO96-6AqFA4ZZnHy4bCVYeYlnQmfUfIY-TOx1V8rX3PzqMFs8lq01KwIKSwKnaTnF4R3u5Lw4pHYVw14YyJU1_DsinrmKF-tvMTkaKlmLnwuJqMSEgSlkW7-Fjg Jul 28 10:32:28.862098 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:32:28.862098 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:32:28.862098 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:32:28.862098 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:32:28.862098 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:32:28.862098 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:32:28.862098 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 1bae7d999d904322aa22e76ac004ba16 Jul 28 10:32:28.862098 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-QuotasAdminNegativeTest-1501188797 Jul 28 10:32:28.862098 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:32:28.862098 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:32:28.863570 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1bae7d999d904322aa22e76ac004ba16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1bae7d999d904322aa22e76ac004ba16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1bae7d999d904322aa22e76ac004ba16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1bae7d999d904322aa22e76ac004ba16", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:28.863570 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-QuotasAdminNegativeTest-1501188797 Jul 28 10:32:28.863570 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 1bae7d999d904322aa22e76ac004ba16 Jul 28 10:32:28.863570 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1501188797 Jul 28 10:32:28.863570 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-QuotasAdminNegativeTest-1501188797-project Jul 28 10:32:28.863570 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:32:28.863570 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:32:28.863570 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 6a78ad5e1e4d49c98ec79d4551c6bdab Jul 28 10:32:28.863570 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-QuotasAdminNegativeTest-1501188797-project Jul 28 10:32:28.863570 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:32:28.863570 n-d-850468-6 devstack@n-api.service[119463]: {"quota_set": {"ram": 0}} Jul 28 10:32:28.863570 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:32:28.863570 n-d-850468-6 devstack@n-api.service[119463]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 28 10:32:28.863570 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '1bae7d999d904322aa22e76ac004ba16', 'body': {'quota_set': {'ram': 0}}} Jul 28 10:32:28.864431 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:28.864431 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:28.864431 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:28.864431 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:28.864431 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:28.864431 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:28.864431 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:32:28.864431 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:32:28.864431 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:28.864431 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:28.864431 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:28.864431 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:28.864431 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 28 10:32:28.864431 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 28 10:32:28.864431 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 10:32:28.864431 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:28.864431 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 10:32:28.864431 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:28.864431 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 28 10:32:28.865729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 28 10:32:28.865729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:32:28.865729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:32:28.865729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:32:28.865729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:32:28.865729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:32:28.865729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:32:28.865729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:32:28.865729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:32:28.865729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:32:28.865729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:32:28.865729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:32:28.865729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:32:28.865729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:32:28.865729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:32:28.865729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 28 10:32:28.865729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:28.865729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:28.865729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:28.865729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:28.866871 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:28.866871 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:28.866871 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:32:28.866871 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:32:28.866871 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 28 10:32:28.866871 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:28.866871 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1da41953-7f53-4ec6-b20f-4f5360489113 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:28.866871 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-1da41953-7f53-4ec6-b20f-4f5360489113 tempest-QuotasAdminNegativeTest-1501188797 tempest-QuotasAdminNegativeTest-1501188797-project] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/1bae7d999d904322aa22e76ac004ba16" status: 403 len: 116 microversion: 2.1 time: 0.023115 Jul 28 10:32:28.866871 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 228/507] 10.222.0.46 () {60 vars in 1262 bytes} [Thu Jul 28 10:32:28 2022] PUT /compute/v2.1/os-quota-sets/1bae7d999d904322aa22e76ac004ba16 => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:32:28.869835 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8169bf08-2908-4daf-8b0f-8e0740d80164 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Calling method '.version_select at 0x7fa94bce8550>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:28.922906 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-8169bf08-2908-4daf-8b0f-8e0740d80164 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] 10.222.0.46 "GET /compute/v2.1/images/10a0ace6-49a4-47c6-a419-cc25f8d2381c" status: 200 len: 661 microversion: 2.1 time: 0.057562 Jul 28 10:32:28.924733 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 229/508] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Jul 28 10:32:28 2022] GET /compute/v2.1/images/10a0ace6-49a4-47c6-a419-cc25f8d2381c => generated 661 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:28.931441 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-06d1f127-0da6-4a8c-8dbf-603178180fb4 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:28.933703 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-06d1f127-0da6-4a8c-8dbf-603178180fb4 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] [instance: 3e5d3f71-0a17-4e98-9158-a92944492744] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:28.941747 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-06d1f127-0da6-4a8c-8dbf-603178180fb4 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:28.942538 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-06d1f127-0da6-4a8c-8dbf-603178180fb4 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:28.943528 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-06d1f127-0da6-4a8c-8dbf-603178180fb4 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:28.944164 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-06d1f127-0da6-4a8c-8dbf-603178180fb4 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:28.959657 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-06d1f127-0da6-4a8c-8dbf-603178180fb4 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] HTTP exception thrown: Instance 3e5d3f71-0a17-4e98-9158-a92944492744 could not be found. Jul 28 10:32:28.961548 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-06d1f127-0da6-4a8c-8dbf-603178180fb4 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Request method failure captured: Jul 28 10:32:28.961548 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/3e5d3f71-0a17-4e98-9158-a92944492744 HTTP/1.1 Jul 28 10:32:28.961548 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:32:28.961548 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:32:28.961548 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:32:28.961548 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:32:28.961548 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:32:28.961548 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:32:28.961548 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:32:28.961548 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:28.961548 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mUsDviFxmY2HLnGTreQtLgTrjcwl5_NhXA8w3Wifn-1kTLdQ48tKyZ79DQ9rEyzANfG20a4jdfnSWv4KS8pqkIbvf6DmNC9lXwT2Ni0Wut_Q1LjpGOxZtZ60egcXO8jPUx_e7sWdhLEkb8L4vGtXp4V7Pb0IXhzCJLNSEOBzCN4Avg Jul 28 10:32:28.961548 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:32:28.961548 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:32:28.961548 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:32:28.961548 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:32:28.961548 n-d-850468-6 devstack@n-api.service[119463]: X-Openstack-Nova-Api-Version: 2.25 Jul 28 10:32:28.961548 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:32:28.961548 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:32:28.961548 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 07e2042b56704e9fb5195d43d8116494 Jul 28 10:32:28.961548 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-131348017 Jul 28 10:32:28.961548 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:32:28.961548 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:32:28.962901 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/07e2042b56704e9fb5195d43d8116494"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/07e2042b56704e9fb5195d43d8116494"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/07e2042b56704e9fb5195d43d8116494"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_07e2042b56704e9fb5195d43d8116494", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:28.962901 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-131348017 Jul 28 10:32:28.962901 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 07e2042b56704e9fb5195d43d8116494 Jul 28 10:32:28.962901 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-131348017 Jul 28 10:32:28.962901 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-LiveAutoBlockMigrationV225Test-131348017-project Jul 28 10:32:28.962901 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:32:28.962901 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:32:28.962901 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 5a46f399714c4124a253c57a26f77a0b Jul 28 10:32:28.962901 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-131348017-project Jul 28 10:32:28.962901 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:32:28.962901 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 3e5d3f71-0a17-4e98-9158-a92944492744 could not be found. Jul 28 10:32:28.962901 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '3e5d3f71-0a17-4e98-9158-a92944492744'} Jul 28 10:32:28.963600 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:28.963600 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:28.963600 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:32:28.963600 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:32:28.963600 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:32:28.963600 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:32:28.963600 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:32:28.963600 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:32:28.963600 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:32:28.963600 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:32:28.963600 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e5d3f71-0a17-4e98-9158-a92944492744 could not be found. Jul 28 10:32:28.963600 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:28.963600 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:28.963600 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:28.963600 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:28.963600 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:28.963600 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:28.963600 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:28.963600 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:28.963600 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:28.964724 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:28.964724 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:32:28.964724 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:32:28.964724 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:32:28.964724 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:32:28.964724 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:32:28.964724 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:32:28.964724 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e5d3f71-0a17-4e98-9158-a92944492744 could not be found. Jul 28 10:32:28.964724 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:28.964724 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:28.964724 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:28.964724 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:28.964724 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:28.964724 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:28.964724 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:28.964724 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:28.964724 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e5d3f71-0a17-4e98-9158-a92944492744 could not be found. Jul 28 10:32:28.964724 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:28.967466 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-06d1f127-0da6-4a8c-8dbf-603178180fb4 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Returning 404 to user: Instance 3e5d3f71-0a17-4e98-9158-a92944492744 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:28.968506 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-06d1f127-0da6-4a8c-8dbf-603178180fb4 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] 10.222.0.46 "GET /compute/v2.1/servers/3e5d3f71-0a17-4e98-9158-a92944492744" status: 404 len: 111 microversion: 2.25 time: 0.042655 Jul 28 10:32:28.974247 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 230/509] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:32:28 2022] GET /compute/v2.1/servers/3e5d3f71-0a17-4e98-9158-a92944492744 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:32:28.987676 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a142b169-73e2-46af-be85-b742a7d74048 tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:29.018732 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0683dad3-649e-4d3e-b945-65eb1b0d1a29 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] [instance: 1bf10c19-7f3f-4ef1-99bf-83fc47308b28] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:32:29.026461 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a142b169-73e2-46af-be85-b742a7d74048 tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049556 Jul 28 10:32:29.037850 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 231/510] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:32:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:29.037850 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ee3de24c-b3c4-4f01-ba2b-c9ed7fe5fbd3 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Calling method '.version_select at 0x7fa94bce8430>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:29.053182 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0683dad3-649e-4d3e-b945-65eb1b0d1a29 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] [instance: 1bf10c19-7f3f-4ef1-99bf-83fc47308b28] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:32:29.104470 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ee3de24c-b3c4-4f01-ba2b-c9ed7fe5fbd3 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] 10.222.0.46 "GET /compute/v2.1/images/10a0ace6-49a4-47c6-a419-cc25f8d2381c" status: 200 len: 661 microversion: 2.1 time: 0.075755 Jul 28 10:32:29.105054 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 232/511] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Jul 28 10:32:29 2022] GET /compute/v2.1/images/10a0ace6-49a4-47c6-a419-cc25f8d2381c => generated 661 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:29.134093 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-45c78739-1f26-4a38-bb83-1cab538fbba4 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] Calling method '.version_select at 0x7fa94bcf1820>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:29.217169 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-45c78739-1f26-4a38-bb83-1cab538fbba4 tempest-LiveAutoBlockMigrationV225Test-131348017 tempest-LiveAutoBlockMigrationV225Test-131348017-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1697056807" status: 204 len: 0 microversion: 2.25 time: 0.108743 Jul 28 10:32:29.219009 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 233/512] 10.222.0.46 () {60 vars in 1262 bytes} [Thu Jul 28 10:32:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1697056807 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:32:29.230010 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c06a7c8c-6321-43ef-b56d-701979b2af4e tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:29.264566 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c06a7c8c-6321-43ef-b56d-701979b2af4e tempest-FlavorsV2TestJSON-2083949394 tempest-FlavorsV2TestJSON-2083949394-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037233 Jul 28 10:32:29.271230 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 234/513] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 10:32:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:29.503385 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0683dad3-649e-4d3e-b945-65eb1b0d1a29 tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1bf10c19-7f3f-4ef1-99bf-83fc47308b28" status: 204 len: 0 microversion: 2.1 time: 1.013746 Jul 28 10:32:29.504261 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 280/514] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:32:28 2022] DELETE /compute/v2.1/servers/1bf10c19-7f3f-4ef1-99bf-83fc47308b28 => generated 0 bytes in 1015 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:32:29.512472 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f5a47b71-1242-43d8-856a-e07bff3bba7d tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:29.513089 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f5a47b71-1242-43d8-856a-e07bff3bba7d tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] [instance: 1bf10c19-7f3f-4ef1-99bf-83fc47308b28] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:29.523222 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f5a47b71-1242-43d8-856a-e07bff3bba7d tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:29.523679 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f5a47b71-1242-43d8-856a-e07bff3bba7d tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:29.524466 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f5a47b71-1242-43d8-856a-e07bff3bba7d tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:29.524902 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f5a47b71-1242-43d8-856a-e07bff3bba7d tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:29.578478 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-f5a47b71-1242-43d8-856a-e07bff3bba7d tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] HTTP exception thrown: Instance 1bf10c19-7f3f-4ef1-99bf-83fc47308b28 could not be found. Jul 28 10:32:29.580686 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f5a47b71-1242-43d8-856a-e07bff3bba7d tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Request method failure captured: Jul 28 10:32:29.580686 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/1bf10c19-7f3f-4ef1-99bf-83fc47308b28 HTTP/1.1 Jul 28 10:32:29.580686 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:32:29.580686 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:32:29.580686 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:32:29.580686 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:32:29.580686 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:32:29.580686 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:32:29.580686 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:32:29.580686 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:29.580686 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mW1c-I2ZDqa16C4hJZNwFdFTlHKLBmbYPILptAHia2yZEHFCKpdw-N9AG7rz6jLNcF6Itg8n7JQEAw5Ty99OXj17nvBQSiodfQX8J-lmETBHLDUxh6kACPL90EVyErudKSv4kaVu9FCuqU2tsAEUkG2TOPd01OQj6VGzmWPdoLCXPY Jul 28 10:32:29.580686 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:32:29.580686 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:32:29.580686 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:32:29.580686 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:32:29.580686 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:32:29.580686 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:32:29.580686 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 5a82c16499174675a06d390a1417fab3 Jul 28 10:32:29.580686 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1435654049 Jul 28 10:32:29.580686 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:32:29.580686 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:32:29.582187 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5a82c16499174675a06d390a1417fab3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5a82c16499174675a06d390a1417fab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5a82c16499174675a06d390a1417fab3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5a82c16499174675a06d390a1417fab3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:29.582187 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1435654049 Jul 28 10:32:29.582187 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 5a82c16499174675a06d390a1417fab3 Jul 28 10:32:29.582187 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1435654049 Jul 28 10:32:29.582187 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServerDiagnosticsNegativeTest-1435654049-project Jul 28 10:32:29.582187 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:32:29.582187 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:32:29.582187 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: fa34881c00984288b5f9c29dba8d8885 Jul 28 10:32:29.582187 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1435654049-project Jul 28 10:32:29.582187 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:32:29.582187 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 1bf10c19-7f3f-4ef1-99bf-83fc47308b28 could not be found. Jul 28 10:32:29.582187 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '1bf10c19-7f3f-4ef1-99bf-83fc47308b28'} Jul 28 10:32:29.582893 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:29.582893 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:29.582893 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:32:29.582893 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:32:29.582893 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:32:29.582893 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:32:29.582893 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:32:29.582893 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:32:29.582893 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:32:29.582893 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:32:29.582893 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bf10c19-7f3f-4ef1-99bf-83fc47308b28 could not be found. Jul 28 10:32:29.582893 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:29.582893 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:29.582893 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:29.582893 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:29.582893 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:29.582893 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:29.582893 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:29.582893 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:29.582893 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:29.584102 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:29.584102 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:32:29.584102 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:32:29.584102 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:32:29.584102 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:32:29.584102 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:32:29.584102 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:32:29.584102 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bf10c19-7f3f-4ef1-99bf-83fc47308b28 could not be found. Jul 28 10:32:29.584102 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:29.584102 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:29.584102 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:29.584102 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:29.584102 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:29.584102 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:29.584102 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:29.584102 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:29.584102 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bf10c19-7f3f-4ef1-99bf-83fc47308b28 could not be found. Jul 28 10:32:29.584102 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:29.585111 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f5a47b71-1242-43d8-856a-e07bff3bba7d tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] Returning 404 to user: Instance 1bf10c19-7f3f-4ef1-99bf-83fc47308b28 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:29.596883 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f5a47b71-1242-43d8-856a-e07bff3bba7d tempest-ServerDiagnosticsNegativeTest-1435654049 tempest-ServerDiagnosticsNegativeTest-1435654049-project] 10.222.0.46 "GET /compute/v2.1/servers/1bf10c19-7f3f-4ef1-99bf-83fc47308b28" status: 404 len: 111 microversion: 2.1 time: 0.073571 Jul 28 10:32:29.604392 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 235/515] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:29 2022] GET /compute/v2.1/servers/1bf10c19-7f3f-4ef1-99bf-83fc47308b28 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:32:31.208967 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1af8c203-a53d-47e5-b6f2-f9cbce6acd04 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Calling method '.version_select at 0x7fa94bde2550>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:31.276313 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1af8c203-a53d-47e5-b6f2-f9cbce6acd04 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] 10.222.0.46 "GET /compute/v2.1/images/3db7907e-f028-480e-b2ca-9db2ee58e79f" status: 200 len: 662 microversion: 2.1 time: 0.073526 Jul 28 10:32:31.283068 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 281/516] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Jul 28 10:32:31 2022] GET /compute/v2.1/images/3db7907e-f028-480e-b2ca-9db2ee58e79f => generated 662 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:32:31.295157 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-67253442-d6c3-43d7-acbb-54936f164442 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Calling method '.version_select at 0x7fa94bce8ee0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:31.361989 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-67253442-d6c3-43d7-acbb-54936f164442 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] 10.222.0.46 "GET /compute/v2.1/images/3db7907e-f028-480e-b2ca-9db2ee58e79f" status: 200 len: 662 microversion: 2.1 time: 0.070368 Jul 28 10:32:31.363190 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 236/517] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Jul 28 10:32:31 2022] GET /compute/v2.1/images/3db7907e-f028-480e-b2ca-9db2ee58e79f => generated 662 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:31.566300 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2114670069", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:31.659213 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] validate_networks() for None {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:32:33.729158 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:32:33.730260 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:32:33.730899 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:32:33.731502 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:32:33.732611 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:32:33.795266 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:33.797168 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:33.799866 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:33.801156 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:33.943370 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Getting quotas for project 839c8046ddb4420e9cc9759af8d9b13b. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:33.993316 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Getting quotas for user 2038700b25844d83926b00b4c31a9cec and project 839c8046ddb4420e9cc9759af8d9b13b. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:34.052038 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:32:34.057954 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: b721d299-a710-45f6-af51-82576b542be6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:32:34.192151 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-8eb8b0f7-c45e-42ed-8e47-4c9158448998 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.630205 Jul 28 10:32:34.200186 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 282/518] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:32:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:32:34.443805 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1915964325", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:34.541797 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] validate_networks() for None {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:32:35.647745 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:32:35.648857 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:32:35.649518 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:32:35.650119 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:32:35.650695 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:32:35.655828 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:35.664731 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:35.669523 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:35.678058 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:35.678854 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:35.743080 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Getting quotas for project 839c8046ddb4420e9cc9759af8d9b13b. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:35.751897 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Getting quotas for user 2038700b25844d83926b00b4c31a9cec and project 839c8046ddb4420e9cc9759af8d9b13b. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:35.826859 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:32:35.829617 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: 3d46db95-fecf-482c-837b-77ff7c339bff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:32:35.955674 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-7b4794d7-245e-4174-9cce-dc75da6b412a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.517898 Jul 28 10:32:35.961768 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 237/519] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:32:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:32:35.968100 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4ca55cb5-802a-4d83-b728-d8b9cba00180 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:35.968738 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-4ca55cb5-802a-4d83-b728-d8b9cba00180 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: 3d46db95-fecf-482c-837b-77ff7c339bff] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:36.432624 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-4ca55cb5-802a-4d83-b728-d8b9cba00180 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2038700b25844d83926b00b4c31a9cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c8046ddb4420e9cc9759af8d9b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:36.447719 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-4ca55cb5-802a-4d83-b728-d8b9cba00180 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] 10.222.0.46 "GET /compute/v2.1/servers/3d46db95-fecf-482c-837b-77ff7c339bff" status: 200 len: 1218 microversion: 2.1 time: 0.484107 Jul 28 10:32:36.448335 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 283/520] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:35 2022] GET /compute/v2.1/servers/3d46db95-fecf-482c-837b-77ff7c339bff => generated 1218 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:37.475569 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a18c463e-bb8f-41f5-99c0-8d2c2ed6293e tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:37.477008 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a18c463e-bb8f-41f5-99c0-8d2c2ed6293e tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: 3d46db95-fecf-482c-837b-77ff7c339bff] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:37.489023 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a18c463e-bb8f-41f5-99c0-8d2c2ed6293e tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:37.491808 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a18c463e-bb8f-41f5-99c0-8d2c2ed6293e tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:37.495121 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a18c463e-bb8f-41f5-99c0-8d2c2ed6293e tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:37.499511 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a18c463e-bb8f-41f5-99c0-8d2c2ed6293e tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:37.510571 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1329363451", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:37.636777 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] validate_networks() for None {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:32:37.667035 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a18c463e-bb8f-41f5-99c0-8d2c2ed6293e tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:37.670248 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a18c463e-bb8f-41f5-99c0-8d2c2ed6293e tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:37.670735 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-a18c463e-bb8f-41f5-99c0-8d2c2ed6293e tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lazy-loading 'fault' on Instance uuid 3d46db95-fecf-482c-837b-77ff7c339bff {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:32:37.926321 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-a18c463e-bb8f-41f5-99c0-8d2c2ed6293e tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2038700b25844d83926b00b4c31a9cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c8046ddb4420e9cc9759af8d9b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:37.939486 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a18c463e-bb8f-41f5-99c0-8d2c2ed6293e tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] 10.222.0.46 "GET /compute/v2.1/servers/3d46db95-fecf-482c-837b-77ff7c339bff" status: 200 len: 1291 microversion: 2.1 time: 0.467347 Jul 28 10:32:37.962676 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 284/521] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:37 2022] GET /compute/v2.1/servers/3d46db95-fecf-482c-837b-77ff7c339bff => generated 1291 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:37.988406 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-07b5b341-bff0-412f-91ec-203e73abdf4a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:37.989402 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-07b5b341-bff0-412f-91ec-203e73abdf4a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: 3d46db95-fecf-482c-837b-77ff7c339bff] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:38.011507 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-07b5b341-bff0-412f-91ec-203e73abdf4a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:38.012027 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-07b5b341-bff0-412f-91ec-203e73abdf4a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:38.014227 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-07b5b341-bff0-412f-91ec-203e73abdf4a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:38.017051 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-07b5b341-bff0-412f-91ec-203e73abdf4a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:38.101885 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-07b5b341-bff0-412f-91ec-203e73abdf4a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: 3d46db95-fecf-482c-837b-77ff7c339bff] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:32:38.239071 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-07b5b341-bff0-412f-91ec-203e73abdf4a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: 3d46db95-fecf-482c-837b-77ff7c339bff] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:32:38.244663 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-07b5b341-bff0-412f-91ec-203e73abdf4a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:38.246727 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-07b5b341-bff0-412f-91ec-203e73abdf4a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:38.248609 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-07b5b341-bff0-412f-91ec-203e73abdf4a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: 3d46db95-fecf-482c-837b-77ff7c339bff] instance's host None is down, deleting from database Jul 28 10:32:38.264040 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-07b5b341-bff0-412f-91ec-203e73abdf4a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: 3d46db95-fecf-482c-837b-77ff7c339bff] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:32:38.438225 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:32:38.441126 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:32:38.442147 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:32:38.442806 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:32:38.443547 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:32:38.476141 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:38.476488 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:38.480890 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:38.481350 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:38.513954 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-07b5b341-bff0-412f-91ec-203e73abdf4a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: 3d46db95-fecf-482c-837b-77ff7c339bff] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:32:38.523999 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-07b5b341-bff0-412f-91ec-203e73abdf4a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: 3d46db95-fecf-482c-837b-77ff7c339bff] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:32:38.567958 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Getting quotas for project 6b7dbda2a02546dbb8024325fffe55f5. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:38.583973 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Getting quotas for user 3330e8f935bf4f369bf0f4cfd1cbecb4 and project 6b7dbda2a02546dbb8024325fffe55f5. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:38.628490 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:32:38.655677 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] [instance: 4924fb6b-dd55-416f-989a-91b6fa8d47e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:32:38.838327 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ed8d4dab-a573-49db-bf13-65d553943009 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.972200 Jul 28 10:32:38.840265 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 238/522] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:32:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:32:38.855912 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3dffe3d5-2851-4667-910d-f1ee958974a7 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:38.857245 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3dffe3d5-2851-4667-910d-f1ee958974a7 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] [instance: 4924fb6b-dd55-416f-989a-91b6fa8d47e2] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:38.895599 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=69,nova_cell0:UPDATE=25,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:38.911536 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-07b5b341-bff0-412f-91ec-203e73abdf4a tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3d46db95-fecf-482c-837b-77ff7c339bff" status: 204 len: 0 microversion: 2.1 time: 0.944099 Jul 28 10:32:38.912165 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 285/523] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:32:37 2022] DELETE /compute/v2.1/servers/3d46db95-fecf-482c-837b-77ff7c339bff => generated 0 bytes in 949 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:32:38.922297 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c2f94091-8961-425a-8b59-fbb7f83996b2 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:38.928347 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c2f94091-8961-425a-8b59-fbb7f83996b2 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: 3d46db95-fecf-482c-837b-77ff7c339bff] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:38.946248 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2f94091-8961-425a-8b59-fbb7f83996b2 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:38.948570 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2f94091-8961-425a-8b59-fbb7f83996b2 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:38.950166 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2f94091-8961-425a-8b59-fbb7f83996b2 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:38.952176 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2f94091-8961-425a-8b59-fbb7f83996b2 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:39.003576 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-c2f94091-8961-425a-8b59-fbb7f83996b2 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] HTTP exception thrown: Instance 3d46db95-fecf-482c-837b-77ff7c339bff could not be found. Jul 28 10:32:39.005159 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c2f94091-8961-425a-8b59-fbb7f83996b2 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Request method failure captured: Jul 28 10:32:39.005159 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/3d46db95-fecf-482c-837b-77ff7c339bff HTTP/1.1 Jul 28 10:32:39.005159 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:32:39.005159 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:32:39.005159 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:32:39.005159 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:32:39.005159 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:32:39.005159 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:32:39.005159 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:32:39.005159 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:39.005159 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mW0FpDf28JHuELU2qHta2hkMxW3JfEUtdRdPg8560b8cIuKqWgD1ko-U3o97Ofh_BCvpD5LrHkq_o9OIx7PVxDx8Qk5T-r1PU-xu80K-BCU9KX3t2BNsXuwFLWWXJskhCfQoAd0k_1wc7pMRk88Yw9uLC4Tm8ewDE5ZvznpgbxrPn4 Jul 28 10:32:39.005159 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:32:39.005159 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:32:39.005159 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:32:39.005159 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:32:39.005159 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:32:39.005159 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:32:39.005159 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 839c8046ddb4420e9cc9759af8d9b13b Jul 28 10:32:39.005159 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ListImageFiltersTestJSON-306585994 Jul 28 10:32:39.005159 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:32:39.005159 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:32:39.006559 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/839c8046ddb4420e9cc9759af8d9b13b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/839c8046ddb4420e9cc9759af8d9b13b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/839c8046ddb4420e9cc9759af8d9b13b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_839c8046ddb4420e9cc9759af8d9b13b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:39.006559 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ListImageFiltersTestJSON-306585994 Jul 28 10:32:39.006559 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 839c8046ddb4420e9cc9759af8d9b13b Jul 28 10:32:39.006559 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-306585994 Jul 28 10:32:39.006559 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ListImageFiltersTestJSON-306585994-project Jul 28 10:32:39.006559 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:32:39.006559 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:32:39.006559 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 2038700b25844d83926b00b4c31a9cec Jul 28 10:32:39.006559 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ListImageFiltersTestJSON-306585994-project Jul 28 10:32:39.006559 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:32:39.006559 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 3d46db95-fecf-482c-837b-77ff7c339bff could not be found. Jul 28 10:32:39.006559 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '3d46db95-fecf-482c-837b-77ff7c339bff'} Jul 28 10:32:39.007329 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:39.007329 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:39.007329 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:32:39.007329 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:32:39.007329 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:32:39.007329 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:32:39.007329 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:32:39.007329 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:32:39.007329 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:32:39.007329 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:32:39.007329 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d46db95-fecf-482c-837b-77ff7c339bff could not be found. Jul 28 10:32:39.007329 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:39.007329 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:39.007329 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:39.007329 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:39.007329 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:39.007329 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:39.007329 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:39.007329 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:39.007329 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:39.008505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:39.008505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:32:39.008505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:32:39.008505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:32:39.008505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:32:39.008505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:32:39.008505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:32:39.008505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d46db95-fecf-482c-837b-77ff7c339bff could not be found. Jul 28 10:32:39.008505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:39.008505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:39.008505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:39.008505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:39.008505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:39.008505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:39.008505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:39.008505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:39.008505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d46db95-fecf-482c-837b-77ff7c339bff could not be found. Jul 28 10:32:39.008505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:39.011664 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c2f94091-8961-425a-8b59-fbb7f83996b2 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Returning 404 to user: Instance 3d46db95-fecf-482c-837b-77ff7c339bff could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:39.019951 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c2f94091-8961-425a-8b59-fbb7f83996b2 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] 10.222.0.46 "GET /compute/v2.1/servers/3d46db95-fecf-482c-837b-77ff7c339bff" status: 404 len: 111 microversion: 2.1 time: 0.099641 Jul 28 10:32:39.023868 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 286/524] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:38 2022] GET /compute/v2.1/servers/3d46db95-fecf-482c-837b-77ff7c339bff => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:32:39.037447 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-87aac13e-572b-4da2-9ae2-2e6157198ad9 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:39.041222 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-87aac13e-572b-4da2-9ae2-2e6157198ad9 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: b721d299-a710-45f6-af51-82576b542be6] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:39.079587 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-87aac13e-572b-4da2-9ae2-2e6157198ad9 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:39.080166 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-87aac13e-572b-4da2-9ae2-2e6157198ad9 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:39.081022 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-87aac13e-572b-4da2-9ae2-2e6157198ad9 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:39.081512 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-87aac13e-572b-4da2-9ae2-2e6157198ad9 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:39.082596 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-3dffe3d5-2851-4667-910d-f1ee958974a7 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3330e8f935bf4f369bf0f4cfd1cbecb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7dbda2a02546dbb8024325fffe55f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:39.099516 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3dffe3d5-2851-4667-910d-f1ee958974a7 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] 10.222.0.46 "GET /compute/v2.1/servers/4924fb6b-dd55-416f-989a-91b6fa8d47e2" status: 200 len: 1222 microversion: 2.1 time: 0.250355 Jul 28 10:32:39.103518 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 239/525] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:38 2022] GET /compute/v2.1/servers/4924fb6b-dd55-416f-989a-91b6fa8d47e2 => generated 1222 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:32:39.200634 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-87aac13e-572b-4da2-9ae2-2e6157198ad9 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: b721d299-a710-45f6-af51-82576b542be6] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:32:39.382335 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-87aac13e-572b-4da2-9ae2-2e6157198ad9 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: b721d299-a710-45f6-af51-82576b542be6] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:32:39.383398 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-87aac13e-572b-4da2-9ae2-2e6157198ad9 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:39.385690 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-87aac13e-572b-4da2-9ae2-2e6157198ad9 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:39.386500 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-87aac13e-572b-4da2-9ae2-2e6157198ad9 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: b721d299-a710-45f6-af51-82576b542be6] instance's host None is down, deleting from database Jul 28 10:32:39.393344 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-87aac13e-572b-4da2-9ae2-2e6157198ad9 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: b721d299-a710-45f6-af51-82576b542be6] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:32:39.886443 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-87aac13e-572b-4da2-9ae2-2e6157198ad9 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: b721d299-a710-45f6-af51-82576b542be6] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:32:39.896169 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-87aac13e-572b-4da2-9ae2-2e6157198ad9 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: b721d299-a710-45f6-af51-82576b542be6] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:32:40.124855 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d9e6508e-424e-42ff-b948-9387c941b284 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:40.125475 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-d9e6508e-424e-42ff-b948-9387c941b284 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] [instance: 4924fb6b-dd55-416f-989a-91b6fa8d47e2] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:40.147868 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d9e6508e-424e-42ff-b948-9387c941b284 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:40.148336 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d9e6508e-424e-42ff-b948-9387c941b284 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:40.149145 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d9e6508e-424e-42ff-b948-9387c941b284 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:40.149591 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d9e6508e-424e-42ff-b948-9387c941b284 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:40.280474 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d9e6508e-424e-42ff-b948-9387c941b284 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:40.285493 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d9e6508e-424e-42ff-b948-9387c941b284 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:40.289704 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-d9e6508e-424e-42ff-b948-9387c941b284 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lazy-loading 'fault' on Instance uuid 4924fb6b-dd55-416f-989a-91b6fa8d47e2 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:32:40.348355 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-87aac13e-572b-4da2-9ae2-2e6157198ad9 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b721d299-a710-45f6-af51-82576b542be6" status: 204 len: 0 microversion: 2.1 time: 1.323002 Jul 28 10:32:40.358877 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 287/526] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:32:39 2022] DELETE /compute/v2.1/servers/b721d299-a710-45f6-af51-82576b542be6 => generated 0 bytes in 1331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:32:40.369962 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-78143cc4-3e43-4880-a36b-60cfb29b0cd5 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:40.371109 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-78143cc4-3e43-4880-a36b-60cfb29b0cd5 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] [instance: b721d299-a710-45f6-af51-82576b542be6] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:40.385525 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-78143cc4-3e43-4880-a36b-60cfb29b0cd5 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:40.387263 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-78143cc4-3e43-4880-a36b-60cfb29b0cd5 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:40.397688 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-78143cc4-3e43-4880-a36b-60cfb29b0cd5 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:40.398398 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-78143cc4-3e43-4880-a36b-60cfb29b0cd5 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:40.428388 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-78143cc4-3e43-4880-a36b-60cfb29b0cd5 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] HTTP exception thrown: Instance b721d299-a710-45f6-af51-82576b542be6 could not be found. Jul 28 10:32:40.432874 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-78143cc4-3e43-4880-a36b-60cfb29b0cd5 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Request method failure captured: Jul 28 10:32:40.432874 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/b721d299-a710-45f6-af51-82576b542be6 HTTP/1.1 Jul 28 10:32:40.432874 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:32:40.432874 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:32:40.432874 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:32:40.432874 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:32:40.432874 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:32:40.432874 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:32:40.432874 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:32:40.432874 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:40.432874 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mW0FpDf28JHuELU2qHta2hkMxW3JfEUtdRdPg8560b8cIuKqWgD1ko-U3o97Ofh_BCvpD5LrHkq_o9OIx7PVxDx8Qk5T-r1PU-xu80K-BCU9KX3t2BNsXuwFLWWXJskhCfQoAd0k_1wc7pMRk88Yw9uLC4Tm8ewDE5ZvznpgbxrPn4 Jul 28 10:32:40.432874 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:32:40.432874 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:32:40.432874 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:32:40.432874 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:32:40.432874 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:32:40.432874 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:32:40.432874 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 839c8046ddb4420e9cc9759af8d9b13b Jul 28 10:32:40.432874 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ListImageFiltersTestJSON-306585994 Jul 28 10:32:40.432874 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:32:40.432874 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:32:40.434373 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/839c8046ddb4420e9cc9759af8d9b13b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/839c8046ddb4420e9cc9759af8d9b13b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/839c8046ddb4420e9cc9759af8d9b13b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_839c8046ddb4420e9cc9759af8d9b13b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:40.434373 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ListImageFiltersTestJSON-306585994 Jul 28 10:32:40.434373 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 839c8046ddb4420e9cc9759af8d9b13b Jul 28 10:32:40.434373 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-306585994 Jul 28 10:32:40.434373 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ListImageFiltersTestJSON-306585994-project Jul 28 10:32:40.434373 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:32:40.434373 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:32:40.434373 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 2038700b25844d83926b00b4c31a9cec Jul 28 10:32:40.434373 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ListImageFiltersTestJSON-306585994-project Jul 28 10:32:40.434373 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:32:40.434373 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance b721d299-a710-45f6-af51-82576b542be6 could not be found. Jul 28 10:32:40.434373 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'b721d299-a710-45f6-af51-82576b542be6'} Jul 28 10:32:40.435079 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:40.435079 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:40.435079 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:32:40.435079 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:32:40.435079 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:32:40.435079 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:32:40.435079 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:32:40.435079 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:32:40.435079 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:32:40.435079 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:32:40.435079 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b721d299-a710-45f6-af51-82576b542be6 could not be found. Jul 28 10:32:40.435079 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:40.435079 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:40.435079 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:40.435079 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:40.435079 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:40.435079 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:40.435079 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:40.435079 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:40.435079 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:40.437165 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:40.437165 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:32:40.437165 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:32:40.437165 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:32:40.437165 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:32:40.437165 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:32:40.437165 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:32:40.437165 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b721d299-a710-45f6-af51-82576b542be6 could not be found. Jul 28 10:32:40.437165 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:40.437165 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:40.437165 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:40.437165 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:40.437165 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:40.437165 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:40.437165 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:40.437165 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:40.437165 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b721d299-a710-45f6-af51-82576b542be6 could not be found. Jul 28 10:32:40.437165 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:40.442523 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-78143cc4-3e43-4880-a36b-60cfb29b0cd5 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Returning 404 to user: Instance b721d299-a710-45f6-af51-82576b542be6 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:40.444507 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-78143cc4-3e43-4880-a36b-60cfb29b0cd5 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] 10.222.0.46 "GET /compute/v2.1/servers/b721d299-a710-45f6-af51-82576b542be6" status: 404 len: 111 microversion: 2.1 time: 0.083915 Jul 28 10:32:40.449540 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 288/527] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:40 2022] GET /compute/v2.1/servers/b721d299-a710-45f6-af51-82576b542be6 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:32:40.457448 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8e4d2d9e-ca27-4ac5-b7a2-92d570c44b58 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Calling method '.version_select at 0x7fa9580c5a60>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:40.467729 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-d9e6508e-424e-42ff-b948-9387c941b284 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3330e8f935bf4f369bf0f4cfd1cbecb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7dbda2a02546dbb8024325fffe55f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:40.476543 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d9e6508e-424e-42ff-b948-9387c941b284 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] 10.222.0.46 "GET /compute/v2.1/servers/4924fb6b-dd55-416f-989a-91b6fa8d47e2" status: 200 len: 1295 microversion: 2.1 time: 0.355966 Jul 28 10:32:40.482748 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 240/528] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:40 2022] GET /compute/v2.1/servers/4924fb6b-dd55-416f-989a-91b6fa8d47e2 => generated 1295 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:40.509327 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8ffb8655-727b-4371-a82c-30ca60d71892 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:40.519439 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-8ffb8655-727b-4371-a82c-30ca60d71892 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] [instance: 4924fb6b-dd55-416f-989a-91b6fa8d47e2] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:40.539867 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8ffb8655-727b-4371-a82c-30ca60d71892 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:40.542456 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8ffb8655-727b-4371-a82c-30ca60d71892 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:40.543360 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8ffb8655-727b-4371-a82c-30ca60d71892 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:40.544642 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8ffb8655-727b-4371-a82c-30ca60d71892 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:40.594425 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-8ffb8655-727b-4371-a82c-30ca60d71892 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] [instance: 4924fb6b-dd55-416f-989a-91b6fa8d47e2] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:32:40.656907 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-8ffb8655-727b-4371-a82c-30ca60d71892 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] [instance: 4924fb6b-dd55-416f-989a-91b6fa8d47e2] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:32:40.658719 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8ffb8655-727b-4371-a82c-30ca60d71892 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:40.659484 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8ffb8655-727b-4371-a82c-30ca60d71892 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:40.660146 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-8ffb8655-727b-4371-a82c-30ca60d71892 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] [instance: 4924fb6b-dd55-416f-989a-91b6fa8d47e2] instance's host None is down, deleting from database Jul 28 10:32:40.665537 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-8ffb8655-727b-4371-a82c-30ca60d71892 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] [instance: 4924fb6b-dd55-416f-989a-91b6fa8d47e2] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:32:40.860534 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-8ffb8655-727b-4371-a82c-30ca60d71892 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] [instance: 4924fb6b-dd55-416f-989a-91b6fa8d47e2] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:32:40.867687 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-8ffb8655-727b-4371-a82c-30ca60d71892 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] [instance: 4924fb6b-dd55-416f-989a-91b6fa8d47e2] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:32:41.308372 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-8ffb8655-727b-4371-a82c-30ca60d71892 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4924fb6b-dd55-416f-989a-91b6fa8d47e2" status: 204 len: 0 microversion: 2.1 time: 0.803993 Jul 28 10:32:41.311052 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 241/529] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:32:40 2022] DELETE /compute/v2.1/servers/4924fb6b-dd55-416f-989a-91b6fa8d47e2 => generated 0 bytes in 808 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:32:41.559391 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-8e4d2d9e-ca27-4ac5-b7a2-92d570c44b58 tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] 10.222.0.46 "DELETE /compute/v2.1/images/3db7907e-f028-480e-b2ca-9db2ee58e79f" status: 204 len: 0 microversion: 2.1 time: 1.108413 Jul 28 10:32:41.560575 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 289/530] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:40 2022] DELETE /compute/v2.1/images/3db7907e-f028-480e-b2ca-9db2ee58e79f => generated 0 bytes in 1110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:32:41.565554 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f6faefcd-c619-4cdb-b29e-2dd9eeffa303 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:41.567306 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-f6faefcd-c619-4cdb-b29e-2dd9eeffa303 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] [instance: 4924fb6b-dd55-416f-989a-91b6fa8d47e2] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:32:41.581551 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f6faefcd-c619-4cdb-b29e-2dd9eeffa303 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:41.586667 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f6faefcd-c619-4cdb-b29e-2dd9eeffa303 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:41.587817 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f6faefcd-c619-4cdb-b29e-2dd9eeffa303 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:41.588410 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f6faefcd-c619-4cdb-b29e-2dd9eeffa303 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:41.628852 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-f6faefcd-c619-4cdb-b29e-2dd9eeffa303 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] HTTP exception thrown: Instance 4924fb6b-dd55-416f-989a-91b6fa8d47e2 could not be found. Jul 28 10:32:41.630752 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f6faefcd-c619-4cdb-b29e-2dd9eeffa303 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Request method failure captured: Jul 28 10:32:41.630752 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/4924fb6b-dd55-416f-989a-91b6fa8d47e2 HTTP/1.1 Jul 28 10:32:41.630752 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:32:41.630752 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:32:41.630752 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:32:41.630752 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:32:41.630752 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:32:41.630752 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:32:41.630752 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:32:41.630752 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:41.630752 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mXC-riUZSmRfN8QAYVsLUN_04RoD5kPJIz2-u7y9iYkYgxKdWIWQcMjV9t21sGnp8kfvGiZYupN-r8gyY4yp7RY9HvJ7T1SbLlPP6ua3seCggi6_CYCJt67205ktm2Ew2-EhnBv7FtqaJRpoBOLvCevden9rWRCZJ-zHKOlbA1cGi4 Jul 28 10:32:41.630752 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:32:41.630752 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:32:41.630752 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:32:41.630752 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:32:41.630752 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:32:41.630752 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:32:41.630752 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 6b7dbda2a02546dbb8024325fffe55f5 Jul 28 10:32:41.630752 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1665660947 Jul 28 10:32:41.630752 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:32:41.630752 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:32:41.632251 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6b7dbda2a02546dbb8024325fffe55f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6b7dbda2a02546dbb8024325fffe55f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6b7dbda2a02546dbb8024325fffe55f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6b7dbda2a02546dbb8024325fffe55f5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:41.632251 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1665660947 Jul 28 10:32:41.632251 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 6b7dbda2a02546dbb8024325fffe55f5 Jul 28 10:32:41.632251 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1665660947 Jul 28 10:32:41.632251 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ServersAdminNegativeTestJSON-1665660947-project Jul 28 10:32:41.632251 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:32:41.632251 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:32:41.632251 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 3330e8f935bf4f369bf0f4cfd1cbecb4 Jul 28 10:32:41.632251 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1665660947-project Jul 28 10:32:41.632251 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:32:41.632251 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 4924fb6b-dd55-416f-989a-91b6fa8d47e2 could not be found. Jul 28 10:32:41.632251 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '4924fb6b-dd55-416f-989a-91b6fa8d47e2'} Jul 28 10:32:41.633035 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:41.633035 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:41.633035 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:32:41.633035 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:32:41.633035 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:32:41.633035 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:32:41.633035 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:32:41.633035 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:32:41.633035 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:32:41.633035 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:32:41.633035 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4924fb6b-dd55-416f-989a-91b6fa8d47e2 could not be found. Jul 28 10:32:41.633035 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:41.633035 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:41.633035 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:41.633035 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:41.633035 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:41.633035 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:41.633035 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:41.633035 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:41.633035 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:41.634478 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:41.634478 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:32:41.634478 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:32:41.634478 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:32:41.634478 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:32:41.634478 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:32:41.634478 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:32:41.634478 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4924fb6b-dd55-416f-989a-91b6fa8d47e2 could not be found. Jul 28 10:32:41.634478 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:41.634478 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:41.634478 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:41.634478 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:41.634478 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:41.634478 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:41.634478 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:41.634478 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:41.634478 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4924fb6b-dd55-416f-989a-91b6fa8d47e2 could not be found. Jul 28 10:32:41.634478 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:32:41.637742 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f6faefcd-c619-4cdb-b29e-2dd9eeffa303 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] Returning 404 to user: Instance 4924fb6b-dd55-416f-989a-91b6fa8d47e2 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:41.643078 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f6faefcd-c619-4cdb-b29e-2dd9eeffa303 tempest-ServersAdminNegativeTestJSON-1665660947 tempest-ServersAdminNegativeTestJSON-1665660947-project] 10.222.0.46 "GET /compute/v2.1/servers/4924fb6b-dd55-416f-989a-91b6fa8d47e2" status: 404 len: 111 microversion: 2.1 time: 0.081252 Jul 28 10:32:41.644207 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 290/531] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:41 2022] GET /compute/v2.1/servers/4924fb6b-dd55-416f-989a-91b6fa8d47e2 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:32:41.667620 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2e1f4b11-d110-413a-aee9-db7dbb6ad30d tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Calling method '.version_select at 0x7fa94bc23940>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:41.725192 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a9ab3bdf-58a0-497a-a99a-731379ece37b tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Action: 'update', calling method: .version_select at 0x7fa94bce80d0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:41.729445 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:32:41.729445 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:32:41.737521 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a9ab3bdf-58a0-497a-a99a-731379ece37b tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:41.738239 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a9ab3bdf-58a0-497a-a99a-731379ece37b tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:41.780686 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a9ab3bdf-58a0-497a-a99a-731379ece37b tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:41.786602 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a9ab3bdf-58a0-497a-a99a-731379ece37b tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:41.811109 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-a9ab3bdf-58a0-497a-a99a-731379ece37b tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] HTTP exception thrown: Service 98b84f61-0353-4726-aae1-852c439fae88 could not be found. Jul 28 10:32:41.813216 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a9ab3bdf-58a0-497a-a99a-731379ece37b tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Request method failure captured: Jul 28 10:32:41.813216 n-d-850468-6 devstack@n-api.service[119463]: request: PUT /compute/v2.1/os-services/98b84f61-0353-4726-aae1-852c439fae88 HTTP/1.1 Jul 28 10:32:41.813216 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:32:41.813216 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:32:41.813216 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:32:41.813216 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 56 Jul 28 10:32:41.813216 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:32:41.813216 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:32:41.813216 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:32:41.813216 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:41.813216 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mXJLStXmicHEKuWXRV0X2C31_kci0abrBOFH2Q-gptO2l2w65_Y0oDzP88LezabnTiTFYJLPyUmSYkke5_hZC0ar_NCZ_NlMAJbRhDVH16xIyTuCmfdXQMaOfbftxufdEBSDAAYBuFFvuOabARb0hDjWSV2ittPqlC1mSoXjbH4e9Y Jul 28 10:32:41.813216 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:32:41.813216 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:32:41.813216 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:32:41.813216 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:32:41.813216 n-d-850468-6 devstack@n-api.service[119463]: X-Openstack-Nova-Api-Version: 2.53 Jul 28 10:32:41.813216 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:32:41.813216 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:32:41.813216 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: d553861192fd48ddaf08952d0e16cbf9 Jul 28 10:32:41.813216 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-876149583 Jul 28 10:32:41.813216 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member,admin Jul 28 10:32:41.813216 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member,admin Jul 28 10:32:41.815215 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d553861192fd48ddaf08952d0e16cbf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d553861192fd48ddaf08952d0e16cbf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d553861192fd48ddaf08952d0e16cbf9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d553861192fd48ddaf08952d0e16cbf9", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:41.815215 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-876149583 Jul 28 10:32:41.815215 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: d553861192fd48ddaf08952d0e16cbf9 Jul 28 10:32:41.815215 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-876149583 Jul 28 10:32:41.815215 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin Jul 28 10:32:41.815215 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:32:41.815215 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:32:41.815215 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: a405178cf2884ccfbcde000250c77671 Jul 28 10:32:41.815215 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin Jul 28 10:32:41.815215 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:32:41.815215 n-d-850468-6 devstack@n-api.service[119463]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 28 10:32:41.815215 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:32:41.815215 n-d-850468-6 devstack@n-api.service[119463]: exception: Service 98b84f61-0353-4726-aae1-852c439fae88 could not be found. Jul 28 10:32:41.816124 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '98b84f61-0353-4726-aae1-852c439fae88', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 28 10:32:41.816124 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:41.816124 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:41.816124 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6158, in service_get_by_id Jul 28 10:32:41.816124 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 28 10:32:41.816124 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6018, in _find_service_in_cell Jul 28 10:32:41.816124 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 28 10:32:41.816124 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 28 10:32:41.816124 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:41.816124 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:41.816124 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:41.816124 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:41.816124 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 28 10:32:41.816124 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 28 10:32:41.816124 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6160, in service_get_by_id Jul 28 10:32:41.816124 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 28 10:32:41.816124 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 98b84f61-0353-4726-aae1-852c439fae88 could not be found. Jul 28 10:32:41.816124 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:41.816124 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:41.816124 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:41.816124 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:41.818605 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:41.818605 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:41.818605 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:41.818605 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:41.818605 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:32:41.818605 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:32:41.818605 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:41.818605 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:41.818605 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:41.818605 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:41.818605 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 28 10:32:41.818605 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:32:41.818605 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 98b84f61-0353-4726-aae1-852c439fae88 could not be found. Jul 28 10:32:41.818605 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:41.818605 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:41.818605 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:41.818605 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:41.818605 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:41.818605 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:41.818605 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:41.820033 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:41.820033 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 98b84f61-0353-4726-aae1-852c439fae88 could not be found. Jul 28 10:32:41.820033 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:41.820668 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a9ab3bdf-58a0-497a-a99a-731379ece37b tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Returning 404 to user: Service 98b84f61-0353-4726-aae1-852c439fae88 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:41.821623 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a9ab3bdf-58a0-497a-a99a-731379ece37b tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-services/98b84f61-0353-4726-aae1-852c439fae88" status: 404 len: 110 microversion: 2.53 time: 0.507412 Jul 28 10:32:41.830411 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 242/532] 10.222.0.46 () {62 vars in 1309 bytes} [Thu Jul 28 10:32:41 2022] PUT /compute/v2.1/os-services/98b84f61-0353-4726-aae1-852c439fae88 => generated 110 bytes in 519 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:32:41.854465 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-59583c9e-c794-4dc5-bb04-28469735eeec tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Action: 'update', calling method: .version_select at 0x7fa94bcdfee0>, body: {"status": "disabled"} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:41.859771 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-59583c9e-c794-4dc5-bb04-28469735eeec tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:41.867988 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-59583c9e-c794-4dc5-bb04-28469735eeec tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:41.910583 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-59583c9e-c794-4dc5-bb04-28469735eeec tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:41.915764 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-59583c9e-c794-4dc5-bb04-28469735eeec tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:41.940034 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-59583c9e-c794-4dc5-bb04-28469735eeec tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] HTTP exception thrown: Service 98b84f61-0353-4726-aae1-852c439fae88 could not be found. Jul 28 10:32:41.942309 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-59583c9e-c794-4dc5-bb04-28469735eeec tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Request method failure captured: Jul 28 10:32:41.942309 n-d-850468-6 devstack@n-api.service[119463]: request: PUT /compute/v2.1/os-services/98b84f61-0353-4726-aae1-852c439fae88 HTTP/1.1 Jul 28 10:32:41.942309 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:32:41.942309 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:32:41.942309 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:32:41.942309 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 22 Jul 28 10:32:41.942309 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:32:41.942309 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:32:41.942309 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:32:41.942309 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:41.942309 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mXJLStXmicHEKuWXRV0X2C31_kci0abrBOFH2Q-gptO2l2w65_Y0oDzP88LezabnTiTFYJLPyUmSYkke5_hZC0ar_NCZ_NlMAJbRhDVH16xIyTuCmfdXQMaOfbftxufdEBSDAAYBuFFvuOabARb0hDjWSV2ittPqlC1mSoXjbH4e9Y Jul 28 10:32:41.942309 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:32:41.942309 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:32:41.942309 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:32:41.942309 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:32:41.942309 n-d-850468-6 devstack@n-api.service[119463]: X-Openstack-Nova-Api-Version: 2.53 Jul 28 10:32:41.942309 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:32:41.942309 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:32:41.942309 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: d553861192fd48ddaf08952d0e16cbf9 Jul 28 10:32:41.942309 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-876149583 Jul 28 10:32:41.942309 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member,admin Jul 28 10:32:41.942309 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member,admin Jul 28 10:32:41.943918 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d553861192fd48ddaf08952d0e16cbf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d553861192fd48ddaf08952d0e16cbf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d553861192fd48ddaf08952d0e16cbf9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d553861192fd48ddaf08952d0e16cbf9", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:41.943918 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-876149583 Jul 28 10:32:41.943918 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: d553861192fd48ddaf08952d0e16cbf9 Jul 28 10:32:41.943918 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-876149583 Jul 28 10:32:41.943918 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin Jul 28 10:32:41.943918 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:32:41.943918 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:32:41.943918 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: a405178cf2884ccfbcde000250c77671 Jul 28 10:32:41.943918 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin Jul 28 10:32:41.943918 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:32:41.943918 n-d-850468-6 devstack@n-api.service[119463]: {"status": "disabled"} Jul 28 10:32:41.943918 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:32:41.943918 n-d-850468-6 devstack@n-api.service[119463]: exception: Service 98b84f61-0353-4726-aae1-852c439fae88 could not be found. Jul 28 10:32:41.943918 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '98b84f61-0353-4726-aae1-852c439fae88', 'body': {'status': 'disabled'}} Jul 28 10:32:41.944896 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:41.944896 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:41.944896 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6158, in service_get_by_id Jul 28 10:32:41.944896 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 28 10:32:41.944896 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6018, in _find_service_in_cell Jul 28 10:32:41.944896 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 28 10:32:41.944896 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 28 10:32:41.944896 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:41.944896 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:41.944896 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:41.944896 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:41.944896 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 28 10:32:41.944896 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 28 10:32:41.944896 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6160, in service_get_by_id Jul 28 10:32:41.944896 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 28 10:32:41.944896 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 98b84f61-0353-4726-aae1-852c439fae88 could not be found. Jul 28 10:32:41.944896 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:41.944896 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:41.944896 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:41.944896 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:41.944896 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:41.946419 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:41.946419 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:41.946419 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:41.946419 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:32:41.946419 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:32:41.946419 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:41.946419 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:41.946419 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:41.946419 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:41.946419 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 28 10:32:41.946419 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:32:41.946419 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 98b84f61-0353-4726-aae1-852c439fae88 could not be found. Jul 28 10:32:41.946419 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:41.946419 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:41.946419 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:41.946419 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:41.946419 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:41.946419 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:41.946419 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:41.946419 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:41.948514 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 98b84f61-0353-4726-aae1-852c439fae88 could not be found. Jul 28 10:32:41.948514 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:41.949514 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-59583c9e-c794-4dc5-bb04-28469735eeec tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Returning 404 to user: Service 98b84f61-0353-4726-aae1-852c439fae88 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:41.956578 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-59583c9e-c794-4dc5-bb04-28469735eeec tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-services/98b84f61-0353-4726-aae1-852c439fae88" status: 404 len: 110 microversion: 2.53 time: 0.113779 Jul 28 10:32:41.959017 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 243/533] 10.222.0.46 () {62 vars in 1309 bytes} [Thu Jul 28 10:32:41 2022] PUT /compute/v2.1/os-services/98b84f61-0353-4726-aae1-852c439fae88 => generated 110 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:32:41.975787 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a2ee391d-35ed-4f88-ad37-8bacc96a509a tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Action: 'update', calling method: .version_select at 0x7fa94bcb3c10>, body: {"status": "enabled"} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:41.982495 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a2ee391d-35ed-4f88-ad37-8bacc96a509a tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:41.982957 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a2ee391d-35ed-4f88-ad37-8bacc96a509a tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:42.014167 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a2ee391d-35ed-4f88-ad37-8bacc96a509a tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:42.014623 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a2ee391d-35ed-4f88-ad37-8bacc96a509a tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:42.035346 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-a2ee391d-35ed-4f88-ad37-8bacc96a509a tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] HTTP exception thrown: Service 98b84f61-0353-4726-aae1-852c439fae88 could not be found. Jul 28 10:32:42.036993 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a2ee391d-35ed-4f88-ad37-8bacc96a509a tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Request method failure captured: Jul 28 10:32:42.036993 n-d-850468-6 devstack@n-api.service[119463]: request: PUT /compute/v2.1/os-services/98b84f61-0353-4726-aae1-852c439fae88 HTTP/1.1 Jul 28 10:32:42.036993 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:32:42.036993 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:32:42.036993 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:32:42.036993 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 21 Jul 28 10:32:42.036993 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:32:42.036993 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:32:42.036993 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:32:42.036993 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:42.036993 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mXJLStXmicHEKuWXRV0X2C31_kci0abrBOFH2Q-gptO2l2w65_Y0oDzP88LezabnTiTFYJLPyUmSYkke5_hZC0ar_NCZ_NlMAJbRhDVH16xIyTuCmfdXQMaOfbftxufdEBSDAAYBuFFvuOabARb0hDjWSV2ittPqlC1mSoXjbH4e9Y Jul 28 10:32:42.036993 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:32:42.036993 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:32:42.036993 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:32:42.036993 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:32:42.036993 n-d-850468-6 devstack@n-api.service[119463]: X-Openstack-Nova-Api-Version: 2.53 Jul 28 10:32:42.036993 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:32:42.036993 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:32:42.036993 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: d553861192fd48ddaf08952d0e16cbf9 Jul 28 10:32:42.036993 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-876149583 Jul 28 10:32:42.036993 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member,admin Jul 28 10:32:42.036993 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member,admin Jul 28 10:32:42.038723 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d553861192fd48ddaf08952d0e16cbf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d553861192fd48ddaf08952d0e16cbf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d553861192fd48ddaf08952d0e16cbf9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d553861192fd48ddaf08952d0e16cbf9", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:42.038723 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-876149583 Jul 28 10:32:42.038723 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: d553861192fd48ddaf08952d0e16cbf9 Jul 28 10:32:42.038723 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-876149583 Jul 28 10:32:42.038723 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin Jul 28 10:32:42.038723 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:32:42.038723 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:32:42.038723 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: a405178cf2884ccfbcde000250c77671 Jul 28 10:32:42.038723 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin Jul 28 10:32:42.038723 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:32:42.038723 n-d-850468-6 devstack@n-api.service[119463]: {"status": "enabled"} Jul 28 10:32:42.038723 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:32:42.038723 n-d-850468-6 devstack@n-api.service[119463]: exception: Service 98b84f61-0353-4726-aae1-852c439fae88 could not be found. Jul 28 10:32:42.038723 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '98b84f61-0353-4726-aae1-852c439fae88', 'body': {'status': 'enabled'}} Jul 28 10:32:42.039577 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:42.039577 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:42.039577 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6158, in service_get_by_id Jul 28 10:32:42.039577 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 28 10:32:42.039577 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6018, in _find_service_in_cell Jul 28 10:32:42.039577 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 28 10:32:42.039577 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 28 10:32:42.039577 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:42.039577 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:42.039577 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:42.039577 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:42.039577 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 28 10:32:42.039577 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 28 10:32:42.039577 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6160, in service_get_by_id Jul 28 10:32:42.039577 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 28 10:32:42.039577 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 98b84f61-0353-4726-aae1-852c439fae88 could not be found. Jul 28 10:32:42.039577 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:42.039577 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:42.039577 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:42.039577 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:42.039577 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:42.041047 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:42.041047 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:42.041047 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:42.041047 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:32:42.041047 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:32:42.041047 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:42.041047 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:42.041047 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:42.041047 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:42.041047 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 28 10:32:42.041047 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:32:42.041047 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 98b84f61-0353-4726-aae1-852c439fae88 could not be found. Jul 28 10:32:42.041047 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:42.041047 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:42.041047 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:42.041047 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:42.041047 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:42.041047 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:42.041047 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:42.041047 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:42.044608 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 98b84f61-0353-4726-aae1-852c439fae88 could not be found. Jul 28 10:32:42.044608 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:42.044608 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a2ee391d-35ed-4f88-ad37-8bacc96a509a tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Returning 404 to user: Service 98b84f61-0353-4726-aae1-852c439fae88 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:42.044608 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a2ee391d-35ed-4f88-ad37-8bacc96a509a tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-services/98b84f61-0353-4726-aae1-852c439fae88" status: 404 len: 110 microversion: 2.53 time: 0.073843 Jul 28 10:32:42.049436 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 244/534] 10.222.0.46 () {62 vars in 1309 bytes} [Thu Jul 28 10:32:41 2022] PUT /compute/v2.1/os-services/98b84f61-0353-4726-aae1-852c439fae88 => generated 110 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:32:42.066423 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1b4781cd-4a67-4ffa-99e6-9fcaf9d33440 tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:42.075064 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:32:42.075064 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:32:42.081375 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1b4781cd-4a67-4ffa-99e6-9fcaf9d33440 tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:42.090573 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1b4781cd-4a67-4ffa-99e6-9fcaf9d33440 tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:42.091811 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1b4781cd-4a67-4ffa-99e6-9fcaf9d33440 tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:42.092435 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1b4781cd-4a67-4ffa-99e6-9fcaf9d33440 tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:42.161648 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-1b4781cd-4a67-4ffa-99e6-9fcaf9d33440 tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.102870 Jul 28 10:32:42.162654 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 245/535] 10.222.0.46 () {60 vars in 1178 bytes} [Thu Jul 28 10:32:42 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:32:42.175520 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0c896d0b-673a-47cc-b40b-ac62fc83c022 tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:42.178714 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:32:42.178714 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:32:42.181321 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0c896d0b-673a-47cc-b40b-ac62fc83c022 tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:42.182033 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0c896d0b-673a-47cc-b40b-ac62fc83c022 tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:42.191330 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0c896d0b-673a-47cc-b40b-ac62fc83c022 tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:42.192267 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0c896d0b-673a-47cc-b40b-ac62fc83c022 tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:42.216679 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-2e1f4b11-d110-413a-aee9-db7dbb6ad30d tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] 10.222.0.46 "DELETE /compute/v2.1/images/10a0ace6-49a4-47c6-a419-cc25f8d2381c" status: 204 len: 0 microversion: 2.1 time: 0.571196 Jul 28 10:32:42.217941 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 291/536] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:41 2022] DELETE /compute/v2.1/images/10a0ace6-49a4-47c6-a419-cc25f8d2381c => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:32:42.229022 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ac20c41e-d298-4903-8304-be7cc0972bef tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] Calling method '.version_select at 0x7fa94bcdd040>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:42.255462 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-0c896d0b-673a-47cc-b40b-ac62fc83c022 tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.084138 Jul 28 10:32:42.257771 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 246/537] 10.222.0.46 () {60 vars in 1211 bytes} [Thu Jul 28 10:32:42 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:32:42.271515 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-90897186-10e1-4e53-acb6-034630dbf3be tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:42.275869 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:32:42.275869 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:32:42.277594 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-90897186-10e1-4e53-acb6-034630dbf3be tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:42.278277 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-90897186-10e1-4e53-acb6-034630dbf3be tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:42.279265 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-90897186-10e1-4e53-acb6-034630dbf3be tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:42.279931 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-90897186-10e1-4e53-acb6-034630dbf3be tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:42.357290 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-90897186-10e1-4e53-acb6-034630dbf3be tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.089642 Jul 28 10:32:42.359062 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 247/538] 10.222.0.46 () {60 vars in 1178 bytes} [Thu Jul 28 10:32:42 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:32:42.372437 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-52fb5f0a-5e46-42fb-b126-0865f8272f8e tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:42.377490 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:32:42.377490 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:32:42.383491 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-52fb5f0a-5e46-42fb-b126-0865f8272f8e tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:42.386744 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-52fb5f0a-5e46-42fb-b126-0865f8272f8e tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:42.388457 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-52fb5f0a-5e46-42fb-b126-0865f8272f8e tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:42.388997 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-52fb5f0a-5e46-42fb-b126-0865f8272f8e tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:42.452107 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-52fb5f0a-5e46-42fb-b126-0865f8272f8e tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?host=n-d-850468-6&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.084126 Jul 28 10:32:42.454216 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 248/539] 10.222.0.46 () {60 vars in 1235 bytes} [Thu Jul 28 10:32:42 2022] GET /compute/v2.1/os-services?host=n-d-850468-6&binary=xxx => generated 16 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:42.465493 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a0682b39-d0e8-45b9-b5f6-ec2ccfa2d4ab tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:42.474843 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:32:42.474843 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:32:42.483262 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a0682b39-d0e8-45b9-b5f6-ec2ccfa2d4ab tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:42.484832 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a0682b39-d0e8-45b9-b5f6-ec2ccfa2d4ab tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:42.490683 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a0682b39-d0e8-45b9-b5f6-ec2ccfa2d4ab tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:42.492076 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a0682b39-d0e8-45b9-b5f6-ec2ccfa2d4ab tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:42.619440 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a0682b39-d0e8-45b9-b5f6-ec2ccfa2d4ab tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.157702 Jul 28 10:32:42.626346 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 249/540] 10.222.0.46 () {60 vars in 1178 bytes} [Thu Jul 28 10:32:42 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:32:42.644876 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-89f8fe52-183b-4925-ad85-be88c73ee75f tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:42.653067 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:32:42.653067 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:32:42.657601 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-89f8fe52-183b-4925-ad85-be88c73ee75f tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:42.660297 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-89f8fe52-183b-4925-ad85-be88c73ee75f tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:42.661589 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-89f8fe52-183b-4925-ad85-be88c73ee75f tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:42.662842 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-89f8fe52-183b-4925-ad85-be88c73ee75f tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:42.727190 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-89f8fe52-183b-4925-ad85-be88c73ee75f tempest-ServicesAdminNegativeV253TestJSON-876149583 tempest-ServicesAdminNegativeV253TestJSON-876149583-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.091742 Jul 28 10:32:42.733620 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 250/541] 10.222.0.46 () {60 vars in 1239 bytes} [Thu Jul 28 10:32:42 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:43.133434 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ac20c41e-d298-4903-8304-be7cc0972bef tempest-ListImageFiltersTestJSON-306585994 tempest-ListImageFiltersTestJSON-306585994-project] 10.222.0.46 "DELETE /compute/v2.1/images/ad393c8a-f154-47a5-beb3-ce83eb79ec3a" status: 204 len: 0 microversion: 2.1 time: 0.910486 Jul 28 10:32:43.134717 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 292/542] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:32:42 2022] DELETE /compute/v2.1/images/ad393c8a-f154-47a5-beb3-ce83eb79ec3a => generated 0 bytes in 912 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:32:43.566859 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-227cfa53-becc-4b46-938a-deaca45a9ce8 tempest-ServicesAdminNegativeV253TestJSON-832609477 tempest-ServicesAdminNegativeV253TestJSON-832609477-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:43.569318 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:32:43.569318 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:32:43.570942 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-227cfa53-becc-4b46-938a-deaca45a9ce8 tempest-ServicesAdminNegativeV253TestJSON-832609477 tempest-ServicesAdminNegativeV253TestJSON-832609477-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'd23ec2a5c2004fd6a7a116724894a88e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5998e3f730ff403882d0d9a28d052896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:32:43.572571 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-227cfa53-becc-4b46-938a-deaca45a9ce8 tempest-ServicesAdminNegativeV253TestJSON-832609477 tempest-ServicesAdminNegativeV253TestJSON-832609477-project] Request method failure captured: Jul 28 10:32:43.572571 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 28 10:32:43.572571 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:32:43.572571 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:32:43.572571 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:32:43.572571 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:32:43.572571 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:32:43.572571 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:32:43.572571 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:32:43.572571 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:43.572571 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mXHvsYxR46ubkKgpGYGKIYnjrsCZjbp8fwHM_HysYXveIA629YL9Y51AuEyPByBwwThYt9y4SemK4-p7r0luIT097K9oJ9t7YEaH6FVdNfBvdpPdGrdUSpg-_2l7vxXQLwqk0_NlmvBR_Bckcc9zc3X1NJkUvqXTzmYXCx72ayf1qw Jul 28 10:32:43.572571 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:32:43.572571 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:32:43.572571 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:32:43.572571 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:32:43.572571 n-d-850468-6 devstack@n-api.service[119463]: X-Openstack-Nova-Api-Version: 2.53 Jul 28 10:32:43.572571 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:32:43.572571 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:32:43.572571 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 5998e3f730ff403882d0d9a28d052896 Jul 28 10:32:43.572571 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-832609477 Jul 28 10:32:43.572571 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:32:43.572571 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:32:43.574371 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5998e3f730ff403882d0d9a28d052896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5998e3f730ff403882d0d9a28d052896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5998e3f730ff403882d0d9a28d052896"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5998e3f730ff403882d0d9a28d052896", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:43.574371 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-832609477 Jul 28 10:32:43.574371 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 5998e3f730ff403882d0d9a28d052896 Jul 28 10:32:43.574371 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-832609477 Jul 28 10:32:43.574371 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServicesAdminNegativeV253TestJSON-832609477-project Jul 28 10:32:43.574371 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:32:43.574371 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:32:43.574371 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: d23ec2a5c2004fd6a7a116724894a88e Jul 28 10:32:43.574371 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-832609477-project Jul 28 10:32:43.574371 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:32:43.574371 n-d-850468-6 devstack@n-api.service[119463]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 28 10:32:43.574371 n-d-850468-6 devstack@n-api.service[119463]: action_args: {} Jul 28 10:32:43.575309 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:43.575309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:43.575309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:43.575309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:43.575309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:43.575309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:43.575309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 10:32:43.575309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:43.575309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 10:32:43.575309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:43.575309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:43.575309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:43.575309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 28 10:32:43.575309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 28 10:32:43.575309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 10:32:43.575309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 10:32:43.575309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 10:32:43.575309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 10:32:43.575309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:32:43.576832 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:32:43.576832 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:32:43.576832 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:32:43.576832 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 10:32:43.576832 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 10:32:43.576832 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 10:32:43.576832 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 10:32:43.576832 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 10:32:43.576832 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 10:32:43.576832 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 28 10:32:43.576832 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:43.576832 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:43.576832 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:43.576832 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:43.576832 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:43.576832 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:43.576832 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 10:32:43.576832 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 10:32:43.576832 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 28 10:32:43.576832 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:43.583409 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-227cfa53-becc-4b46-938a-deaca45a9ce8 tempest-ServicesAdminNegativeV253TestJSON-832609477 tempest-ServicesAdminNegativeV253TestJSON-832609477-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:43.583409 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-227cfa53-becc-4b46-938a-deaca45a9ce8 tempest-ServicesAdminNegativeV253TestJSON-832609477 tempest-ServicesAdminNegativeV253TestJSON-832609477-project] 10.222.0.46 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.833184 Jul 28 10:32:43.583409 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 251/543] 10.222.0.46 () {60 vars in 1178 bytes} [Thu Jul 28 10:32:42 2022] GET /compute/v2.1/os-services => generated 112 bytes in 837 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:32:48.279744 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=19 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:48.280418 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=23 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:49.039181 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-dba528e6-86ad-4a21-80c4-3a0e140db8e2 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Action: 'create', calling method: .version_select at 0x7fa94bde2790>, body: {"keypair": {"name": "tempest-keypair-1055282833", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYDmsufmoqOgNa1RmzrkfSvxJByNKC9dSfbEMokwZstHtDIPqQxjR6Pw2jZd1npZo7heIJ57Hj5aPNp4NT2COwdT51SAQ/uQXt96mzp9zMqQczLNBX5sNQwRKXh8wFJBw=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:49.109432 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-dba528e6-86ad-4a21-80c4-3a0e140db8e2 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Getting quotas for project 0ce205552ef3402faeecc69f68a4d2c9. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:49.123014 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-dba528e6-86ad-4a21-80c4-3a0e140db8e2 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Getting quotas for user ec9d5165b0ce4208a5202bfde43696a4 and project 0ce205552ef3402faeecc69f68a4d2c9. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:49.175052 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-dba528e6-86ad-4a21-80c4-3a0e140db8e2 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.895298 Jul 28 10:32:49.175886 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 293/544] 10.222.0.46 () {62 vars in 1199 bytes} [Thu Jul 28 10:32:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 898 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 28 10:32:49.191101 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=19 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:49.225105 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-39ec879c-07ca-42b6-925b-58c2bdd4f9fe tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Calling method '.version_select at 0x7fa94bc15d30>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:49.297924 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-39ec879c-07ca-42b6-925b-58c2bdd4f9fe tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs/tempest-keypair-1055282833" status: 200 len: 512 microversion: 2.2 time: 0.110292 Jul 28 10:32:49.307681 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 252/545] 10.222.0.46 () {60 vars in 1258 bytes} [Thu Jul 28 10:32:49 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1055282833 => generated 512 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:49.332888 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-29cffa23-9d78-4959-b5c0-a33aa44dc406 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Calling method '.version_select at 0x7fa94bb44280>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:49.415973 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-29cffa23-9d78-4959-b5c0-a33aa44dc406 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055282833" status: 204 len: 0 microversion: 2.2 time: 0.093171 Jul 28 10:32:49.417813 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 294/546] 10.222.0.46 () {60 vars in 1261 bytes} [Thu Jul 28 10:32:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055282833 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:32:49.444996 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1620aa5d-0749-4b21-88c1-481eeeb60fb1 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Action: 'create', calling method: .version_select at 0x7fa94bc151f0>, body: {"keypair": {"name": "tempest-keypair-1630229421", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4bVc0CkEQnY0oAod9+v4JLl64pYcfxXPpLk1ONtcwblAIffVP128tbea3lVq80lyuPkqd8heCTgOV1zwYBKyi32hNJ3WA3FRB4M2HCmiaw8xAIeL1MBAfWJQBQaJfY2g=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:49.528905 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-1620aa5d-0749-4b21-88c1-481eeeb60fb1 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Getting quotas for project 0ce205552ef3402faeecc69f68a4d2c9. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:49.554807 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-1620aa5d-0749-4b21-88c1-481eeeb60fb1 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Getting quotas for user ec9d5165b0ce4208a5202bfde43696a4 and project 0ce205552ef3402faeecc69f68a4d2c9. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:49.654265 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-1620aa5d-0749-4b21-88c1-481eeeb60fb1 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.222054 Jul 28 10:32:49.659897 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 253/547] 10.222.0.46 () {62 vars in 1199 bytes} [Thu Jul 28 10:32:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 228 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 28 10:32:49.679533 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9c1fecbc-a08e-4ad5-8484-398118de6d65 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Calling method '.version_select at 0x7fa94bb44670>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:49.756070 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9c1fecbc-a08e-4ad5-8484-398118de6d65 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1630229421" status: 204 len: 0 microversion: 2.2 time: 0.086035 Jul 28 10:32:49.759797 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 295/548] 10.222.0.46 () {60 vars in 1261 bytes} [Thu Jul 28 10:32:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1630229421 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:32:49.775611 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2f8a3ad0-9794-481e-9c40-c06028c6ef40 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Action: 'create', calling method: .version_select at 0x7fa94bc734c0>, body: {"keypair": {"name": "tempest-keypair-326517007", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:49.867512 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-2f8a3ad0-9794-481e-9c40-c06028c6ef40 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Getting quotas for project 0ce205552ef3402faeecc69f68a4d2c9. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:49.892998 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-2f8a3ad0-9794-481e-9c40-c06028c6ef40 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Getting quotas for user ec9d5165b0ce4208a5202bfde43696a4 and project 0ce205552ef3402faeecc69f68a4d2c9. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:49.958538 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-2f8a3ad0-9794-481e-9c40-c06028c6ef40 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.190268 Jul 28 10:32:49.961647 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 254/549] 10.222.0.46 () {62 vars in 1199 bytes} [Thu Jul 28 10:32:49 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 195 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 28 10:32:49.974092 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-bccfae4d-597c-4553-8c08-a842c73c7d67 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Calling method '.version_select at 0x7fa94bc39af0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:50.014301 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-bccfae4d-597c-4553-8c08-a842c73c7d67 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-326517007" status: 204 len: 0 microversion: 2.2 time: 0.045264 Jul 28 10:32:50.014979 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 296/550] 10.222.0.46 () {60 vars in 1258 bytes} [Thu Jul 28 10:32:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-326517007 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:32:50.032811 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c8e6981b-0564-480c-81d8-9f956c9ad190 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Action: 'create', calling method: .version_select at 0x7fa94bc773a0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-243862932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4uGRBfMH39kiFMEeiK4go05ZpQVcUI/aAeIapbhaB2tTWE+KS27yWIEnG10YuclomsusMTAaHC6hYAr90/o3RCqsUes0rHUvbv//+JEc8gk0xX59Tv3GnDLUpnEFK3GQ=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:50.061445 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:50.098613 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-c8e6981b-0564-480c-81d8-9f956c9ad190 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Getting quotas for project 0ce205552ef3402faeecc69f68a4d2c9. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:50.120964 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-c8e6981b-0564-480c-81d8-9f956c9ad190 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Getting quotas for user ec9d5165b0ce4208a5202bfde43696a4 and project 0ce205552ef3402faeecc69f68a4d2c9. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:50.210208 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c8e6981b-0564-480c-81d8-9f956c9ad190 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.186423 Jul 28 10:32:50.220365 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 255/551] 10.222.0.46 () {62 vars in 1199 bytes} [Thu Jul 28 10:32:50 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 189 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 28 10:32:50.228394 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9b9d8184-9c6c-4658-afe9-fe7c2d989b3a tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Action: 'create', calling method: .version_select at 0x7fa94bde28b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-371937778", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZDQlFZkEs1BtLQ1BpIstXoKMp/Omfvb5FQkOSknYZ5FUBGoejkJiIu10v8/Ywwfo04rTj0x47unCXY36oh695VJwEe9Zw9K8HhJDg0iTs8goNshK1flbJRoS+OXkotkA=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:50.264281 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:UPDATE=4,nova_api:DELETE=3 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:50.301386 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-9b9d8184-9c6c-4658-afe9-fe7c2d989b3a tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Getting quotas for project 0ce205552ef3402faeecc69f68a4d2c9. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:50.312309 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-9b9d8184-9c6c-4658-afe9-fe7c2d989b3a tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Getting quotas for user ec9d5165b0ce4208a5202bfde43696a4 and project 0ce205552ef3402faeecc69f68a4d2c9. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:50.370595 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9b9d8184-9c6c-4658-afe9-fe7c2d989b3a tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.147642 Jul 28 10:32:50.374541 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 297/552] 10.222.0.46 () {62 vars in 1199 bytes} [Thu Jul 28 10:32:50 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 28 10:32:50.389133 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-43f5c9aa-5fa1-4b96-aba9-18cc911483f3 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Action: 'create', calling method: .version_select at 0x7fa94bcb33a0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-337513867", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByQ/wXhkLwi5s7BeERK0nwBtMEi5l4aWuY9tYOR/IlersFUkpjMlfowtQweoDtKSUQkYLjkMq4Zkf+7DUj2xWCqglJazSfk7Fd7DmeP7+A6voF/R0jW240BgH8iu01HGg=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:50.439222 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-43f5c9aa-5fa1-4b96-aba9-18cc911483f3 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Getting quotas for project 0ce205552ef3402faeecc69f68a4d2c9. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:50.447468 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-43f5c9aa-5fa1-4b96-aba9-18cc911483f3 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Getting quotas for user ec9d5165b0ce4208a5202bfde43696a4 and project 0ce205552ef3402faeecc69f68a4d2c9. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:50.480846 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-43f5c9aa-5fa1-4b96-aba9-18cc911483f3 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.096844 Jul 28 10:32:50.480951 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 256/553] 10.222.0.46 () {62 vars in 1199 bytes} [Thu Jul 28 10:32:50 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 28 10:32:50.491227 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c62efae2-b79b-434c-8306-e9d7243dee07 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Calling method '.version_select at 0x7fa94bb9f310>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:50.495226 n-d-850468-6 devstack@n-api.service[119464]: WARNING oslo_db.sqlalchemy.utils [None req-c62efae2-b79b-434c-8306-e9d7243dee07 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 28 10:32:50.517519 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c62efae2-b79b-434c-8306-e9d7243dee07 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.029973 Jul 28 10:32:50.530023 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 298/554] 10.222.0.46 () {60 vars in 1177 bytes} [Thu Jul 28 10:32:50 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:50.539828 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b4d6eb86-2f5d-4767-b33f-7da9e43c35c6 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Calling method '.version_select at 0x7fa94bce8670>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:50.590744 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b4d6eb86-2f5d-4767-b33f-7da9e43c35c6 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-337513867" status: 204 len: 0 microversion: 2.2 time: 0.052845 Jul 28 10:32:50.592676 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 257/555] 10.222.0.46 () {60 vars in 1318 bytes} [Thu Jul 28 10:32:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-337513867 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:32:50.602999 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-61e6b3b8-de5d-4adc-bd11-f4947f09fd10 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Calling method '.version_select at 0x7fa94bc00550>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:50.643072 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-61e6b3b8-de5d-4adc-bd11-f4947f09fd10 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-371937778" status: 204 len: 0 microversion: 2.2 time: 0.043720 Jul 28 10:32:50.646979 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 299/556] 10.222.0.46 () {60 vars in 1318 bytes} [Thu Jul 28 10:32:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-371937778 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:32:50.670332 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-48570fab-a1eb-4c2c-a8e4-db1e363a54e8 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Calling method '.version_select at 0x7fa94bc151f0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:50.738022 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-48570fab-a1eb-4c2c-a8e4-db1e363a54e8 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-243862932" status: 204 len: 0 microversion: 2.2 time: 0.083964 Jul 28 10:32:50.769272 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-83fa09f9-a1b0-45a6-8786-50ae7b885eb7 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Action: 'create', calling method: .version_select at 0x7fa94bc39b80>, body: {"keypair": {"name": "tempest-keypair-754478869", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6o5oRFWHu5MwrBuKqj9Je9xPCAVm7KhU3RNrpvGEFi9VOS9L3mEb6SvJeAaZrvnPTQeIxrKWLEPkt0mcnoWRVaI6r5dYkebdtl1sjGp0m1sICj/nK2GMDAzd9rVdjvYA=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:50.773242 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 258/557] 10.222.0.46 () {60 vars in 1318 bytes} [Thu Jul 28 10:32:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-243862932 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:32:50.807856 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-83fa09f9-a1b0-45a6-8786-50ae7b885eb7 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Getting quotas for project 0ce205552ef3402faeecc69f68a4d2c9. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:50.835869 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-83fa09f9-a1b0-45a6-8786-50ae7b885eb7 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Getting quotas for user ec9d5165b0ce4208a5202bfde43696a4 and project 0ce205552ef3402faeecc69f68a4d2c9. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:50.917847 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-83fa09f9-a1b0-45a6-8786-50ae7b885eb7 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.153254 Jul 28 10:32:50.930046 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ac7e1240-39b9-433a-b1a4-263e140e36b6 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Calling method '.version_select at 0x7fa94bd2ec10>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:50.940500 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 300/558] 10.222.0.46 () {62 vars in 1199 bytes} [Thu Jul 28 10:32:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 177 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 28 10:32:50.954144 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ac7e1240-39b9-433a-b1a4-263e140e36b6 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs/tempest-keypair-754478869" status: 200 len: 512 microversion: 2.2 time: 0.027282 Jul 28 10:32:50.954804 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 259/559] 10.222.0.46 () {60 vars in 1255 bytes} [Thu Jul 28 10:32:50 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-754478869 => generated 512 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:32:50.967829 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6341c79f-3e62-4051-82f0-9b60637cd105 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Calling method '.version_select at 0x7fa94bc399d0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:50.978966 n-d-850468-6 devstack@n-api.service[119464]: WARNING oslo_db.sqlalchemy.utils [None req-6341c79f-3e62-4051-82f0-9b60637cd105 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 28 10:32:50.991091 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-6341c79f-3e62-4051-82f0-9b60637cd105 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.027262 Jul 28 10:32:50.993160 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 301/560] 10.222.0.46 () {60 vars in 1177 bytes} [Thu Jul 28 10:32:50 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:51.004714 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c5fe4f5b-0d47-40ae-b426-e1732617c560 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Calling method '.version_select at 0x7fa94bc730d0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:51.039840 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c5fe4f5b-0d47-40ae-b426-e1732617c560 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-754478869" status: 204 len: 0 microversion: 2.2 time: 0.039590 Jul 28 10:32:51.044192 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 260/561] 10.222.0.46 () {60 vars in 1258 bytes} [Thu Jul 28 10:32:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-754478869 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 10:32:51.054299 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4063b750-fe10-4235-90a1-d103f3f311c5 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Action: 'create', calling method: .version_select at 0x7fa94bc004c0>, body: {"keypair": {"name": "tempest-keypair-1621915841", "type": "x509"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:51.111742 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-4063b750-fe10-4235-90a1-d103f3f311c5 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Getting quotas for project 0ce205552ef3402faeecc69f68a4d2c9. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:51.119473 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-4063b750-fe10-4235-90a1-d103f3f311c5 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Getting quotas for user ec9d5165b0ce4208a5202bfde43696a4 and project 0ce205552ef3402faeecc69f68a4d2c9. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:51.163582 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.processutils [None req-4063b750-fe10-4235-90a1-d103f3f311c5 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpcwgl688_/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpcwgl688_/temp.key -subj /CN=ec9d5165b0ce4208a5202bfde43696a4 -extensions v3_req_client {{(pid=119464) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 28 10:32:51.385713 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.processutils [None req-4063b750-fe10-4235-90a1-d103f3f311c5 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpcwgl688_/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpcwgl688_/temp.key -subj /CN=ec9d5165b0ce4208a5202bfde43696a4 -extensions v3_req_client" returned: 0 in 0.222s {{(pid=119464) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 28 10:32:51.387397 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.processutils [None req-4063b750-fe10-4235-90a1-d103f3f311c5 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpcwgl688_/temp.key -password pass: {{(pid=119464) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 28 10:32:51.474146 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.processutils [None req-4063b750-fe10-4235-90a1-d103f3f311c5 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpcwgl688_/temp.key -password pass:" returned: 0 in 0.086s {{(pid=119464) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 28 10:32:51.561787 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-4063b750-fe10-4235-90a1-d103f3f311c5 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Getting quotas for project 0ce205552ef3402faeecc69f68a4d2c9. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:51.580865 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-4063b750-fe10-4235-90a1-d103f3f311c5 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Getting quotas for user ec9d5165b0ce4208a5202bfde43696a4 and project 0ce205552ef3402faeecc69f68a4d2c9. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:51.605807 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-4063b750-fe10-4235-90a1-d103f3f311c5 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.555420 Jul 28 10:32:51.609149 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 302/562] 10.222.0.46 () {62 vars in 1198 bytes} [Thu Jul 28 10:32:51 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 559 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:32:51.620925 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-405a4fcb-b5f5-4183-a807-3816b0da8271 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Calling method '.version_select at 0x7fa94bc131f0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:51.650913 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-405a4fcb-b5f5-4183-a807-3816b0da8271 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs/tempest-keypair-1621915841" status: 200 len: 1534 microversion: 2.2 time: 0.034077 Jul 28 10:32:51.651526 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 261/563] 10.222.0.46 () {60 vars in 1258 bytes} [Thu Jul 28 10:32:51 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1621915841 => generated 1534 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:51.670182 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-818883c4-65da-4784-bf1d-cdc35d61bc4b tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Calling method '.version_select at 0x7fa94bc73550>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:51.676924 n-d-850468-6 devstack@n-api.service[119464]: WARNING oslo_db.sqlalchemy.utils [None req-818883c4-65da-4784-bf1d-cdc35d61bc4b tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 28 10:32:51.692365 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:UPDATE=20,nova_cell0:DELETE=4,nova_cell0:SELECT=30,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:51.697354 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-818883c4-65da-4784-bf1d-cdc35d61bc4b tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.033370 Jul 28 10:32:51.700630 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 303/564] 10.222.0.46 () {60 vars in 1177 bytes} [Thu Jul 28 10:32:51 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:51.711777 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2e6397b5-de45-4f7b-ae71-0dcf617594c0 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] Calling method '.version_select at 0x7fa94bc13af0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:51.758596 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-2e6397b5-de45-4f7b-ae71-0dcf617594c0 tempest-KeyPairsV22TestJSON-684603248 tempest-KeyPairsV22TestJSON-684603248-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1621915841" status: 204 len: 0 microversion: 2.2 time: 0.048100 Jul 28 10:32:51.760522 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 262/565] 10.222.0.46 () {60 vars in 1261 bytes} [Thu Jul 28 10:32:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1621915841 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:32:55.698429 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7ac2a735-ba98-40ae-90a6-f822d0ef9348 tempest-AbsoluteLimitsNegativeTestJSON-1248655908 tempest-AbsoluteLimitsNegativeTestJSON-1248655908-project] Calling method '.version_select at 0x7fa94bc39dc0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:55.720091 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7ac2a735-ba98-40ae-90a6-f822d0ef9348 tempest-AbsoluteLimitsNegativeTestJSON-1248655908 tempest-AbsoluteLimitsNegativeTestJSON-1248655908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:55.720739 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7ac2a735-ba98-40ae-90a6-f822d0ef9348 tempest-AbsoluteLimitsNegativeTestJSON-1248655908 tempest-AbsoluteLimitsNegativeTestJSON-1248655908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:55.721574 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7ac2a735-ba98-40ae-90a6-f822d0ef9348 tempest-AbsoluteLimitsNegativeTestJSON-1248655908 tempest-AbsoluteLimitsNegativeTestJSON-1248655908-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:32:55.722049 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7ac2a735-ba98-40ae-90a6-f822d0ef9348 tempest-AbsoluteLimitsNegativeTestJSON-1248655908 tempest-AbsoluteLimitsNegativeTestJSON-1248655908-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:32:55.781289 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7ac2a735-ba98-40ae-90a6-f822d0ef9348 tempest-AbsoluteLimitsNegativeTestJSON-1248655908 tempest-AbsoluteLimitsNegativeTestJSON-1248655908-project] 10.222.0.46 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.416327 Jul 28 10:32:55.802636 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 304/566] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Jul 28 10:32:55 2022] GET /compute/v2.1/limits => generated 511 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:55.966179 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=66,nova_cell0:UPDATE=27,nova_cell0:DELETE=4,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:55.968824 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=23 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:32:55.973952 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c73679de-e67f-4710-81d1-d32c94d6e01e tempest-AbsoluteLimitsNegativeTestJSON-1248655908 tempest-AbsoluteLimitsNegativeTestJSON-1248655908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1687078326", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:56.132503 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-c73679de-e67f-4710-81d1-d32c94d6e01e tempest-AbsoluteLimitsNegativeTestJSON-1248655908 tempest-AbsoluteLimitsNegativeTestJSON-1248655908-project] validate_networks() for None {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:32:57.494466 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-c73679de-e67f-4710-81d1-d32c94d6e01e tempest-AbsoluteLimitsNegativeTestJSON-1248655908 tempest-AbsoluteLimitsNegativeTestJSON-1248655908-project] Getting quotas for project 73500ca301a04651a9201ab4eb49b752. Resources: dict_keys(['metadata_items']) {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:57.510486 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-c73679de-e67f-4710-81d1-d32c94d6e01e tempest-AbsoluteLimitsNegativeTestJSON-1248655908 tempest-AbsoluteLimitsNegativeTestJSON-1248655908-project] Getting quotas for user cc344c611b5040b1a411380afa6f9405 and project 73500ca301a04651a9201ab4eb49b752. Resources: dict_keys(['metadata_items']) {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:57.537960 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-c73679de-e67f-4710-81d1-d32c94d6e01e tempest-AbsoluteLimitsNegativeTestJSON-1248655908 tempest-AbsoluteLimitsNegativeTestJSON-1248655908-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c73679de-e67f-4710-81d1-d32c94d6e01e tempest-AbsoluteLimitsNegativeTestJSON-1248655908 tempest-AbsoluteLimitsNegativeTestJSON-1248655908-project] Request method failure captured: Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 1752 Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mXXqYYBJW4VH7vu51v11k27tbeKaWVVL1FX3WSlItIsLJRoQJhb29SjJ40J05wj7ExR8Ew2PP4QFDyns_v6sEFP77bWcGhPu2dNM4hREuJEofIEPCesTQCEkNXOr68PT7P3vSCJsGepq3vYecw1nsj3HkzQ-Ja-_XDOn6WZBWoVBxQ Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 73500ca301a04651a9201ab4eb49b752 Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1248655908 Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/73500ca301a04651a9201ab4eb49b752"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/73500ca301a04651a9201ab4eb49b752"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/73500ca301a04651a9201ab4eb49b752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_73500ca301a04651a9201ab4eb49b752", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1248655908 Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 73500ca301a04651a9201ab4eb49b752 Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1248655908 Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1248655908-project Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: cc344c611b5040b1a411380afa6f9405 Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1248655908-project Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1687078326", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:32:57.541512 n-d-850468-6 devstack@n-api.service[119463]: exception: Maximum number of metadata items exceeds 128 Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1687078326', 'imageRef': 'eff4a889-87b7-4a4c-be7a-77433dc25faf', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 465, in _check_metadata_properties_quota Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2152, in create Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1670, in _create_instance Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 472, in _check_metadata_properties_quota Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:57.545046 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:32:57.552293 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:32:57.552293 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 10:32:57.552293 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 28 10:32:57.552293 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 28 10:32:57.552293 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 28 10:32:57.552293 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:57.552293 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:32:57.552293 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:57.552293 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:32:57.552293 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:32:57.552293 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:32:57.552293 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:32:57.552293 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:32:57.552293 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 28 10:32:57.552293 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:32:57.557988 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c73679de-e67f-4710-81d1-d32c94d6e01e tempest-AbsoluteLimitsNegativeTestJSON-1248655908 tempest-AbsoluteLimitsNegativeTestJSON-1248655908-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:32:57.557988 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c73679de-e67f-4710-81d1-d32c94d6e01e tempest-AbsoluteLimitsNegativeTestJSON-1248655908 tempest-AbsoluteLimitsNegativeTestJSON-1248655908-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.590699 Jul 28 10:32:57.557988 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 263/567] 10.222.0.46 () {60 vars in 1148 bytes} [Thu Jul 28 10:32:55 2022] POST /compute/v2.1/servers => generated 87 bytes in 1592 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:32:59.168010 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-25114f4e-d1e3-4a07-820e-708af2a787dc tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Action: 'create', calling method: .version_select at 0x7fa94bcdd670>, body: {"keypair": {"name": "tempest-keypair-2141582043", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHkXeo50myPQfdX7lfs+jQjNdw/DEusQMtUWmJfv52EA1gvrkVFcNBVpj3D6m7YyIs9uKZb30tniNuBiylgEiOhWW8p5RsO3tmNp0UkVLxUcW/0jrxcwPSo/zVWunyXDw=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:32:59.254737 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-25114f4e-d1e3-4a07-820e-708af2a787dc tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Getting quotas for project 6a444daab6bb40e9aa209a6e8b1d1fb0. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:32:59.267019 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-25114f4e-d1e3-4a07-820e-708af2a787dc tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Getting quotas for user 00cd8bde8b06496b84498d77e60ea330 and project 6a444daab6bb40e9aa209a6e8b1d1fb0. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:32:59.328381 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-25114f4e-d1e3-4a07-820e-708af2a787dc tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.669776 Jul 28 10:32:59.330751 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 305/568] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:32:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:33:00.964497 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-397a329f-8b78-4b80-8944-5c2fd2049a9e tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Action: 'create', calling method: .version_select at 0x7fa94bc73280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1396026697", "description": "tempest-description-1391728757"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:02.300154 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-397a329f-8b78-4b80-8944-5c2fd2049a9e tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.526958 Jul 28 10:33:02.308056 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 264/569] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:33:00 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:33:02.314594 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-bb09c4e1-9adb-40ab-9abe-f1febe4d28ea tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Action: 'create', calling method: .version_select at 0x7fa94bc39790>, body: {"security_group_rule": {"parent_group_id": "2d460aab-6dfd-4117-a68c-c7e5ab3356e7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:03.729685 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-bb09c4e1-9adb-40ab-9abe-f1febe4d28ea tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.420076 Jul 28 10:33:03.731632 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 306/570] 10.222.0.46 () {60 vars in 1195 bytes} [Thu Jul 28 10:33:02 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:33:03.748249 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c652637c-26c2-42db-b247-02383ebb361b tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Action: 'create', calling method: .version_select at 0x7fa94bc77f70>, body: {"security_group_rule": {"parent_group_id": "2d460aab-6dfd-4117-a68c-c7e5ab3356e7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:04.595327 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-c652637c-26c2-42db-b247-02383ebb361b tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] HTTP exception thrown: This rule already exists in group 2d460aab-6dfd-4117-a68c-c7e5ab3356e7 Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c652637c-26c2-42db-b247-02383ebb361b tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Request method failure captured: Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 138 Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mXcK8Z_eY5r53JeMiyMk6QmN5zUJmEXoUtHiN0dEg85xufhCdZm10rxmDYT54CA8bD6WEkRw47V8931K853mRsJRCyRa-7tDgerJq59vgEgD63m9vgfvG7I4UwQfyiN9yQaYip0NvPMlNcSwOPHYi0g23eOhjxg_eQJXLpt3OKE2kY Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 09bc1ff0d5164cabaeb43d17f1c5bddc Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_09bc1ff0d5164cabaeb43d17f1c5bddc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 09bc1ff0d5164cabaeb43d17f1c5bddc Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-358250170-project Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 45645aecc0a14a818d4e44f2bc47b99d Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170-project Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: {"security_group_rule": {"parent_group_id": "2d460aab-6dfd-4117-a68c-c7e5ab3356e7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: exception: This rule already exists in group 2d460aab-6dfd-4117-a68c-c7e5ab3356e7 Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2d460aab-6dfd-4117-a68c-c7e5ab3356e7', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 2d460aab-6dfd-4117-a68c-c7e5ab3356e7 Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 2d460aab-6dfd-4117-a68c-c7e5ab3356e7 Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:04.597804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:04.601696 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:33:04.601696 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:33:04.601696 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 2d460aab-6dfd-4117-a68c-c7e5ab3356e7 Jul 28 10:33:04.601696 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:04.605566 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c652637c-26c2-42db-b247-02383ebb361b tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Returning 400 to user: This rule already exists in group 2d460aab-6dfd-4117-a68c-c7e5ab3356e7 {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:04.608511 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c652637c-26c2-42db-b247-02383ebb361b tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.867690 Jul 28 10:33:04.610054 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 265/571] 10.222.0.46 () {60 vars in 1195 bytes} [Thu Jul 28 10:33:03 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 870 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:33:04.625197 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f7a27f29-4965-4ced-9a4c-4c18429770e9 tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Calling method '.version_select at 0x7fa94bc39820>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:05.751767 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:05.752830 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:07.357202 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f7a27f29-4965-4ced-9a4c-4c18429770e9 tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-group-rules/ab2b3601-d8d9-4417-84db-944bea75dd8b" status: 202 len: 0 microversion: 2.1 time: 2.740716 Jul 28 10:33:07.367816 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 307/572] 10.222.0.46 () {58 vars in 1287 bytes} [Thu Jul 28 10:33:04 2022] DELETE /compute/v2.1/os-security-group-rules/ab2b3601-d8d9-4417-84db-944bea75dd8b => generated 0 bytes in 2754 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:33:07.371329 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c127a8aa-3ee3-46f2-a185-a461def058e5 tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Action: 'create', calling method: .version_select at 0x7fa94bce8820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-409087529", "description": "tempest-description-1022847562"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:07.526496 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=20 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:07.536931 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=2,nova_api:DELETE=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:07.643920 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2009899460", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "1919abb0-f185-492d-a78b-1ceacf0f50c1"}], "security_groups": [{"name": "tempest-securitygroup--319854298"}], "key_name": "tempest-keypair-2141582043", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:08.189579 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c127a8aa-3ee3-46f2-a185-a461def058e5 tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.824871 Jul 28 10:33:08.190216 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 266/573] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:33:07 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:33:08.203743 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f91e83af-4bef-4bfa-a517-9a15455ea34b tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Action: 'create', calling method: .version_select at 0x7fa94bcdf820>, body: {"security_group_rule": {"parent_group_id": "29c065f5-2507-4f4a-864b-ce3ea71d91bc", "ip_protocol": "tcp", "from_port": 1891194562, "to_port": 22}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:08.438250 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-f91e83af-4bef-4bfa-a517-9a15455ea34b tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] HTTP exception thrown: Invalid port range 1891194562:22. Former value cannot be greater than the later Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f91e83af-4bef-4bfa-a517-9a15455ea34b tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Request method failure captured: Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 146 Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mXcK8Z_eY5r53JeMiyMk6QmN5zUJmEXoUtHiN0dEg85xufhCdZm10rxmDYT54CA8bD6WEkRw47V8931K853mRsJRCyRa-7tDgerJq59vgEgD63m9vgfvG7I4UwQfyiN9yQaYip0NvPMlNcSwOPHYi0g23eOhjxg_eQJXLpt3OKE2kY Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 09bc1ff0d5164cabaeb43d17f1c5bddc Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_09bc1ff0d5164cabaeb43d17f1c5bddc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 09bc1ff0d5164cabaeb43d17f1c5bddc Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-358250170-project Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 45645aecc0a14a818d4e44f2bc47b99d Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170-project Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: {"security_group_rule": {"parent_group_id": "29c065f5-2507-4f4a-864b-ce3ea71d91bc", "ip_protocol": "tcp", "from_port": 1891194562, "to_port": 22}} Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: exception: Invalid port range 1891194562:22. Former value cannot be greater than the later Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'body': {'security_group_rule': {'parent_group_id': '29c065f5-2507-4f4a-864b-ce3ea71d91bc', 'ip_protocol': 'tcp', 'from_port': 1891194562, 'to_port': 22}}} Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1891194562:22. Former value cannot be greater than the later Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1891194562:22. Former value cannot be greater than the later Jul 28 10:33:08.445272 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:08.449824 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:08.449824 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:08.449824 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:08.449824 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:08.449824 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:08.449824 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:33:08.449824 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:33:08.449824 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1891194562:22. Former value cannot be greater than the later Jul 28 10:33:08.449824 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:08.456743 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f91e83af-4bef-4bfa-a517-9a15455ea34b tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Returning 400 to user: Invalid port range 1891194562:22. Former value cannot be greater than the later {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:08.458396 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f91e83af-4bef-4bfa-a517-9a15455ea34b tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.259004 Jul 28 10:33:08.480123 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 267/574] 10.222.0.46 () {60 vars in 1195 bytes} [Thu Jul 28 10:33:08 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 281 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:33:08.494209 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-fccfb9e1-7d89-4a6f-8a44-c56dd44e203c tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Action: 'create', calling method: .version_select at 0x7fa94bd2e310>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-438354363", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:08.504106 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-fccfb9e1-7d89-4a6f-8a44-c56dd44e203c tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] HTTP exception thrown: Security group id should be uuid Jul 28 10:33:08.511489 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] validate_networks() for [('1919abb0-f185-492d-a78b-1ceacf0f50c1', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-fccfb9e1-7d89-4a6f-8a44-c56dd44e203c tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Request method failure captured: Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 130 Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mXcK8Z_eY5r53JeMiyMk6QmN5zUJmEXoUtHiN0dEg85xufhCdZm10rxmDYT54CA8bD6WEkRw47V8931K853mRsJRCyRa-7tDgerJq59vgEgD63m9vgfvG7I4UwQfyiN9yQaYip0NvPMlNcSwOPHYi0g23eOhjxg_eQJXLpt3OKE2kY Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 09bc1ff0d5164cabaeb43d17f1c5bddc Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_09bc1ff0d5164cabaeb43d17f1c5bddc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 09bc1ff0d5164cabaeb43d17f1c5bddc Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-358250170-project Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 45645aecc0a14a818d4e44f2bc47b99d Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170-project Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-438354363", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: exception: Security group id should be uuid Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-438354363', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:33:08.523837 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:33:08.541096 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 28 10:33:08.541096 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:08.541096 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-fccfb9e1-7d89-4a6f-8a44-c56dd44e203c tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Returning 400 to user: Security group id should be uuid {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:08.541096 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-fccfb9e1-7d89-4a6f-8a44-c56dd44e203c tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.046221 Jul 28 10:33:08.541096 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 268/575] 10.222.0.46 () {60 vars in 1195 bytes} [Thu Jul 28 10:33:08 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 10:33:08.546978 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2e500a67-c214-48e7-bdf3-2c07aa7043eb tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Action: 'create', calling method: .version_select at 0x7fa94bce8700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1763308641", "description": "tempest-description-1914348425"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:09.316079 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=26 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:09.485052 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-2e500a67-c214-48e7-bdf3-2c07aa7043eb tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.948563 Jul 28 10:33:09.505841 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 269/576] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:33:08 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:33:09.522944 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5b9300f3-1ede-495f-8230-ffdc2cd7a14c tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Action: 'create', calling method: .version_select at 0x7fa94bc734c0>, body: {"security_group_rule": {"parent_group_id": "c58d92ec-af18-41b6-bc5d-775485ba57c2", "ip_protocol": "tempest-999-1920186217", "from_port": 22, "to_port": 22}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:10.325972 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-5b9300f3-1ede-495f-8230-ffdc2cd7a14c tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] HTTP exception thrown: Invalid IP protocol tempest-999-1920186217. Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5b9300f3-1ede-495f-8230-ffdc2cd7a14c tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Request method failure captured: Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 157 Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mXcK8Z_eY5r53JeMiyMk6QmN5zUJmEXoUtHiN0dEg85xufhCdZm10rxmDYT54CA8bD6WEkRw47V8931K853mRsJRCyRa-7tDgerJq59vgEgD63m9vgfvG7I4UwQfyiN9yQaYip0NvPMlNcSwOPHYi0g23eOhjxg_eQJXLpt3OKE2kY Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 09bc1ff0d5164cabaeb43d17f1c5bddc Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_09bc1ff0d5164cabaeb43d17f1c5bddc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 09bc1ff0d5164cabaeb43d17f1c5bddc Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-358250170-project Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 45645aecc0a14a818d4e44f2bc47b99d Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170-project Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: {"security_group_rule": {"parent_group_id": "c58d92ec-af18-41b6-bc5d-775485ba57c2", "ip_protocol": "tempest-999-1920186217", "from_port": 22, "to_port": 22}} Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: exception: Invalid IP protocol tempest-999-1920186217. Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c58d92ec-af18-41b6-bc5d-775485ba57c2', 'ip_protocol': 'tempest-999-1920186217', 'from_port': 22, 'to_port': 22}}} Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1920186217. Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1920186217. Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:10.328505 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:10.350440 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:10.350440 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:10.350440 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:10.350440 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:10.350440 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:33:10.350440 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:33:10.350440 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1920186217. Jul 28 10:33:10.350440 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:10.350440 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5b9300f3-1ede-495f-8230-ffdc2cd7a14c tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Returning 400 to user: Invalid IP protocol tempest-999-1920186217. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:10.350440 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-5b9300f3-1ede-495f-8230-ffdc2cd7a14c tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.822296 Jul 28 10:33:10.350440 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 270/577] 10.222.0.46 () {60 vars in 1195 bytes} [Thu Jul 28 10:33:09 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 824 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 10:33:10.350440 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-037c9013-4901-4ca6-8815-17852cae3dfd tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Action: 'create', calling method: .version_select at 0x7fa94bcb3790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-443229578", "description": "tempest-description-2120545618"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:10.708939 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:33:10.709462 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:33:10.709888 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:33:10.710293 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:33:10.711582 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:33:10.741546 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:10.742447 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:10.745779 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:10.746775 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:10.819606 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Getting quotas for project 6a444daab6bb40e9aa209a6e8b1d1fb0. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:33:10.825985 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Getting quotas for user 00cd8bde8b06496b84498d77e60ea330 and project 6a444daab6bb40e9aa209a6e8b1d1fb0. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:33:10.874884 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:33:10.879252 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: 8c87b19a-aa52-43c4-a769-4209684f53a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:33:11.035573 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-eb5bc99b-1cbc-4758-ae21-80cc52865814 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.398971 Jul 28 10:33:11.041427 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 308/578] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:33:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 3405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:33:11.072473 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-14963d44-9fb6-4345-ad54-a6e8897b159a tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:11.074738 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-14963d44-9fb6-4345-ad54-a6e8897b159a tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: 8c87b19a-aa52-43c4-a769-4209684f53a8] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:11.448820 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-037c9013-4901-4ca6-8815-17852cae3dfd tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.107558 Jul 28 10:33:11.459260 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 271/579] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:33:10 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:33:11.534543 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-14963d44-9fb6-4345-ad54-a6e8897b159a tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cd8bde8b06496b84498d77e60ea330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a444daab6bb40e9aa209a6e8b1d1fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:33:11.551806 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-14963d44-9fb6-4345-ad54-a6e8897b159a tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] 10.222.0.46 "GET /compute/v2.1/servers/8c87b19a-aa52-43c4-a769-4209684f53a8" status: 200 len: 1242 microversion: 2.1 time: 0.503972 Jul 28 10:33:11.554657 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 309/580] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:33:11 2022] GET /compute/v2.1/servers/8c87b19a-aa52-43c4-a769-4209684f53a8 => generated 1242 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:33:11.587421 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fdbc510b-f191-4e8c-bb8d-a7fa876da28f tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Action: 'create', calling method: .version_select at 0x7fa94bcedf70>, body: {"security_group_rule": {"parent_group_id": "0b05fd36-d52f-45f5-9cbb-a29b2d79d7fb", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:12.026358 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1206899166", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "e318a6cc-4c41-417d-90b1-48556b0d25fe"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:12.106985 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] validate_networks() for [('e318a6cc-4c41-417d-90b1-48556b0d25fe', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:33:12.129475 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-fdbc510b-f191-4e8c-bb8d-a7fa876da28f tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fdbc510b-f191-4e8c-bb8d-a7fa876da28f tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Request method failure captured: Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 138 Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mXcK8Z_eY5r53JeMiyMk6QmN5zUJmEXoUtHiN0dEg85xufhCdZm10rxmDYT54CA8bD6WEkRw47V8931K853mRsJRCyRa-7tDgerJq59vgEgD63m9vgfvG7I4UwQfyiN9yQaYip0NvPMlNcSwOPHYi0g23eOhjxg_eQJXLpt3OKE2kY Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 09bc1ff0d5164cabaeb43d17f1c5bddc Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_09bc1ff0d5164cabaeb43d17f1c5bddc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 09bc1ff0d5164cabaeb43d17f1c5bddc Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-358250170-project Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 45645aecc0a14a818d4e44f2bc47b99d Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170-project Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: {"security_group_rule": {"parent_group_id": "0b05fd36-d52f-45f5-9cbb-a29b2d79d7fb", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0b05fd36-d52f-45f5-9cbb-a29b2d79d7fb', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 28 10:33:12.132240 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:12.140670 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:12.140670 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:12.140670 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:12.140670 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:12.140670 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:12.140670 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:33:12.140670 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:33:12.140670 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 28 10:33:12.140670 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:12.140670 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fdbc510b-f191-4e8c-bb8d-a7fa876da28f tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:12.140670 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-fdbc510b-f191-4e8c-bb8d-a7fa876da28f tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.578143 Jul 28 10:33:12.140670 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 310/581] 10.222.0.46 () {60 vars in 1195 bytes} [Thu Jul 28 10:33:11 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 579 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:33:12.153189 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-31a9ddec-e4d1-412e-947e-106d577ab87c tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Action: 'create', calling method: .version_select at 0x7fa94bcdd280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1013145117", "description": "tempest-description-1294841872"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:13.829719 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:33:13.830231 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:33:13.830614 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:33:13.831022 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:33:13.831444 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:33:13.867236 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:13.868072 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:13.869133 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:13.869725 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:13.916313 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Getting quotas for project e60e39df35a24b9e902b4c3159e154da. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:33:13.930994 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Getting quotas for user 7b62d1b3544a4f77a6e359a778788176 and project e60e39df35a24b9e902b4c3159e154da. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:33:13.961781 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:33:13.968931 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] [instance: db2c0d84-51e6-4260-b938-68c81e5d97d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:33:14.050519 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-31a9ddec-e4d1-412e-947e-106d577ab87c tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.906081 Jul 28 10:33:14.052151 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 311/582] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:33:12 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:33:14.065630 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f0d26fd3-9ac0-4ff4-83ff-ca35f0f4d36f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:14.066624 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-f0d26fd3-9ac0-4ff4-83ff-ca35f0f4d36f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: 8c87b19a-aa52-43c4-a769-4209684f53a8] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:14.102517 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f0d26fd3-9ac0-4ff4-83ff-ca35f0f4d36f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:14.107686 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f0d26fd3-9ac0-4ff4-83ff-ca35f0f4d36f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:14.113220 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f0d26fd3-9ac0-4ff4-83ff-ca35f0f4d36f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:14.114748 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-2c2b21a2-98b0-497a-9748-fd364b85a4b4 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.649682 Jul 28 10:33:14.117353 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f0d26fd3-9ac0-4ff4-83ff-ca35f0f4d36f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:14.117815 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 272/583] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:33:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:33:14.126716 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-10aff557-b394-416c-b4fa-188d1aea4683 tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Action: 'create', calling method: .version_select at 0x7fa94bc150d0>, body: {"security_group_rule": {"parent_group_id": "d6b99975-e7f0-493f-8f35-cca81c29db0e", "ip_protocol": "tcp", "from_port": 22, "to_port": 1216117714}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:14.209850 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f0d26fd3-9ac0-4ff4-83ff-ca35f0f4d36f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:14.210477 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f0d26fd3-9ac0-4ff4-83ff-ca35f0f4d36f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:14.213698 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-f0d26fd3-9ac0-4ff4-83ff-ca35f0f4d36f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lazy-loading 'fault' on Instance uuid 8c87b19a-aa52-43c4-a769-4209684f53a8 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:33:14.370365 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-10aff557-b394-416c-b4fa-188d1aea4683 tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] HTTP exception thrown: Invalid port range 22:1216117714. Valid TCP ports should be between 1-65535 Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-10aff557-b394-416c-b4fa-188d1aea4683 tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Request method failure captured: Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 146 Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mXcK8Z_eY5r53JeMiyMk6QmN5zUJmEXoUtHiN0dEg85xufhCdZm10rxmDYT54CA8bD6WEkRw47V8931K853mRsJRCyRa-7tDgerJq59vgEgD63m9vgfvG7I4UwQfyiN9yQaYip0NvPMlNcSwOPHYi0g23eOhjxg_eQJXLpt3OKE2kY Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 09bc1ff0d5164cabaeb43d17f1c5bddc Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_09bc1ff0d5164cabaeb43d17f1c5bddc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 09bc1ff0d5164cabaeb43d17f1c5bddc Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-358250170-project Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 45645aecc0a14a818d4e44f2bc47b99d Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170-project Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: {"security_group_rule": {"parent_group_id": "d6b99975-e7f0-493f-8f35-cca81c29db0e", "ip_protocol": "tcp", "from_port": 22, "to_port": 1216117714}} Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: exception: Invalid port range 22:1216117714. Valid TCP ports should be between 1-65535 Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd6b99975-e7f0-493f-8f35-cca81c29db0e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1216117714}}} Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1216117714. Valid TCP ports should be between 1-65535 Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1216117714. Valid TCP ports should be between 1-65535 Jul 28 10:33:14.372197 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:14.377038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:14.377038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:14.377038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:14.377038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:14.377038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:14.377038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:33:14.377038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:33:14.377038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1216117714. Valid TCP ports should be between 1-65535 Jul 28 10:33:14.377038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:14.377038 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-10aff557-b394-416c-b4fa-188d1aea4683 tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Returning 400 to user: Invalid port range 22:1216117714. Valid TCP ports should be between 1-65535 {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:14.377038 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-10aff557-b394-416c-b4fa-188d1aea4683 tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.254534 Jul 28 10:33:14.379805 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 273/584] 10.222.0.46 () {60 vars in 1195 bytes} [Thu Jul 28 10:33:14 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 261 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:33:14.389084 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-96d3b788-80ed-42d1-887c-92ff9d1207c5 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:14.396274 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-96d3b788-80ed-42d1-887c-92ff9d1207c5 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] [instance: db2c0d84-51e6-4260-b938-68c81e5d97d2] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:14.476760 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-96d3b788-80ed-42d1-887c-92ff9d1207c5 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b62d1b3544a4f77a6e359a778788176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e39df35a24b9e902b4c3159e154da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:33:14.485096 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-96d3b788-80ed-42d1-887c-92ff9d1207c5 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] 10.222.0.46 "GET /compute/v2.1/servers/db2c0d84-51e6-4260-b938-68c81e5d97d2" status: 200 len: 1224 microversion: 2.1 time: 0.103984 Jul 28 10:33:14.489086 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 274/585] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:33:14 2022] GET /compute/v2.1/servers/db2c0d84-51e6-4260-b938-68c81e5d97d2 => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:33:14.500805 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-21ba0f11-c3f5-44a6-b312-2c55c527e7ed tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Action: 'create', calling method: .version_select at 0x7fa94bc168b0>, body: {"security_group_rule": {"parent_group_id": "9aad4983-be6b-47ac-84a8-8b6f6bdb0a00", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:14.539719 n-d-850468-6 devstack@n-api.service[119463]: DEBUG neutronclient.v2_0.client [None req-21ba0f11-c3f5-44a6-b312-2c55c527e7ed tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9aad4983-be6b-47ac-84a8-8b6f6bdb0a00 does not exist", "detail": ""}} {{(pid=119463) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 10:33:14.540514 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.security_group_api [None req-21ba0f11-c3f5-44a6-b312-2c55c527e7ed tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Neutron security group 9aad4983-be6b-47ac-84a8-8b6f6bdb0a00 not found {{(pid=119463) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 10:33:14.541229 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-21ba0f11-c3f5-44a6-b312-2c55c527e7ed tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] HTTP exception thrown: Security group 9aad4983-be6b-47ac-84a8-8b6f6bdb0a00 does not exist Jul 28 10:33:14.541229 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-6ae66c26-b0ca-453a-bdb1-edf783ff6d7a'] Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-21ba0f11-c3f5-44a6-b312-2c55c527e7ed tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Request method failure captured: Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 138 Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mXcK8Z_eY5r53JeMiyMk6QmN5zUJmEXoUtHiN0dEg85xufhCdZm10rxmDYT54CA8bD6WEkRw47V8931K853mRsJRCyRa-7tDgerJq59vgEgD63m9vgfvG7I4UwQfyiN9yQaYip0NvPMlNcSwOPHYi0g23eOhjxg_eQJXLpt3OKE2kY Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 09bc1ff0d5164cabaeb43d17f1c5bddc Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_09bc1ff0d5164cabaeb43d17f1c5bddc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 09bc1ff0d5164cabaeb43d17f1c5bddc Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-358250170-project Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 45645aecc0a14a818d4e44f2bc47b99d Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170-project Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: {"security_group_rule": {"parent_group_id": "9aad4983-be6b-47ac-84a8-8b6f6bdb0a00", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: exception: Security group 9aad4983-be6b-47ac-84a8-8b6f6bdb0a00 does not exist Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-6ae66c26-b0ca-453a-bdb1-edf783ff6d7a'] Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9aad4983-be6b-47ac-84a8-8b6f6bdb0a00', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 10:33:14.543748 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9aad4983-be6b-47ac-84a8-8b6f6bdb0a00 does not exist Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ae66c26-b0ca-453a-bdb1-edf783ff6d7a'] Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9aad4983-be6b-47ac-84a8-8b6f6bdb0a00 does not exist Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ae66c26-b0ca-453a-bdb1-edf783ff6d7a'] Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9aad4983-be6b-47ac-84a8-8b6f6bdb0a00 does not exist Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ae66c26-b0ca-453a-bdb1-edf783ff6d7a'] Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9aad4983-be6b-47ac-84a8-8b6f6bdb0a00 does not exist Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ae66c26-b0ca-453a-bdb1-edf783ff6d7a'] Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-21ba0f11-c3f5-44a6-b312-2c55c527e7ed tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Returning 404 to user: Security group 9aad4983-be6b-47ac-84a8-8b6f6bdb0a00 does not exist Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-6ae66c26-b0ca-453a-bdb1-edf783ff6d7a'] {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:14.554137 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-21ba0f11-c3f5-44a6-b312-2c55c527e7ed tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.056752 Jul 28 10:33:14.560456 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 275/586] 10.222.0.46 () {60 vars in 1195 bytes} [Thu Jul 28 10:33:14 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:33:14.568888 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8d737198-0b11-41ae-80b7-6c91f92e2b1d tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Calling method '.version_select at 0x7fa94bc16ee0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:14.632715 n-d-850468-6 devstack@n-api.service[119463]: DEBUG neutronclient.v2_0.client [None req-8d737198-0b11-41ae-80b7-6c91f92e2b1d tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule d8707b9c-06be-45a5-bd5e-371c32427986 does not exist", "detail": ""}} {{(pid=119463) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 10:33:14.633514 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.security_group_api [None req-8d737198-0b11-41ae-80b7-6c91f92e2b1d tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Neutron security group rule d8707b9c-06be-45a5-bd5e-371c32427986 not found {{(pid=119463) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 28 10:33:14.634253 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-8d737198-0b11-41ae-80b7-6c91f92e2b1d tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] HTTP exception thrown: Security group rule d8707b9c-06be-45a5-bd5e-371c32427986 does not exist Jul 28 10:33:14.634253 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-1085f463-c071-488b-8d0e-802f0e3d4256'] Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8d737198-0b11-41ae-80b7-6c91f92e2b1d tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Request method failure captured: Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: request: DELETE /compute/v2.1/os-security-group-rules/d8707b9c-06be-45a5-bd5e-371c32427986 HTTP/1.1 Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mXcK8Z_eY5r53JeMiyMk6QmN5zUJmEXoUtHiN0dEg85xufhCdZm10rxmDYT54CA8bD6WEkRw47V8931K853mRsJRCyRa-7tDgerJq59vgEgD63m9vgfvG7I4UwQfyiN9yQaYip0NvPMlNcSwOPHYi0g23eOhjxg_eQJXLpt3OKE2kY Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 09bc1ff0d5164cabaeb43d17f1c5bddc Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/09bc1ff0d5164cabaeb43d17f1c5bddc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_09bc1ff0d5164cabaeb43d17f1c5bddc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 09bc1ff0d5164cabaeb43d17f1c5bddc Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170 Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-358250170-project Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 45645aecc0a14a818d4e44f2bc47b99d Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-358250170-project Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: exception: Security group rule d8707b9c-06be-45a5-bd5e-371c32427986 does not exist Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-1085f463-c071-488b-8d0e-802f0e3d4256'] Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'd8707b9c-06be-45a5-bd5e-371c32427986'} Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 10:33:14.636321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule d8707b9c-06be-45a5-bd5e-371c32427986 does not exist Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1085f463-c071-488b-8d0e-802f0e3d4256'] Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule d8707b9c-06be-45a5-bd5e-371c32427986 does not exist Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1085f463-c071-488b-8d0e-802f0e3d4256'] Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule d8707b9c-06be-45a5-bd5e-371c32427986 does not exist Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1085f463-c071-488b-8d0e-802f0e3d4256'] Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule d8707b9c-06be-45a5-bd5e-371c32427986 does not exist Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1085f463-c071-488b-8d0e-802f0e3d4256'] Jul 28 10:33:14.641392 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:14.645792 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8d737198-0b11-41ae-80b7-6c91f92e2b1d tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Returning 404 to user: Security group rule d8707b9c-06be-45a5-bd5e-371c32427986 does not exist Jul 28 10:33:14.645792 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-1085f463-c071-488b-8d0e-802f0e3d4256'] {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:14.646930 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-8d737198-0b11-41ae-80b7-6c91f92e2b1d tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-group-rules/d8707b9c-06be-45a5-bd5e-371c32427986" status: 404 len: 199 microversion: 2.1 time: 0.090035 Jul 28 10:33:14.647674 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 276/587] 10.222.0.46 () {58 vars in 1287 bytes} [Thu Jul 28 10:33:14 2022] DELETE /compute/v2.1/os-security-group-rules/d8707b9c-06be-45a5-bd5e-371c32427986 => generated 199 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:33:14.662680 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d7e836eb-56b4-49be-ac8b-ac75e0063e91 tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Calling method '.version_select at 0x7fa94bc169d0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:14.767217 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-f0d26fd3-9ac0-4ff4-83ff-ca35f0f4d36f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cd8bde8b06496b84498d77e60ea330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a444daab6bb40e9aa209a6e8b1d1fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:33:14.778835 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f0d26fd3-9ac0-4ff4-83ff-ca35f0f4d36f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] 10.222.0.46 "GET /compute/v2.1/servers/8c87b19a-aa52-43c4-a769-4209684f53a8" status: 200 len: 1315 microversion: 2.1 time: 0.725382 Jul 28 10:33:14.779687 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 312/588] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:33:14 2022] GET /compute/v2.1/servers/8c87b19a-aa52-43c4-a769-4209684f53a8 => generated 1315 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:33:14.809388 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a090a113-24d3-4606-9d6e-d574d4ef0007 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:14.811067 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a090a113-24d3-4606-9d6e-d574d4ef0007 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: 8c87b19a-aa52-43c4-a769-4209684f53a8] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:14.816877 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:14.842260 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a090a113-24d3-4606-9d6e-d574d4ef0007 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:14.843531 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a090a113-24d3-4606-9d6e-d574d4ef0007 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:14.844572 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a090a113-24d3-4606-9d6e-d574d4ef0007 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:14.845166 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a090a113-24d3-4606-9d6e-d574d4ef0007 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:14.904692 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a090a113-24d3-4606-9d6e-d574d4ef0007 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: 8c87b19a-aa52-43c4-a769-4209684f53a8] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:33:15.038058 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a090a113-24d3-4606-9d6e-d574d4ef0007 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: 8c87b19a-aa52-43c4-a769-4209684f53a8] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:33:15.040057 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a090a113-24d3-4606-9d6e-d574d4ef0007 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:15.043770 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a090a113-24d3-4606-9d6e-d574d4ef0007 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:15.044539 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-a090a113-24d3-4606-9d6e-d574d4ef0007 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: 8c87b19a-aa52-43c4-a769-4209684f53a8] instance's host None is down, deleting from database Jul 28 10:33:15.056668 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-a090a113-24d3-4606-9d6e-d574d4ef0007 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: 8c87b19a-aa52-43c4-a769-4209684f53a8] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:33:15.303324 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-a090a113-24d3-4606-9d6e-d574d4ef0007 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: 8c87b19a-aa52-43c4-a769-4209684f53a8] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:33:15.316703 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-a090a113-24d3-4606-9d6e-d574d4ef0007 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: 8c87b19a-aa52-43c4-a769-4209684f53a8] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:33:15.419388 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d7e836eb-56b4-49be-ac8b-ac75e0063e91 tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/d6b99975-e7f0-493f-8f35-cca81c29db0e" status: 202 len: 0 microversion: 2.1 time: 0.761992 Jul 28 10:33:15.419995 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 277/589] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:33:14 2022] DELETE /compute/v2.1/os-security-groups/d6b99975-e7f0-493f-8f35-cca81c29db0e => generated 0 bytes in 764 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:33:15.428638 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-898e10e4-755e-453f-8ff4-22de96c79e83 tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Calling method '.version_select at 0x7fa94bc77310>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:15.879472 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a090a113-24d3-4606-9d6e-d574d4ef0007 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8c87b19a-aa52-43c4-a769-4209684f53a8" status: 204 len: 0 microversion: 2.1 time: 1.076416 Jul 28 10:33:15.881633 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 313/590] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:33:14 2022] DELETE /compute/v2.1/servers/8c87b19a-aa52-43c4-a769-4209684f53a8 => generated 0 bytes in 1081 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 10:33:15.893439 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4dca5a6f-e9d2-4d2f-9184-b1171d15415a tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:15.894730 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-4dca5a6f-e9d2-4d2f-9184-b1171d15415a tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] [instance: db2c0d84-51e6-4260-b938-68c81e5d97d2] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:15.904087 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4dca5a6f-e9d2-4d2f-9184-b1171d15415a tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:15.906514 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4dca5a6f-e9d2-4d2f-9184-b1171d15415a tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:15.907707 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4dca5a6f-e9d2-4d2f-9184-b1171d15415a tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:15.908471 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4dca5a6f-e9d2-4d2f-9184-b1171d15415a tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:15.947518 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4dca5a6f-e9d2-4d2f-9184-b1171d15415a tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:15.948250 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4dca5a6f-e9d2-4d2f-9184-b1171d15415a tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:15.948888 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-4dca5a6f-e9d2-4d2f-9184-b1171d15415a tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lazy-loading 'fault' on Instance uuid db2c0d84-51e6-4260-b938-68c81e5d97d2 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:33:16.323825 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-4dca5a6f-e9d2-4d2f-9184-b1171d15415a tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b62d1b3544a4f77a6e359a778788176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e39df35a24b9e902b4c3159e154da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:33:16.338197 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-4dca5a6f-e9d2-4d2f-9184-b1171d15415a tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] 10.222.0.46 "GET /compute/v2.1/servers/db2c0d84-51e6-4260-b938-68c81e5d97d2" status: 200 len: 1297 microversion: 2.1 time: 0.454654 Jul 28 10:33:16.347535 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 314/591] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:33:15 2022] GET /compute/v2.1/servers/db2c0d84-51e6-4260-b938-68c81e5d97d2 => generated 1297 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:33:16.352658 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e72a7e88-542e-4ddf-afae-780972528a7d tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:16.353127 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-e72a7e88-542e-4ddf-afae-780972528a7d tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: 8c87b19a-aa52-43c4-a769-4209684f53a8] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:16.380899 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e72a7e88-542e-4ddf-afae-780972528a7d tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:16.381349 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e72a7e88-542e-4ddf-afae-780972528a7d tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:16.391039 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e72a7e88-542e-4ddf-afae-780972528a7d tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:16.391779 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e72a7e88-542e-4ddf-afae-780972528a7d tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:16.418924 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-e72a7e88-542e-4ddf-afae-780972528a7d tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] HTTP exception thrown: Instance 8c87b19a-aa52-43c4-a769-4209684f53a8 could not be found. Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e72a7e88-542e-4ddf-afae-780972528a7d tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Request method failure captured: Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/8c87b19a-aa52-43c4-a769-4209684f53a8 HTTP/1.1 Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mXFhX7rVfccH1bvaihQHnmXkVRryMxGZe_uCZA5ARP871BkP-aVXwQK9jb0D8sToTxJZolX2Ks8mBdvMMrlLlMdzshk8uTvrp3uJ3lRps5dR1Rtkt8nr7bfKCgbHGKtMdrOqAMMx4uFZWQuQUxZowhc8IO4YGEQFc2SB9yLzvawUvY Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 6a444daab6bb40e9aa209a6e8b1d1fb0 Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-VolumesAdminNegativeTest-1515595628 Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6a444daab6bb40e9aa209a6e8b1d1fb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6a444daab6bb40e9aa209a6e8b1d1fb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6a444daab6bb40e9aa209a6e8b1d1fb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6a444daab6bb40e9aa209a6e8b1d1fb0", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-VolumesAdminNegativeTest-1515595628 Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 6a444daab6bb40e9aa209a6e8b1d1fb0 Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1515595628 Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-VolumesAdminNegativeTest-1515595628-project Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 00cd8bde8b06496b84498d77e60ea330 Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-VolumesAdminNegativeTest-1515595628-project Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 8c87b19a-aa52-43c4-a769-4209684f53a8 could not be found. Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '8c87b19a-aa52-43c4-a769-4209684f53a8'} Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c87b19a-aa52-43c4-a769-4209684f53a8 could not be found. Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c87b19a-aa52-43c4-a769-4209684f53a8 could not be found. Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:16.421382 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:16.425429 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:16.425429 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:16.425429 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:16.425429 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:33:16.425429 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:33:16.425429 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c87b19a-aa52-43c4-a769-4209684f53a8 could not be found. Jul 28 10:33:16.425429 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:16.428261 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e72a7e88-542e-4ddf-afae-780972528a7d tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Returning 404 to user: Instance 8c87b19a-aa52-43c4-a769-4209684f53a8 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:16.429608 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e72a7e88-542e-4ddf-afae-780972528a7d tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] 10.222.0.46 "GET /compute/v2.1/servers/8c87b19a-aa52-43c4-a769-4209684f53a8" status: 404 len: 111 microversion: 2.1 time: 0.080955 Jul 28 10:33:16.430715 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 315/592] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:33:16 2022] GET /compute/v2.1/servers/8c87b19a-aa52-43c4-a769-4209684f53a8 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:33:16.465742 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fbe69bed-817a-482c-927a-9b10ebba5fba tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:16.469846 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-fbe69bed-817a-482c-927a-9b10ebba5fba tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] [instance: db2c0d84-51e6-4260-b938-68c81e5d97d2] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:16.496652 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fbe69bed-817a-482c-927a-9b10ebba5fba tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:16.497633 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fbe69bed-817a-482c-927a-9b10ebba5fba tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:16.500487 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fbe69bed-817a-482c-927a-9b10ebba5fba tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:16.501397 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fbe69bed-817a-482c-927a-9b10ebba5fba tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:16.556129 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-898e10e4-755e-453f-8ff4-22de96c79e83 tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/0b05fd36-d52f-45f5-9cbb-a29b2d79d7fb" status: 202 len: 0 microversion: 2.1 time: 1.131089 Jul 28 10:33:16.556712 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 278/593] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:33:15 2022] DELETE /compute/v2.1/os-security-groups/0b05fd36-d52f-45f5-9cbb-a29b2d79d7fb => generated 0 bytes in 1132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:33:16.566522 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-dd98b3a3-daac-4d87-b50c-5e8db66ebf6d tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Calling method '.version_select at 0x7fa94bc2a0d0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:16.596268 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-fbe69bed-817a-482c-927a-9b10ebba5fba tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] [instance: db2c0d84-51e6-4260-b938-68c81e5d97d2] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:33:16.730205 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-fbe69bed-817a-482c-927a-9b10ebba5fba tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] [instance: db2c0d84-51e6-4260-b938-68c81e5d97d2] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:33:16.731035 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fbe69bed-817a-482c-927a-9b10ebba5fba tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:16.731481 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fbe69bed-817a-482c-927a-9b10ebba5fba tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:16.731922 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-fbe69bed-817a-482c-927a-9b10ebba5fba tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] [instance: db2c0d84-51e6-4260-b938-68c81e5d97d2] instance's host None is down, deleting from database Jul 28 10:33:16.743106 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-fbe69bed-817a-482c-927a-9b10ebba5fba tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] [instance: db2c0d84-51e6-4260-b938-68c81e5d97d2] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:33:16.951557 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-fbe69bed-817a-482c-927a-9b10ebba5fba tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] [instance: db2c0d84-51e6-4260-b938-68c81e5d97d2] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:33:16.962330 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-fbe69bed-817a-482c-927a-9b10ebba5fba tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] [instance: db2c0d84-51e6-4260-b938-68c81e5d97d2] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:33:17.328452 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-dd98b3a3-daac-4d87-b50c-5e8db66ebf6d tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/c58d92ec-af18-41b6-bc5d-775485ba57c2" status: 202 len: 0 microversion: 2.1 time: 0.767542 Jul 28 10:33:17.332743 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 279/594] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:33:16 2022] DELETE /compute/v2.1/os-security-groups/c58d92ec-af18-41b6-bc5d-775485ba57c2 => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:33:17.367410 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1255518863", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "1919abb0-f185-492d-a78b-1ceacf0f50c1"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:17.416724 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=68,nova_cell0:UPDATE=26,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:17.433377 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-fbe69bed-817a-482c-927a-9b10ebba5fba tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] 10.222.0.46 "DELETE /compute/v2.1/servers/db2c0d84-51e6-4260-b938-68c81e5d97d2" status: 204 len: 0 microversion: 2.1 time: 0.989504 Jul 28 10:33:17.436116 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 316/595] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:33:16 2022] DELETE /compute/v2.1/servers/db2c0d84-51e6-4260-b938-68c81e5d97d2 => generated 0 bytes in 1003 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:33:17.613974 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] validate_networks() for [('1919abb0-f185-492d-a78b-1ceacf0f50c1', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:33:17.858180 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1151286447", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:18.020074 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] validate_networks() for None {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:33:18.973064 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:33:18.973771 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:33:18.974116 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:33:18.974340 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:33:18.979807 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:33:18.996980 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:18.997981 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:18.999254 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:19.000159 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:19.048904 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Getting quotas for project 6a444daab6bb40e9aa209a6e8b1d1fb0. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:33:19.065500 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Getting quotas for user 00cd8bde8b06496b84498d77e60ea330 and project 6a444daab6bb40e9aa209a6e8b1d1fb0. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:33:19.131981 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:33:19.136953 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: e40e4c5b-ded2-424c-8beb-d405e36c9cc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:33:19.296368 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-8b101cab-6fd8-4a31-ae88-6058e845c5f3 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.954816 Jul 28 10:33:19.297040 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 280/596] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:33:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:33:19.314332 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6073b03c-9a7e-40b2-9687-592c200288ca tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Calling method '.version_select at 0x7fa94bce8f70>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:19.713487 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:33:19.715119 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:33:19.716212 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:33:19.716835 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:33:19.717683 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:33:19.731809 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:19.732695 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:19.733838 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:19.734510 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:19.782327 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Getting quotas for project 6d170f010f89462eb4e3a8737e0a3884. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:33:19.823387 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Getting quotas for user 0b7a94c03cb2412db270ae02387e4f22 and project 6d170f010f89462eb4e3a8737e0a3884. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:33:19.863342 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:33:19.866185 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] [instance: e3085b1e-f8d0-49a6-a83a-0d9bdb386622] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:33:19.968758 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6073b03c-9a7e-40b2-9687-592c200288ca tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/29c065f5-2507-4f4a-864b-ce3ea71d91bc" status: 202 len: 0 microversion: 2.1 time: 0.668991 Jul 28 10:33:19.970307 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 281/597] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:33:19 2022] DELETE /compute/v2.1/os-security-groups/29c065f5-2507-4f4a-864b-ce3ea71d91bc => generated 0 bytes in 672 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:33:19.979478 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ef5bac63-af27-4add-a48a-ca1b36001978 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:19.981584 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ef5bac63-af27-4add-a48a-ca1b36001978 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] [instance: db2c0d84-51e6-4260-b938-68c81e5d97d2] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:19.990084 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b1f4497c-d7ee-4791-bad9-baeae8caebdb tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.549108 Jul 28 10:33:19.991103 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 317/598] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:33:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:33:19.997222 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-867f9a7f-a5e4-43eb-a5a5-90d0f8042b12 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:19.998388 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-867f9a7f-a5e4-43eb-a5a5-90d0f8042b12 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: e40e4c5b-ded2-424c-8beb-d405e36c9cc5] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:20.001822 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ef5bac63-af27-4add-a48a-ca1b36001978 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:20.003756 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ef5bac63-af27-4add-a48a-ca1b36001978 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:20.005028 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ef5bac63-af27-4add-a48a-ca1b36001978 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:20.006635 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ef5bac63-af27-4add-a48a-ca1b36001978 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:20.011388 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-867f9a7f-a5e4-43eb-a5a5-90d0f8042b12 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:20.012239 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-867f9a7f-a5e4-43eb-a5a5-90d0f8042b12 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:20.013204 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-867f9a7f-a5e4-43eb-a5a5-90d0f8042b12 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:20.013841 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-867f9a7f-a5e4-43eb-a5a5-90d0f8042b12 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:20.042917 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-ef5bac63-af27-4add-a48a-ca1b36001978 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] HTTP exception thrown: Instance db2c0d84-51e6-4260-b938-68c81e5d97d2 could not be found. Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ef5bac63-af27-4add-a48a-ca1b36001978 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Request method failure captured: Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/db2c0d84-51e6-4260-b938-68c81e5d97d2 HTTP/1.1 Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mXnVD1R2EmtLcqXqhka9ISJPJurL9HkKdmDXLQfLZ6J1-eQpEnsFnuzD7wK-eZdd6DYYdHFWEVCSTLKpTgrAJn4otSVVvanRfgTqnBBsFjpHlb7F3x75DNu7b_RbV8bscDWVRUAL6Acip7m4qi4TNAlJLYxdQlOmqO9FEphyiNza6c Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: e60e39df35a24b9e902b4c3159e154da Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1522447191 Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e60e39df35a24b9e902b4c3159e154da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e60e39df35a24b9e902b4c3159e154da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e60e39df35a24b9e902b4c3159e154da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e60e39df35a24b9e902b4c3159e154da", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1522447191 Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: e60e39df35a24b9e902b4c3159e154da Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1522447191 Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-FloatingIPsAssociationTestJSON-1522447191-project Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 7b62d1b3544a4f77a6e359a778788176 Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1522447191-project Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance db2c0d84-51e6-4260-b938-68c81e5d97d2 could not be found. Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'db2c0d84-51e6-4260-b938-68c81e5d97d2'} Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db2c0d84-51e6-4260-b938-68c81e5d97d2 could not be found. Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db2c0d84-51e6-4260-b938-68c81e5d97d2 could not be found. Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:20.048753 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:20.053071 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:20.053071 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:20.053071 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:20.053071 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:20.053071 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:33:20.053071 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:33:20.053071 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db2c0d84-51e6-4260-b938-68c81e5d97d2 could not be found. Jul 28 10:33:20.053071 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:20.054368 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ef5bac63-af27-4add-a48a-ca1b36001978 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] Returning 404 to user: Instance db2c0d84-51e6-4260-b938-68c81e5d97d2 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:20.055183 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ef5bac63-af27-4add-a48a-ca1b36001978 tempest-FloatingIPsAssociationTestJSON-1522447191 tempest-FloatingIPsAssociationTestJSON-1522447191-project] 10.222.0.46 "GET /compute/v2.1/servers/db2c0d84-51e6-4260-b938-68c81e5d97d2" status: 404 len: 111 microversion: 2.1 time: 0.083505 Jul 28 10:33:20.056556 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 282/599] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:33:19 2022] GET /compute/v2.1/servers/db2c0d84-51e6-4260-b938-68c81e5d97d2 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:33:20.066278 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-76f7a434-24fe-4e52-b2ab-bdd434ffa912 tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] Calling method '.version_select at 0x7fa94bcdfca0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:20.109647 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-867f9a7f-a5e4-43eb-a5a5-90d0f8042b12 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:20.110144 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-867f9a7f-a5e4-43eb-a5a5-90d0f8042b12 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:20.110623 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-867f9a7f-a5e4-43eb-a5a5-90d0f8042b12 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lazy-loading 'fault' on Instance uuid e40e4c5b-ded2-424c-8beb-d405e36c9cc5 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:33:20.490693 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-867f9a7f-a5e4-43eb-a5a5-90d0f8042b12 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cd8bde8b06496b84498d77e60ea330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a444daab6bb40e9aa209a6e8b1d1fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:33:20.511500 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-867f9a7f-a5e4-43eb-a5a5-90d0f8042b12 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] 10.222.0.46 "GET /compute/v2.1/servers/e40e4c5b-ded2-424c-8beb-d405e36c9cc5" status: 200 len: 1291 microversion: 2.1 time: 0.519087 Jul 28 10:33:20.512580 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 318/600] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:33:19 2022] GET /compute/v2.1/servers/e40e4c5b-ded2-424c-8beb-d405e36c9cc5 => generated 1291 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:33:20.519839 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-52f6e8e3-9f61-411b-8b60-6699af535b39 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:20.528780 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-52f6e8e3-9f61-411b-8b60-6699af535b39 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] [instance: e3085b1e-f8d0-49a6-a83a-0d9bdb386622] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:20.542049 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-52f6e8e3-9f61-411b-8b60-6699af535b39 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:20.542618 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-52f6e8e3-9f61-411b-8b60-6699af535b39 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:20.550608 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-52f6e8e3-9f61-411b-8b60-6699af535b39 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:20.551248 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-52f6e8e3-9f61-411b-8b60-6699af535b39 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:20.628404 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-52f6e8e3-9f61-411b-8b60-6699af535b39 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:20.632204 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-52f6e8e3-9f61-411b-8b60-6699af535b39 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:20.633784 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-52f6e8e3-9f61-411b-8b60-6699af535b39 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lazy-loading 'fault' on Instance uuid e3085b1e-f8d0-49a6-a83a-0d9bdb386622 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:33:20.912510 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-52f6e8e3-9f61-411b-8b60-6699af535b39 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7a94c03cb2412db270ae02387e4f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d170f010f89462eb4e3a8737e0a3884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:33:20.926942 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-52f6e8e3-9f61-411b-8b60-6699af535b39 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] 10.222.0.46 "GET /compute/v2.1/servers/e3085b1e-f8d0-49a6-a83a-0d9bdb386622" status: 200 len: 1290 microversion: 2.1 time: 0.409749 Jul 28 10:33:20.927969 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 319/601] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:33:20 2022] GET /compute/v2.1/servers/e3085b1e-f8d0-49a6-a83a-0d9bdb386622 => generated 1290 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:33:21.535586 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4c6574ce-8d2c-4196-bcb3-b40c20f80eb5 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:21.536581 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-4c6574ce-8d2c-4196-bcb3-b40c20f80eb5 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: e40e4c5b-ded2-424c-8beb-d405e36c9cc5] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:21.544882 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4c6574ce-8d2c-4196-bcb3-b40c20f80eb5 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:21.545337 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4c6574ce-8d2c-4196-bcb3-b40c20f80eb5 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:21.546693 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4c6574ce-8d2c-4196-bcb3-b40c20f80eb5 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:21.547205 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4c6574ce-8d2c-4196-bcb3-b40c20f80eb5 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:21.674661 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4c6574ce-8d2c-4196-bcb3-b40c20f80eb5 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:21.675358 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4c6574ce-8d2c-4196-bcb3-b40c20f80eb5 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:21.675989 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-4c6574ce-8d2c-4196-bcb3-b40c20f80eb5 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lazy-loading 'fault' on Instance uuid e40e4c5b-ded2-424c-8beb-d405e36c9cc5 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:33:21.712939 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-76f7a434-24fe-4e52-b2ab-bdd434ffa912 tempest-SecurityGroupRulesNegativeTestJSON-358250170 tempest-SecurityGroupRulesNegativeTestJSON-358250170-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/2d460aab-6dfd-4117-a68c-c7e5ab3356e7" status: 202 len: 0 microversion: 2.1 time: 1.655203 Jul 28 10:33:21.713504 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 283/602] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:33:20 2022] DELETE /compute/v2.1/os-security-groups/2d460aab-6dfd-4117-a68c-c7e5ab3356e7 => generated 0 bytes in 1656 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:33:21.952840 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b20c3f95-3f53-4c47-a6dd-b5b0d19a8e0b tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:21.953450 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b20c3f95-3f53-4c47-a6dd-b5b0d19a8e0b tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] [instance: e3085b1e-f8d0-49a6-a83a-0d9bdb386622] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:21.964752 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b20c3f95-3f53-4c47-a6dd-b5b0d19a8e0b tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:21.965203 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b20c3f95-3f53-4c47-a6dd-b5b0d19a8e0b tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:21.974195 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b20c3f95-3f53-4c47-a6dd-b5b0d19a8e0b tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:21.974795 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b20c3f95-3f53-4c47-a6dd-b5b0d19a8e0b tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:21.989720 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-4c6574ce-8d2c-4196-bcb3-b40c20f80eb5 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cd8bde8b06496b84498d77e60ea330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a444daab6bb40e9aa209a6e8b1d1fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:33:21.997840 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-4c6574ce-8d2c-4196-bcb3-b40c20f80eb5 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] 10.222.0.46 "GET /compute/v2.1/servers/e40e4c5b-ded2-424c-8beb-d405e36c9cc5" status: 200 len: 1291 microversion: 2.1 time: 0.466335 Jul 28 10:33:22.005685 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 320/603] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:33:21 2022] GET /compute/v2.1/servers/e40e4c5b-ded2-424c-8beb-d405e36c9cc5 => generated 1291 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:33:22.027489 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c155cb3a-e8a7-4b20-bdbf-913b316c5d0f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:22.029267 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c155cb3a-e8a7-4b20-bdbf-913b316c5d0f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: e40e4c5b-ded2-424c-8beb-d405e36c9cc5] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:22.047942 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c155cb3a-e8a7-4b20-bdbf-913b316c5d0f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:22.048398 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c155cb3a-e8a7-4b20-bdbf-913b316c5d0f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:22.049176 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c155cb3a-e8a7-4b20-bdbf-913b316c5d0f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:22.049611 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c155cb3a-e8a7-4b20-bdbf-913b316c5d0f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:22.076363 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b20c3f95-3f53-4c47-a6dd-b5b0d19a8e0b tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:22.077420 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b20c3f95-3f53-4c47-a6dd-b5b0d19a8e0b tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:22.078199 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-b20c3f95-3f53-4c47-a6dd-b5b0d19a8e0b tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lazy-loading 'fault' on Instance uuid e3085b1e-f8d0-49a6-a83a-0d9bdb386622 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:33:22.123831 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c155cb3a-e8a7-4b20-bdbf-913b316c5d0f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: e40e4c5b-ded2-424c-8beb-d405e36c9cc5] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:33:22.231936 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c155cb3a-e8a7-4b20-bdbf-913b316c5d0f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: e40e4c5b-ded2-424c-8beb-d405e36c9cc5] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:33:22.233612 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c155cb3a-e8a7-4b20-bdbf-913b316c5d0f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:22.234281 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c155cb3a-e8a7-4b20-bdbf-913b316c5d0f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:22.234883 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-c155cb3a-e8a7-4b20-bdbf-913b316c5d0f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: e40e4c5b-ded2-424c-8beb-d405e36c9cc5] instance's host None is down, deleting from database Jul 28 10:33:22.243071 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-c155cb3a-e8a7-4b20-bdbf-913b316c5d0f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: e40e4c5b-ded2-424c-8beb-d405e36c9cc5] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:33:22.285169 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-b20c3f95-3f53-4c47-a6dd-b5b0d19a8e0b tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7a94c03cb2412db270ae02387e4f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d170f010f89462eb4e3a8737e0a3884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:33:22.300362 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b20c3f95-3f53-4c47-a6dd-b5b0d19a8e0b tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] 10.222.0.46 "GET /compute/v2.1/servers/e3085b1e-f8d0-49a6-a83a-0d9bdb386622" status: 200 len: 1290 microversion: 2.1 time: 0.351248 Jul 28 10:33:22.303070 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 284/604] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:33:21 2022] GET /compute/v2.1/servers/e3085b1e-f8d0-49a6-a83a-0d9bdb386622 => generated 1290 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:33:22.329761 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-57053d0e-423f-4499-b423-5ee24c1cfda8 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:22.330310 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-57053d0e-423f-4499-b423-5ee24c1cfda8 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] [instance: e3085b1e-f8d0-49a6-a83a-0d9bdb386622] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:22.344394 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-57053d0e-423f-4499-b423-5ee24c1cfda8 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:22.344841 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-57053d0e-423f-4499-b423-5ee24c1cfda8 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:22.345626 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-57053d0e-423f-4499-b423-5ee24c1cfda8 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:22.346109 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-57053d0e-423f-4499-b423-5ee24c1cfda8 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:22.403160 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-57053d0e-423f-4499-b423-5ee24c1cfda8 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] [instance: e3085b1e-f8d0-49a6-a83a-0d9bdb386622] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:33:22.579402 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-57053d0e-423f-4499-b423-5ee24c1cfda8 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] [instance: e3085b1e-f8d0-49a6-a83a-0d9bdb386622] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:33:22.580243 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-57053d0e-423f-4499-b423-5ee24c1cfda8 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:22.580699 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-57053d0e-423f-4499-b423-5ee24c1cfda8 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:22.581142 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-57053d0e-423f-4499-b423-5ee24c1cfda8 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] [instance: e3085b1e-f8d0-49a6-a83a-0d9bdb386622] instance's host None is down, deleting from database Jul 28 10:33:22.585165 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-57053d0e-423f-4499-b423-5ee24c1cfda8 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] [instance: e3085b1e-f8d0-49a6-a83a-0d9bdb386622] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:33:22.694905 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-57053d0e-423f-4499-b423-5ee24c1cfda8 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] [instance: e3085b1e-f8d0-49a6-a83a-0d9bdb386622] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:33:22.704067 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-57053d0e-423f-4499-b423-5ee24c1cfda8 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] [instance: e3085b1e-f8d0-49a6-a83a-0d9bdb386622] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:33:22.740336 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-c155cb3a-e8a7-4b20-bdbf-913b316c5d0f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: e40e4c5b-ded2-424c-8beb-d405e36c9cc5] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:33:22.752623 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-c155cb3a-e8a7-4b20-bdbf-913b316c5d0f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: e40e4c5b-ded2-424c-8beb-d405e36c9cc5] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:33:23.096953 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c155cb3a-e8a7-4b20-bdbf-913b316c5d0f tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e40e4c5b-ded2-424c-8beb-d405e36c9cc5" status: 204 len: 0 microversion: 2.1 time: 1.073081 Jul 28 10:33:23.098773 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 321/605] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:33:22 2022] DELETE /compute/v2.1/servers/e40e4c5b-ded2-424c-8beb-d405e36c9cc5 => generated 0 bytes in 1075 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 10:33:23.108647 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1ebdb8f3-20b9-4d60-af65-ba1c2aafbe47 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:23.109546 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-1ebdb8f3-20b9-4d60-af65-ba1c2aafbe47 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] [instance: e40e4c5b-ded2-424c-8beb-d405e36c9cc5] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:23.127700 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1ebdb8f3-20b9-4d60-af65-ba1c2aafbe47 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:23.130296 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1ebdb8f3-20b9-4d60-af65-ba1c2aafbe47 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:23.132176 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1ebdb8f3-20b9-4d60-af65-ba1c2aafbe47 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:23.132867 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1ebdb8f3-20b9-4d60-af65-ba1c2aafbe47 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:23.158043 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-57053d0e-423f-4499-b423-5ee24c1cfda8 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e3085b1e-f8d0-49a6-a83a-0d9bdb386622" status: 204 len: 0 microversion: 2.1 time: 0.835349 Jul 28 10:33:23.162512 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 285/606] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:33:22 2022] DELETE /compute/v2.1/servers/e3085b1e-f8d0-49a6-a83a-0d9bdb386622 => generated 0 bytes in 838 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 10:33:23.169139 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-1ebdb8f3-20b9-4d60-af65-ba1c2aafbe47 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] HTTP exception thrown: Instance e40e4c5b-ded2-424c-8beb-d405e36c9cc5 could not be found. Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1ebdb8f3-20b9-4d60-af65-ba1c2aafbe47 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Request method failure captured: Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/e40e4c5b-ded2-424c-8beb-d405e36c9cc5 HTTP/1.1 Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mXFhX7rVfccH1bvaihQHnmXkVRryMxGZe_uCZA5ARP871BkP-aVXwQK9jb0D8sToTxJZolX2Ks8mBdvMMrlLlMdzshk8uTvrp3uJ3lRps5dR1Rtkt8nr7bfKCgbHGKtMdrOqAMMx4uFZWQuQUxZowhc8IO4YGEQFc2SB9yLzvawUvY Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 6a444daab6bb40e9aa209a6e8b1d1fb0 Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-VolumesAdminNegativeTest-1515595628 Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6a444daab6bb40e9aa209a6e8b1d1fb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6a444daab6bb40e9aa209a6e8b1d1fb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6a444daab6bb40e9aa209a6e8b1d1fb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6a444daab6bb40e9aa209a6e8b1d1fb0", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-VolumesAdminNegativeTest-1515595628 Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 6a444daab6bb40e9aa209a6e8b1d1fb0 Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1515595628 Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-VolumesAdminNegativeTest-1515595628-project Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 00cd8bde8b06496b84498d77e60ea330 Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-VolumesAdminNegativeTest-1515595628-project Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance e40e4c5b-ded2-424c-8beb-d405e36c9cc5 could not be found. Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'e40e4c5b-ded2-424c-8beb-d405e36c9cc5'} Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e40e4c5b-ded2-424c-8beb-d405e36c9cc5 could not be found. Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e40e4c5b-ded2-424c-8beb-d405e36c9cc5 could not be found. Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:23.170755 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:23.175302 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:23.175302 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:23.175302 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:23.175302 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:33:23.175302 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:33:23.175302 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e40e4c5b-ded2-424c-8beb-d405e36c9cc5 could not be found. Jul 28 10:33:23.175302 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:23.175824 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3ab4b5c4-a2ff-4730-b0ed-a0c868395992 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:23.178115 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1ebdb8f3-20b9-4d60-af65-ba1c2aafbe47 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Returning 404 to user: Instance e40e4c5b-ded2-424c-8beb-d405e36c9cc5 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:23.178941 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3ab4b5c4-a2ff-4730-b0ed-a0c868395992 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] [instance: e3085b1e-f8d0-49a6-a83a-0d9bdb386622] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:23.184092 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1ebdb8f3-20b9-4d60-af65-ba1c2aafbe47 tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] 10.222.0.46 "GET /compute/v2.1/servers/e40e4c5b-ded2-424c-8beb-d405e36c9cc5" status: 404 len: 111 microversion: 2.1 time: 0.079623 Jul 28 10:33:23.185170 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 322/607] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:33:23 2022] GET /compute/v2.1/servers/e40e4c5b-ded2-424c-8beb-d405e36c9cc5 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:33:23.191715 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3ab4b5c4-a2ff-4730-b0ed-a0c868395992 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:23.192180 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3ab4b5c4-a2ff-4730-b0ed-a0c868395992 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:23.192979 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3ab4b5c4-a2ff-4730-b0ed-a0c868395992 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:23.193423 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3ab4b5c4-a2ff-4730-b0ed-a0c868395992 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:23.206300 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4bae13cb-37e5-481f-8dec-77f043971ade tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] Calling method '.version_select at 0x7fa94bc39040>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:23.238251 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-3ab4b5c4-a2ff-4730-b0ed-a0c868395992 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] HTTP exception thrown: Instance e3085b1e-f8d0-49a6-a83a-0d9bdb386622 could not be found. Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3ab4b5c4-a2ff-4730-b0ed-a0c868395992 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Request method failure captured: Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/e3085b1e-f8d0-49a6-a83a-0d9bdb386622 HTTP/1.1 Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mXrSCfNqX9VjGsI5nF43uS0omza1n8798n8wpS62FE-TyiTQBj6Z3H0KSJ9YRFYdf_o-n_FVC2YQxDRMTMBysJFsu1fYiiRxtfXvG9rfKLF-LviIRKQze3UwoiiN77zp950FcJLa9upzVWdbpZ_dmwA8lzS4ZpfPIu0DdU_aT9a01s Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 6d170f010f89462eb4e3a8737e0a3884 Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServersOnMultiNodesTest-1816463188 Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d170f010f89462eb4e3a8737e0a3884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d170f010f89462eb4e3a8737e0a3884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d170f010f89462eb4e3a8737e0a3884"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d170f010f89462eb4e3a8737e0a3884", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServersOnMultiNodesTest-1816463188 Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 6d170f010f89462eb4e3a8737e0a3884 Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1816463188 Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServersOnMultiNodesTest-1816463188-project Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 0b7a94c03cb2412db270ae02387e4f22 Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServersOnMultiNodesTest-1816463188-project Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance e3085b1e-f8d0-49a6-a83a-0d9bdb386622 could not be found. Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'e3085b1e-f8d0-49a6-a83a-0d9bdb386622'} Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3085b1e-f8d0-49a6-a83a-0d9bdb386622 could not be found. Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3085b1e-f8d0-49a6-a83a-0d9bdb386622 could not be found. Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:23.250548 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:23.255036 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:23.255036 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:23.255036 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:23.255036 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:33:23.255036 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:33:23.255036 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3085b1e-f8d0-49a6-a83a-0d9bdb386622 could not be found. Jul 28 10:33:23.255036 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:23.257319 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3ab4b5c4-a2ff-4730-b0ed-a0c868395992 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] Returning 404 to user: Instance e3085b1e-f8d0-49a6-a83a-0d9bdb386622 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:23.261207 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3ab4b5c4-a2ff-4730-b0ed-a0c868395992 tempest-ServersOnMultiNodesTest-1816463188 tempest-ServersOnMultiNodesTest-1816463188-project] 10.222.0.46 "GET /compute/v2.1/servers/e3085b1e-f8d0-49a6-a83a-0d9bdb386622" status: 404 len: 111 microversion: 2.1 time: 0.097293 Jul 28 10:33:23.261400 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-4bae13cb-37e5-481f-8dec-77f043971ade tempest-VolumesAdminNegativeTest-1515595628 tempest-VolumesAdminNegativeTest-1515595628-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2141582043" status: 202 len: 0 microversion: 2.1 time: 0.060681 Jul 28 10:33:23.262197 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 323/608] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Jul 28 10:33:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2141582043 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:33:23.267484 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 286/609] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:33:23 2022] GET /compute/v2.1/servers/e3085b1e-f8d0-49a6-a83a-0d9bdb386622 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:33:24.586625 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-442642094", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "a480176f-430c-4f94-be15-0432408980cb"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:24.719897 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] validate_networks() for [('a480176f-430c-4f94-be15-0432408980cb', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:33:28.515862 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:33:28.516457 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:33:28.516457 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:33:28.518187 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:33:28.518648 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:33:28.553669 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:28.557012 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:28.560277 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:28.566630 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:28.618424 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Getting quotas for project 58ca977f82924ab49d534a3410458a76. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:33:28.625368 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Getting quotas for user e53795f71cc04327bf21947c228b00d9 and project 58ca977f82924ab49d534a3410458a76. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:33:28.647886 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:33:28.652821 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] [instance: fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:33:28.742348 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7c7a083e-754b-4207-8f0c-f5afc3e3dad6 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.514364 Jul 28 10:33:28.745076 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 324/610] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:33:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 4518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:33:28.754548 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f724fa2e-8ce4-4445-a738-48c553dadd69 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:28.755165 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f724fa2e-8ce4-4445-a738-48c553dadd69 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] [instance: fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:28.925926 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-f724fa2e-8ce4-4445-a738-48c553dadd69 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53795f71cc04327bf21947c228b00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ca977f82924ab49d534a3410458a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:33:28.937285 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f724fa2e-8ce4-4445-a738-48c553dadd69 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] 10.222.0.46 "GET /compute/v2.1/servers/fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8" status: 200 len: 1224 microversion: 2.1 time: 0.186504 Jul 28 10:33:28.937895 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 287/611] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:33:28 2022] GET /compute/v2.1/servers/fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8 => generated 1224 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:33:29.973504 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4ac50d39-84e1-4069-bc60-8d526c5eeb89 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:29.975265 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-4ac50d39-84e1-4069-bc60-8d526c5eeb89 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] [instance: fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:29.980338 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:30.006637 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4ac50d39-84e1-4069-bc60-8d526c5eeb89 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:30.011120 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4ac50d39-84e1-4069-bc60-8d526c5eeb89 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:30.020282 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-23289697-7cb4-48a5-a09e-9844d270cede tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Action: 'create', calling method: .version_select at 0x7fa94bd96dc0>, body: {"keypair": {"name": "tempest-keypair-496270188", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCimz4QvRbIHwWTLFlKoH6L4F1sf0xxvqzzKpbApHv7U9vgHawsCSu2x/pxGjenmhjq77J1h3MCFI5CUXdn+leY3UWsM3Gtv5ayCkmY69dOWFyf6gbUbJKS4L0KKp0eJmg=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:30.040511 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4ac50d39-84e1-4069-bc60-8d526c5eeb89 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:30.050185 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4ac50d39-84e1-4069-bc60-8d526c5eeb89 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:30.112421 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-23289697-7cb4-48a5-a09e-9844d270cede tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Getting quotas for project 464094be29ab46e0b9370341079127ad. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:33:30.136361 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-23289697-7cb4-48a5-a09e-9844d270cede tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Getting quotas for user ff1f774d5c764554ae3f880a7d4aa2ef and project 464094be29ab46e0b9370341079127ad. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:33:30.199023 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4ac50d39-84e1-4069-bc60-8d526c5eeb89 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:30.202050 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4ac50d39-84e1-4069-bc60-8d526c5eeb89 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:30.206049 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-4ac50d39-84e1-4069-bc60-8d526c5eeb89 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lazy-loading 'fault' on Instance uuid fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:33:30.231404 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-23289697-7cb4-48a5-a09e-9844d270cede tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.169828 Jul 28 10:33:30.235814 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 325/612] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:33:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:33:30.308643 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-4ac50d39-84e1-4069-bc60-8d526c5eeb89 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53795f71cc04327bf21947c228b00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ca977f82924ab49d534a3410458a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:33:30.323720 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-4ac50d39-84e1-4069-bc60-8d526c5eeb89 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] 10.222.0.46 "GET /compute/v2.1/servers/fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8" status: 200 len: 1297 microversion: 2.1 time: 0.368273 Jul 28 10:33:30.331051 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 288/613] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:33:29 2022] GET /compute/v2.1/servers/fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8 => generated 1297 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:33:30.354480 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-49d98f0b-60ff-47ea-9d98-b74b874ff341 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:30.355556 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-49d98f0b-60ff-47ea-9d98-b74b874ff341 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] [instance: fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:30.367603 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-49d98f0b-60ff-47ea-9d98-b74b874ff341 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:30.371226 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-49d98f0b-60ff-47ea-9d98-b74b874ff341 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:30.374294 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-49d98f0b-60ff-47ea-9d98-b74b874ff341 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:30.380210 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-49d98f0b-60ff-47ea-9d98-b74b874ff341 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:30.449129 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-49d98f0b-60ff-47ea-9d98-b74b874ff341 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] [instance: fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:33:30.582223 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=3,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:30.588290 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-49d98f0b-60ff-47ea-9d98-b74b874ff341 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] [instance: fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:33:30.589544 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-49d98f0b-60ff-47ea-9d98-b74b874ff341 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:30.590182 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-49d98f0b-60ff-47ea-9d98-b74b874ff341 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:30.590788 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-49d98f0b-60ff-47ea-9d98-b74b874ff341 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] [instance: fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8] instance's host None is down, deleting from database Jul 28 10:33:30.595832 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-49d98f0b-60ff-47ea-9d98-b74b874ff341 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] [instance: fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:33:30.940685 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-49d98f0b-60ff-47ea-9d98-b74b874ff341 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] [instance: fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:33:30.952864 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-49d98f0b-60ff-47ea-9d98-b74b874ff341 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] [instance: fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:33:31.066865 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:UPDATE=22,nova_cell0:DELETE=4,nova_cell0:SELECT=70,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:31.307707 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-49d98f0b-60ff-47ea-9d98-b74b874ff341 tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8" status: 204 len: 0 microversion: 2.1 time: 0.957559 Jul 28 10:33:31.313915 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 326/614] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:33:30 2022] DELETE /compute/v2.1/servers/fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8 => generated 0 bytes in 959 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:33:31.319179 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3c94869e-0295-4df3-bc50-1b2804fc695e tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:31.320349 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3c94869e-0295-4df3-bc50-1b2804fc695e tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] [instance: fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:31.334175 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3c94869e-0295-4df3-bc50-1b2804fc695e tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:31.334989 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3c94869e-0295-4df3-bc50-1b2804fc695e tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:31.336045 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3c94869e-0295-4df3-bc50-1b2804fc695e tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:31.336663 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3c94869e-0295-4df3-bc50-1b2804fc695e tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:31.367347 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-3c94869e-0295-4df3-bc50-1b2804fc695e tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] HTTP exception thrown: Instance fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8 could not be found. Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3c94869e-0295-4df3-bc50-1b2804fc695e tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Request method failure captured: Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8 HTTP/1.1 Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mXzDan3miVxmuVCoA68iyILwUEiCMwGhwrJK2ObKXYUyuDQQEsRB3qx53yS8AN5Do9fWgDmcrxAuAZVWMrclEiBYkL2ZV7zx7epFfJ1zElnmwvm0v3xhszVtgki_b5CnkMtkWxuKM5JyTRpwi8arQO7fs_JEl6Ep4UCgQ72iW0s3K0 Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 58ca977f82924ab49d534a3410458a76 Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1333296024 Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/58ca977f82924ab49d534a3410458a76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/58ca977f82924ab49d534a3410458a76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/58ca977f82924ab49d534a3410458a76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_58ca977f82924ab49d534a3410458a76", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1333296024 Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 58ca977f82924ab49d534a3410458a76 Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1333296024 Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ImagesOneServerNegativeTestJSON-1333296024-project Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: e53795f71cc04327bf21947c228b00d9 Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1333296024-project Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8 could not be found. Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8'} Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8 could not be found. Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8 could not be found. Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:31.369289 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:31.373692 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:31.373692 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:31.373692 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:31.373692 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:31.373692 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:33:31.373692 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:33:31.373692 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8 could not be found. Jul 28 10:33:31.373692 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:31.375890 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3c94869e-0295-4df3-bc50-1b2804fc695e tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] Returning 404 to user: Instance fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:31.376924 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3c94869e-0295-4df3-bc50-1b2804fc695e tempest-ImagesOneServerNegativeTestJSON-1333296024 tempest-ImagesOneServerNegativeTestJSON-1333296024-project] 10.222.0.46 "GET /compute/v2.1/servers/fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8" status: 404 len: 111 microversion: 2.1 time: 0.062499 Jul 28 10:33:31.378456 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 289/615] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:33:31 2022] GET /compute/v2.1/servers/fa95d68f-b3d2-41eb-bb9f-3d7df43ddea8 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:33:38.871825 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1633257353", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "4c42d355-6655-4ecf-a3b7-01059b3a1308"}], "security_groups": [{"name": "tempest-securitygroup--388114953"}], "key_name": "tempest-keypair-496270188", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:38.947986 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=6 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:39.659019 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] validate_networks() for [('4c42d355-6655-4ecf-a3b7-01059b3a1308', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:33:40.175339 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=24 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:41.306857 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=12,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:43.242848 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Getting quotas for project 464094be29ab46e0b9370341079127ad. Resources: dict_keys(['metadata_items']) {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:33:43.259285 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Getting quotas for user ff1f774d5c764554ae3f880a7d4aa2ef and project 464094be29ab46e0b9370341079127ad. Resources: dict_keys(['metadata_items']) {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:33:43.310931 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:33:43.312494 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:33:43.313165 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:33:43.313785 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:33:43.314866 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:33:43.336580 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:43.348044 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:43.351892 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:43.352362 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:43.421738 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Getting quotas for project 464094be29ab46e0b9370341079127ad. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:33:43.431129 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Getting quotas for user ff1f774d5c764554ae3f880a7d4aa2ef and project 464094be29ab46e0b9370341079127ad. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:33:43.458229 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:33:43.476763 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] [instance: 522fb2d0-fa4c-43bd-896c-34c9de7fa081] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:33:43.574745 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-54a5b330-6d58-40d5-8830-e1defb3c095e tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.710716 Jul 28 10:33:43.576411 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 327/616] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:33:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 4713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:33:43.587205 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-acc78c19-85b2-42a1-84ed-a6a682c1fccf tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:43.587810 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-acc78c19-85b2-42a1-84ed-a6a682c1fccf tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] [instance: 522fb2d0-fa4c-43bd-896c-34c9de7fa081] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:43.599064 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=16 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:43.599916 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:43.600429 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=50,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:44.067592 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-acc78c19-85b2-42a1-84ed-a6a682c1fccf tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1f774d5c764554ae3f880a7d4aa2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464094be29ab46e0b9370341079127ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:33:44.103977 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-acc78c19-85b2-42a1-84ed-a6a682c1fccf tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] 10.222.0.46 "GET /compute/v2.1/servers/522fb2d0-fa4c-43bd-896c-34c9de7fa081" status: 200 len: 1269 microversion: 2.1 time: 0.520603 Jul 28 10:33:44.110171 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 290/617] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:33:43 2022] GET /compute/v2.1/servers/522fb2d0-fa4c-43bd-896c-34c9de7fa081 => generated 1269 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:33:45.142559 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c06e43f7-2129-4903-9312-564ea20d6416 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:45.143160 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c06e43f7-2129-4903-9312-564ea20d6416 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] [instance: 522fb2d0-fa4c-43bd-896c-34c9de7fa081] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:45.159638 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c06e43f7-2129-4903-9312-564ea20d6416 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:45.161022 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c06e43f7-2129-4903-9312-564ea20d6416 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:45.162284 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c06e43f7-2129-4903-9312-564ea20d6416 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:45.162918 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c06e43f7-2129-4903-9312-564ea20d6416 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:45.290672 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c06e43f7-2129-4903-9312-564ea20d6416 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:45.291688 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c06e43f7-2129-4903-9312-564ea20d6416 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:45.295126 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-c06e43f7-2129-4903-9312-564ea20d6416 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lazy-loading 'fault' on Instance uuid 522fb2d0-fa4c-43bd-896c-34c9de7fa081 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:33:45.907307 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-c06e43f7-2129-4903-9312-564ea20d6416 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1f774d5c764554ae3f880a7d4aa2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464094be29ab46e0b9370341079127ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:33:45.918626 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c06e43f7-2129-4903-9312-564ea20d6416 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] 10.222.0.46 "GET /compute/v2.1/servers/522fb2d0-fa4c-43bd-896c-34c9de7fa081" status: 200 len: 1342 microversion: 2.1 time: 0.788091 Jul 28 10:33:45.921987 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 328/618] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:33:45 2022] GET /compute/v2.1/servers/522fb2d0-fa4c-43bd-896c-34c9de7fa081 => generated 1342 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:33:45.946881 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2ccaa87b-34d2-4def-9315-e428e8bdb967 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:45.947501 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-2ccaa87b-34d2-4def-9315-e428e8bdb967 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] [instance: 522fb2d0-fa4c-43bd-896c-34c9de7fa081] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:45.968655 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2ccaa87b-34d2-4def-9315-e428e8bdb967 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:45.973432 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2ccaa87b-34d2-4def-9315-e428e8bdb967 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:45.974334 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2ccaa87b-34d2-4def-9315-e428e8bdb967 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:45.982366 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2ccaa87b-34d2-4def-9315-e428e8bdb967 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:46.095711 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-2ccaa87b-34d2-4def-9315-e428e8bdb967 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] [instance: 522fb2d0-fa4c-43bd-896c-34c9de7fa081] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:33:46.251802 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-2ccaa87b-34d2-4def-9315-e428e8bdb967 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] [instance: 522fb2d0-fa4c-43bd-896c-34c9de7fa081] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:33:46.265737 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2ccaa87b-34d2-4def-9315-e428e8bdb967 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:46.266907 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2ccaa87b-34d2-4def-9315-e428e8bdb967 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:46.268384 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-2ccaa87b-34d2-4def-9315-e428e8bdb967 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] [instance: 522fb2d0-fa4c-43bd-896c-34c9de7fa081] instance's host None is down, deleting from database Jul 28 10:33:46.280088 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-2ccaa87b-34d2-4def-9315-e428e8bdb967 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] [instance: 522fb2d0-fa4c-43bd-896c-34c9de7fa081] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:33:46.405537 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-2ccaa87b-34d2-4def-9315-e428e8bdb967 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] [instance: 522fb2d0-fa4c-43bd-896c-34c9de7fa081] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:33:46.417791 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-2ccaa87b-34d2-4def-9315-e428e8bdb967 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] [instance: 522fb2d0-fa4c-43bd-896c-34c9de7fa081] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:33:46.789544 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-2ccaa87b-34d2-4def-9315-e428e8bdb967 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] 10.222.0.46 "DELETE /compute/v2.1/servers/522fb2d0-fa4c-43bd-896c-34c9de7fa081" status: 204 len: 0 microversion: 2.1 time: 0.845116 Jul 28 10:33:46.795981 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 291/619] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:33:45 2022] DELETE /compute/v2.1/servers/522fb2d0-fa4c-43bd-896c-34c9de7fa081 => generated 0 bytes in 850 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:33:46.804069 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d8e94e34-ecb1-42fb-950c-fe5c80b909a8 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:46.805079 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-d8e94e34-ecb1-42fb-950c-fe5c80b909a8 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] [instance: 522fb2d0-fa4c-43bd-896c-34c9de7fa081] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:46.822415 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d8e94e34-ecb1-42fb-950c-fe5c80b909a8 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:46.822873 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d8e94e34-ecb1-42fb-950c-fe5c80b909a8 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:46.823666 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d8e94e34-ecb1-42fb-950c-fe5c80b909a8 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:46.824116 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d8e94e34-ecb1-42fb-950c-fe5c80b909a8 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:46.850579 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-d8e94e34-ecb1-42fb-950c-fe5c80b909a8 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] HTTP exception thrown: Instance 522fb2d0-fa4c-43bd-896c-34c9de7fa081 could not be found. Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d8e94e34-ecb1-42fb-950c-fe5c80b909a8 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Request method failure captured: Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/522fb2d0-fa4c-43bd-896c-34c9de7fa081 HTTP/1.1 Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mX4h76GU14pV4aMz1hROFY_gCPRSudDHIepYfb4m3LjBSRhAraRBv0zrZzu7EcNsUHdrOm0FnM7ek9uE0FxLJvn4XSXWxH5enCNRktdhhV-SXeMCPku5v0mM_R1A95uBukynVI-UlZ7nPe7EBVfQMZRvuM7YfDeCWQmD3Rv3s-oEJM Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 464094be29ab46e0b9370341079127ad Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ServersTestJSON-330545858 Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/464094be29ab46e0b9370341079127ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/464094be29ab46e0b9370341079127ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/464094be29ab46e0b9370341079127ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_464094be29ab46e0b9370341079127ad", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ServersTestJSON-330545858 Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 464094be29ab46e0b9370341079127ad Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ServersTestJSON-330545858 Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ServersTestJSON-330545858-project Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: ff1f774d5c764554ae3f880a7d4aa2ef Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ServersTestJSON-330545858-project Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 522fb2d0-fa4c-43bd-896c-34c9de7fa081 could not be found. Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '522fb2d0-fa4c-43bd-896c-34c9de7fa081'} Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 522fb2d0-fa4c-43bd-896c-34c9de7fa081 could not be found. Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 522fb2d0-fa4c-43bd-896c-34c9de7fa081 could not be found. Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:46.867692 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:46.874194 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:46.874194 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:46.874194 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:33:46.874194 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:33:46.874194 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 522fb2d0-fa4c-43bd-896c-34c9de7fa081 could not be found. Jul 28 10:33:46.874194 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:46.874194 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d8e94e34-ecb1-42fb-950c-fe5c80b909a8 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Returning 404 to user: Instance 522fb2d0-fa4c-43bd-896c-34c9de7fa081 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:46.874194 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-d8e94e34-ecb1-42fb-950c-fe5c80b909a8 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] 10.222.0.46 "GET /compute/v2.1/servers/522fb2d0-fa4c-43bd-896c-34c9de7fa081" status: 404 len: 111 microversion: 2.1 time: 0.072249 Jul 28 10:33:46.874194 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 329/620] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:33:46 2022] GET /compute/v2.1/servers/522fb2d0-fa4c-43bd-896c-34c9de7fa081 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:33:46.881428 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6b511b0f-77d3-4f44-a420-4d6ad954f772 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] Calling method '.version_select at 0x7fa94bc16c10>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:46.917279 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6b511b0f-77d3-4f44-a420-4d6ad954f772 tempest-ServersTestJSON-330545858 tempest-ServersTestJSON-330545858-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-496270188" status: 202 len: 0 microversion: 2.1 time: 0.040816 Jul 28 10:33:46.918209 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 292/621] 10.222.0.46 () {58 vars in 1218 bytes} [Thu Jul 28 10:33:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-496270188 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:33:47.339887 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c327a22e-def6-4f21-8596-bfbc373b8815 tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] 10.222.0.46 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.338310 Jul 28 10:33:47.341724 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 330/622] 10.222.0.46 () {58 vars in 1128 bytes} [Thu Jul 28 10:33:47 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 10:33:47.354338 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-355369c9-04ca-4159-b7bd-c12adc90d513 tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] Calling method '.version_select at 0x7fa94bbe0ca0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:47.417036 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-355369c9-04ca-4159-b7bd-c12adc90d513 tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] HTTP exception thrown: Image not found. Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-355369c9-04ca-4159-b7bd-c12adc90d513 tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] Request method failure captured: Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mYKfQckY4Vggkdp062C6C1DAw8kji2Bt6baJNSNKcCGFd0xov_9AP_cqJzrxRIkeipOgTi-G4B3QsrMEAkMoeMHFwk4uu5MT28v6dxCsXb2vmSqtXl1j84MwnO5l-aH_iH7zg6PEFJcdWCrcVAI_xsf7mbEBoLzaNLufxwHoBeDAOU Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 4ff23dd3099e4b098617137d1f284d99 Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-183780699 Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4ff23dd3099e4b098617137d1f284d99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ff23dd3099e4b098617137d1f284d99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ff23dd3099e4b098617137d1f284d99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4ff23dd3099e4b098617137d1f284d99", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-183780699 Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 4ff23dd3099e4b098617137d1f284d99 Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-183780699 Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ImagesDeleteNegativeTestJSON-183780699-project Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 2c3de4edb16d432c86745036ba7ae556 Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-183780699-project Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: exception: Image not found. Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '-1'} Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.420659 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:47.426264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:47.426264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:47.426264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:47.426264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:47.426264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:33:47.426264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:33:47.426264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:47.426264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:47.426264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 10:33:47.426264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 10:33:47.426264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 10:33:47.426264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.426264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:47.426264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.426264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:47.426264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:47.426264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:47.426264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:33:47.426264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:33:47.426264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 10:33:47.426264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.429305 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-355369c9-04ca-4159-b7bd-c12adc90d513 tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] Returning 404 to user: Image not found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:47.429305 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-355369c9-04ca-4159-b7bd-c12adc90d513 tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] 10.222.0.46 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.079987 Jul 28 10:33:47.433423 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 293/623] 10.222.0.46 () {58 vars in 1134 bytes} [Thu Jul 28 10:33:47 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:33:47.443729 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-dfbd971c-c4bf-4793-a2bc-32d8c032a136 tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] Calling method '.version_select at 0x7fa94bc23ca0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:47.515145 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-dfbd971c-c4bf-4793-a2bc-32d8c032a136 tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] HTTP exception thrown: Image not found. Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-dfbd971c-c4bf-4793-a2bc-32d8c032a136 tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] Request method failure captured: Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: request: DELETE /compute/v2.1/images/e690a062-3b5b-4b21-b9e0-08b9fa38993j HTTP/1.1 Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mYKfQckY4Vggkdp062C6C1DAw8kji2Bt6baJNSNKcCGFd0xov_9AP_cqJzrxRIkeipOgTi-G4B3QsrMEAkMoeMHFwk4uu5MT28v6dxCsXb2vmSqtXl1j84MwnO5l-aH_iH7zg6PEFJcdWCrcVAI_xsf7mbEBoLzaNLufxwHoBeDAOU Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 4ff23dd3099e4b098617137d1f284d99 Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-183780699 Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4ff23dd3099e4b098617137d1f284d99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ff23dd3099e4b098617137d1f284d99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ff23dd3099e4b098617137d1f284d99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4ff23dd3099e4b098617137d1f284d99", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-183780699 Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 4ff23dd3099e4b098617137d1f284d99 Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-183780699 Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ImagesDeleteNegativeTestJSON-183780699-project Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 2c3de4edb16d432c86745036ba7ae556 Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-183780699-project Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: exception: Image not found. Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'e690a062-3b5b-4b21-b9e0-08b9fa38993j'} Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e690a062-3b5b-4b21-b9e0-08b9fa38993j to delete Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e690a062-3b5b-4b21-b9e0-08b9fa38993j could not be found. Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:47.517157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.521161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:47.521161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:47.521161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:47.521161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:47.521161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:47.521161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:33:47.521161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:33:47.521161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:47.521161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:47.521161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 10:33:47.521161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 10:33:47.521161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 10:33:47.521161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.521161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:47.521161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.521161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:47.521161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:47.521161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:47.521161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:33:47.521161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:33:47.521161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 10:33:47.521161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.526943 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-dfbd971c-c4bf-4793-a2bc-32d8c032a136 tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] Returning 404 to user: Image not found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:47.528060 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-dfbd971c-c4bf-4793-a2bc-32d8c032a136 tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] 10.222.0.46 "DELETE /compute/v2.1/images/e690a062-3b5b-4b21-b9e0-08b9fa38993j" status: 404 len: 62 microversion: 2.1 time: 0.093973 Jul 28 10:33:47.529457 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 331/624] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:33:47 2022] DELETE /compute/v2.1/images/e690a062-3b5b-4b21-b9e0-08b9fa38993j => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 28 10:33:47.543788 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e7e24e3f-d8bf-43a4-b38c-878a34595d7b tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] Calling method '.version_select at 0x7fa94bcdfdc0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:47.571268 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-e7e24e3f-d8bf-43a4-b38c-878a34595d7b tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] HTTP exception thrown: Image not found. Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e7e24e3f-d8bf-43a4-b38c-878a34595d7b tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] Request method failure captured: Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: request: DELETE /compute/v2.1/images/ecdf9ef4-60d0-4a8c-b6ea-701ef7187cff1 HTTP/1.1 Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mYKfQckY4Vggkdp062C6C1DAw8kji2Bt6baJNSNKcCGFd0xov_9AP_cqJzrxRIkeipOgTi-G4B3QsrMEAkMoeMHFwk4uu5MT28v6dxCsXb2vmSqtXl1j84MwnO5l-aH_iH7zg6PEFJcdWCrcVAI_xsf7mbEBoLzaNLufxwHoBeDAOU Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 4ff23dd3099e4b098617137d1f284d99 Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-183780699 Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4ff23dd3099e4b098617137d1f284d99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ff23dd3099e4b098617137d1f284d99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ff23dd3099e4b098617137d1f284d99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4ff23dd3099e4b098617137d1f284d99", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-183780699 Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 4ff23dd3099e4b098617137d1f284d99 Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-183780699 Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ImagesDeleteNegativeTestJSON-183780699-project Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 2c3de4edb16d432c86745036ba7ae556 Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-183780699-project Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: exception: Image not found. Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'ecdf9ef4-60d0-4a8c-b6ea-701ef7187cff1'} Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ecdf9ef4-60d0-4a8c-b6ea-701ef7187cff1 to delete Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ecdf9ef4-60d0-4a8c-b6ea-701ef7187cff1 could not be found. Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:47.573340 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e7e24e3f-d8bf-43a4-b38c-878a34595d7b tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] Returning 404 to user: Image not found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e7e24e3f-d8bf-43a4-b38c-878a34595d7b tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] 10.222.0.46 "DELETE /compute/v2.1/images/ecdf9ef4-60d0-4a8c-b6ea-701ef7187cff1" status: 404 len: 62 microversion: 2.1 time: 0.042595 Jul 28 10:33:47.580644 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 294/625] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:33:47 2022] DELETE /compute/v2.1/images/ecdf9ef4-60d0-4a8c-b6ea-701ef7187cff1 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:33:47.591693 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0a797d06-98f5-430b-b795-faf3f5a5bda8 tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] Calling method '.version_select at 0x7fa94bc23550>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:47.670290 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-0a797d06-98f5-430b-b795-faf3f5a5bda8 tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] HTTP exception thrown: Image not found. Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0a797d06-98f5-430b-b795-faf3f5a5bda8 tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] Request method failure captured: Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: request: DELETE /compute/v2.1/images/tempest-invalid-1615044684 HTTP/1.1 Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mYKfQckY4Vggkdp062C6C1DAw8kji2Bt6baJNSNKcCGFd0xov_9AP_cqJzrxRIkeipOgTi-G4B3QsrMEAkMoeMHFwk4uu5MT28v6dxCsXb2vmSqtXl1j84MwnO5l-aH_iH7zg6PEFJcdWCrcVAI_xsf7mbEBoLzaNLufxwHoBeDAOU Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 4ff23dd3099e4b098617137d1f284d99 Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-183780699 Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4ff23dd3099e4b098617137d1f284d99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ff23dd3099e4b098617137d1f284d99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ff23dd3099e4b098617137d1f284d99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4ff23dd3099e4b098617137d1f284d99", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-183780699 Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 4ff23dd3099e4b098617137d1f284d99 Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-183780699 Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ImagesDeleteNegativeTestJSON-183780699-project Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 2c3de4edb16d432c86745036ba7ae556 Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-183780699-project Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: exception: Image not found. Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'tempest-invalid-1615044684'} Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1615044684 to delete Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1615044684 could not be found. Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.672081 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:47.676560 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:47.676560 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:47.676560 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:47.676560 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:47.676560 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:33:47.676560 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:33:47.676560 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:47.676560 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:47.676560 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 10:33:47.676560 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 10:33:47.676560 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 10:33:47.676560 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.676560 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:47.676560 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.676560 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:47.676560 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:47.676560 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:47.676560 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:33:47.676560 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:33:47.676560 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 10:33:47.676560 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.676560 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0a797d06-98f5-430b-b795-faf3f5a5bda8 tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] Returning 404 to user: Image not found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:47.676560 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0a797d06-98f5-430b-b795-faf3f5a5bda8 tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] 10.222.0.46 "DELETE /compute/v2.1/images/tempest-invalid-1615044684" status: 404 len: 62 microversion: 2.1 time: 0.089098 Jul 28 10:33:47.681469 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 332/626] 10.222.0.46 () {58 vars in 1206 bytes} [Thu Jul 28 10:33:47 2022] DELETE /compute/v2.1/images/tempest-invalid-1615044684 => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:33:47.692700 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0713717f-b3ab-4166-a517-827c62d4b933 tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] Calling method '.version_select at 0x7fa94bc15c10>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:47.738365 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-0713717f-b3ab-4166-a517-827c62d4b933 tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] HTTP exception thrown: Image not found. Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0713717f-b3ab-4166-a517-827c62d4b933 tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] Request method failure captured: Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: request: DELETE /compute/v2.1/images/bc52c705-9a42-4148-9d3d-c47f70e2c53b HTTP/1.1 Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mYKfQckY4Vggkdp062C6C1DAw8kji2Bt6baJNSNKcCGFd0xov_9AP_cqJzrxRIkeipOgTi-G4B3QsrMEAkMoeMHFwk4uu5MT28v6dxCsXb2vmSqtXl1j84MwnO5l-aH_iH7zg6PEFJcdWCrcVAI_xsf7mbEBoLzaNLufxwHoBeDAOU Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 4ff23dd3099e4b098617137d1f284d99 Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-183780699 Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4ff23dd3099e4b098617137d1f284d99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ff23dd3099e4b098617137d1f284d99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ff23dd3099e4b098617137d1f284d99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4ff23dd3099e4b098617137d1f284d99", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-183780699 Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 4ff23dd3099e4b098617137d1f284d99 Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-183780699 Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ImagesDeleteNegativeTestJSON-183780699-project Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 2c3de4edb16d432c86745036ba7ae556 Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-183780699-project Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: exception: Image not found. Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'bc52c705-9a42-4148-9d3d-c47f70e2c53b'} Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bc52c705-9a42-4148-9d3d-c47f70e2c53b to delete Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bc52c705-9a42-4148-9d3d-c47f70e2c53b could not be found. Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:47.740243 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.746266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:47.746266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:47.746266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:47.746266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:47.746266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:47.746266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:33:47.746266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:33:47.746266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:47.746266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:47.746266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 10:33:47.746266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 10:33:47.746266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 10:33:47.746266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.746266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:47.746266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.746266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:47.746266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:47.746266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:47.746266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:33:47.746266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:33:47.746266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 10:33:47.746266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:47.748636 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0713717f-b3ab-4166-a517-827c62d4b933 tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] Returning 404 to user: Image not found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:47.749545 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-0713717f-b3ab-4166-a517-827c62d4b933 tempest-ImagesDeleteNegativeTestJSON-183780699 tempest-ImagesDeleteNegativeTestJSON-183780699-project] 10.222.0.46 "DELETE /compute/v2.1/images/bc52c705-9a42-4148-9d3d-c47f70e2c53b" status: 404 len: 62 microversion: 2.1 time: 0.062176 Jul 28 10:33:47.753597 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 295/627] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:33:47 2022] DELETE /compute/v2.1/images/bc52c705-9a42-4148-9d3d-c47f70e2c53b => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:33:49.309485 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6c22d9a7-694c-4660-83c4-7aec0310f2bf tempest-MultipleCreateNegativeTestJSON-141472524 tempest-MultipleCreateNegativeTestJSON-141472524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-565297988", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:49.324456 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-6c22d9a7-694c-4660-83c4-7aec0310f2bf tempest-MultipleCreateNegativeTestJSON-141472524 tempest-MultipleCreateNegativeTestJSON-141472524-project] HTTP exception thrown: min_count must be <= max_count Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6c22d9a7-694c-4660-83c4-7aec0310f2bf tempest-MultipleCreateNegativeTestJSON-141472524 tempest-MultipleCreateNegativeTestJSON-141472524-project] Request method failure captured: Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 183 Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mYMIsOb_xdqBL0EIrYQeLNBMqhDYK3wVnTTZBf714NC465OIlHg5B3CfSSbKX6LOOtG27o12_wEi44H_kK-qX8lgEADyecRfBjEIXGzrnutkOiMVPVewKIKQWqgq7pbUqv-cnuHs75FNAvC6TjQkCeo6fKNVSkyE-UlZmnCErI2mZE Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: c115486fe7e74d30975d66c09d263750 Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-141472524 Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c115486fe7e74d30975d66c09d263750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c115486fe7e74d30975d66c09d263750"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c115486fe7e74d30975d66c09d263750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c115486fe7e74d30975d66c09d263750", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-141472524 Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: c115486fe7e74d30975d66c09d263750 Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-141472524 Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-MultipleCreateNegativeTestJSON-141472524-project Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: e329895ac89843fc8d124bfcdc475e7d Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-141472524-project Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-565297988", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: exception: min_count must be <= max_count Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-565297988', 'imageRef': 'eff4a889-87b7-4a4c-be7a-77433dc25faf', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 28 10:33:49.331192 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.335738 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6c22d9a7-694c-4660-83c4-7aec0310f2bf tempest-MultipleCreateNegativeTestJSON-141472524 tempest-MultipleCreateNegativeTestJSON-141472524-project] Returning 400 to user: min_count must be <= max_count {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:49.338462 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-6c22d9a7-694c-4660-83c4-7aec0310f2bf tempest-MultipleCreateNegativeTestJSON-141472524 tempest-MultipleCreateNegativeTestJSON-141472524-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.350765 Jul 28 10:33:49.351003 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 333/628] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:33:48 2022] POST /compute/v2.1/servers => generated 74 bytes in 355 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 10:33:49.433566 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8fa23e67-cb17-45ae-a0f3-06011f32f39b tempest-MultipleCreateNegativeTestJSON-141472524 tempest-MultipleCreateNegativeTestJSON-141472524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1702258194", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "max_count": 0}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8fa23e67-cb17-45ae-a0f3-06011f32f39b tempest-MultipleCreateNegativeTestJSON-141472524 tempest-MultipleCreateNegativeTestJSON-141472524-project] Request method failure captured: Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 168 Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mYMIsOb_xdqBL0EIrYQeLNBMqhDYK3wVnTTZBf714NC465OIlHg5B3CfSSbKX6LOOtG27o12_wEi44H_kK-qX8lgEADyecRfBjEIXGzrnutkOiMVPVewKIKQWqgq7pbUqv-cnuHs75FNAvC6TjQkCeo6fKNVSkyE-UlZmnCErI2mZE Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: c115486fe7e74d30975d66c09d263750 Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-141472524 Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c115486fe7e74d30975d66c09d263750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c115486fe7e74d30975d66c09d263750"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c115486fe7e74d30975d66c09d263750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c115486fe7e74d30975d66c09d263750", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-141472524 Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: c115486fe7e74d30975d66c09d263750 Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-141472524 Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-MultipleCreateNegativeTestJSON-141472524-project Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: e329895ac89843fc8d124bfcdc475e7d Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-141472524-project Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1702258194", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "max_count": 0}} Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1702258194', 'imageRef': 'eff4a889-87b7-4a4c-be7a-77433dc25faf', 'flavorRef': '452', 'max_count': 0}}} Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise error Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi 0 Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 10:33:49.441771 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 10:33:49.446233 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 10:33:49.446233 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 10:33:49.446233 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 10:33:49.446233 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 10:33:49.446233 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 28 10:33:49.446233 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.446233 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:49.446233 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.446233 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:49.446233 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:49.446233 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:49.446233 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 10:33:49.446233 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 10:33:49.446233 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 28 10:33:49.446233 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.456175 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8fa23e67-cb17-45ae-a0f3-06011f32f39b tempest-MultipleCreateNegativeTestJSON-141472524 tempest-MultipleCreateNegativeTestJSON-141472524-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:49.457805 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-8fa23e67-cb17-45ae-a0f3-06011f32f39b tempest-MultipleCreateNegativeTestJSON-141472524 tempest-MultipleCreateNegativeTestJSON-141472524-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.036591 Jul 28 10:33:49.458428 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 296/629] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:33:49 2022] POST /compute/v2.1/servers => generated 130 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:33:49.573886 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4f3616c1-8215-4921-9cd3-c88c681c5197 tempest-MultipleCreateNegativeTestJSON-141472524 tempest-MultipleCreateNegativeTestJSON-141472524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-858680904", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "max_count": 2.5}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4f3616c1-8215-4921-9cd3-c88c681c5197 tempest-MultipleCreateNegativeTestJSON-141472524 tempest-MultipleCreateNegativeTestJSON-141472524-project] Request method failure captured: Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 169 Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mYMIsOb_xdqBL0EIrYQeLNBMqhDYK3wVnTTZBf714NC465OIlHg5B3CfSSbKX6LOOtG27o12_wEi44H_kK-qX8lgEADyecRfBjEIXGzrnutkOiMVPVewKIKQWqgq7pbUqv-cnuHs75FNAvC6TjQkCeo6fKNVSkyE-UlZmnCErI2mZE Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: c115486fe7e74d30975d66c09d263750 Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-141472524 Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c115486fe7e74d30975d66c09d263750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c115486fe7e74d30975d66c09d263750"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c115486fe7e74d30975d66c09d263750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c115486fe7e74d30975d66c09d263750", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-141472524 Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: c115486fe7e74d30975d66c09d263750 Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-141472524 Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-MultipleCreateNegativeTestJSON-141472524-project Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: e329895ac89843fc8d124bfcdc475e7d Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-141472524-project Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-858680904", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "max_count": 2.5}} Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-858680904', 'imageRef': 'eff4a889-87b7-4a4c-be7a-77433dc25faf', 'flavorRef': '452', 'max_count': 2.5}}} Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise error Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 2.5 Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 10:33:49.580817 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 10:33:49.584689 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 10:33:49.584689 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 10:33:49.584689 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 10:33:49.584689 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 10:33:49.584689 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 28 10:33:49.584689 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.584689 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:49.584689 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.584689 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:49.584689 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:49.584689 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:49.584689 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 10:33:49.584689 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 10:33:49.584689 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 28 10:33:49.584689 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.584689 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4f3616c1-8215-4921-9cd3-c88c681c5197 tempest-MultipleCreateNegativeTestJSON-141472524 tempest-MultipleCreateNegativeTestJSON-141472524-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:49.584689 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-4f3616c1-8215-4921-9cd3-c88c681c5197 tempest-MultipleCreateNegativeTestJSON-141472524 tempest-MultipleCreateNegativeTestJSON-141472524-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.013204 Jul 28 10:33:49.594024 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 334/630] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:33:49 2022] POST /compute/v2.1/servers => generated 139 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:33:49.670177 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4316aff0-f1ec-4abd-97d6-8981f6efa1d0 tempest-MultipleCreateNegativeTestJSON-141472524 tempest-MultipleCreateNegativeTestJSON-141472524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-926664245", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "min_count": 0}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4316aff0-f1ec-4abd-97d6-8981f6efa1d0 tempest-MultipleCreateNegativeTestJSON-141472524 tempest-MultipleCreateNegativeTestJSON-141472524-project] Request method failure captured: Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 167 Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mYMIsOb_xdqBL0EIrYQeLNBMqhDYK3wVnTTZBf714NC465OIlHg5B3CfSSbKX6LOOtG27o12_wEi44H_kK-qX8lgEADyecRfBjEIXGzrnutkOiMVPVewKIKQWqgq7pbUqv-cnuHs75FNAvC6TjQkCeo6fKNVSkyE-UlZmnCErI2mZE Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: c115486fe7e74d30975d66c09d263750 Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-141472524 Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c115486fe7e74d30975d66c09d263750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c115486fe7e74d30975d66c09d263750"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c115486fe7e74d30975d66c09d263750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c115486fe7e74d30975d66c09d263750", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-141472524 Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: c115486fe7e74d30975d66c09d263750 Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-141472524 Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-MultipleCreateNegativeTestJSON-141472524-project Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: e329895ac89843fc8d124bfcdc475e7d Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-141472524-project Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-926664245", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "min_count": 0}} Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-926664245', 'imageRef': 'eff4a889-87b7-4a4c-be7a-77433dc25faf', 'flavorRef': '452', 'min_count': 0}}} Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise error Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi 0 Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 10:33:49.677789 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 10:33:49.699249 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 10:33:49.699249 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 10:33:49.699249 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 10:33:49.699249 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 10:33:49.699249 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 28 10:33:49.699249 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.699249 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:49.699249 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.699249 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:49.699249 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:49.699249 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:49.699249 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 10:33:49.699249 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 10:33:49.699249 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 28 10:33:49.699249 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.699249 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4316aff0-f1ec-4abd-97d6-8981f6efa1d0 tempest-MultipleCreateNegativeTestJSON-141472524 tempest-MultipleCreateNegativeTestJSON-141472524-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:49.699249 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-4316aff0-f1ec-4abd-97d6-8981f6efa1d0 tempest-MultipleCreateNegativeTestJSON-141472524 tempest-MultipleCreateNegativeTestJSON-141472524-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.015680 Jul 28 10:33:49.699249 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 297/631] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:33:49 2022] POST /compute/v2.1/servers => generated 130 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:33:49.752514 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8a72b328-50bf-4747-a55a-f1e7ece04335 tempest-MultipleCreateNegativeTestJSON-141472524 tempest-MultipleCreateNegativeTestJSON-141472524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-590253096", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "min_count": 2.5}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8a72b328-50bf-4747-a55a-f1e7ece04335 tempest-MultipleCreateNegativeTestJSON-141472524 tempest-MultipleCreateNegativeTestJSON-141472524-project] Request method failure captured: Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 169 Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mYMIsOb_xdqBL0EIrYQeLNBMqhDYK3wVnTTZBf714NC465OIlHg5B3CfSSbKX6LOOtG27o12_wEi44H_kK-qX8lgEADyecRfBjEIXGzrnutkOiMVPVewKIKQWqgq7pbUqv-cnuHs75FNAvC6TjQkCeo6fKNVSkyE-UlZmnCErI2mZE Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: c115486fe7e74d30975d66c09d263750 Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-141472524 Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c115486fe7e74d30975d66c09d263750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c115486fe7e74d30975d66c09d263750"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c115486fe7e74d30975d66c09d263750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c115486fe7e74d30975d66c09d263750", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-141472524 Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: c115486fe7e74d30975d66c09d263750 Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-141472524 Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-MultipleCreateNegativeTestJSON-141472524-project Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: e329895ac89843fc8d124bfcdc475e7d Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-141472524-project Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-590253096", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "min_count": 2.5}} Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-590253096', 'imageRef': 'eff4a889-87b7-4a4c-be7a-77433dc25faf', 'flavorRef': '452', 'min_count': 2.5}}} Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise error Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 2.5 Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 10:33:49.756715 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 10:33:49.760853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 10:33:49.760853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 10:33:49.760853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 10:33:49.760853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 10:33:49.760853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 28 10:33:49.760853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.760853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:49.760853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.760853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:49.760853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:49.760853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:49.760853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 10:33:49.760853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 10:33:49.760853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 28 10:33:49.760853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:33:49.761752 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8a72b328-50bf-4747-a55a-f1e7ece04335 tempest-MultipleCreateNegativeTestJSON-141472524 tempest-MultipleCreateNegativeTestJSON-141472524-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:49.761832 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-8a72b328-50bf-4747-a55a-f1e7ece04335 tempest-MultipleCreateNegativeTestJSON-141472524 tempest-MultipleCreateNegativeTestJSON-141472524-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.013497 Jul 28 10:33:49.768327 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 335/632] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:33:49 2022] POST /compute/v2.1/servers => generated 139 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:33:50.780447 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c73b84a9-35a8-4acc-a8f2-8da87d2bed92 tempest-FloatingIPDetailsNegativeTestJSON-1658309405 tempest-FloatingIPDetailsNegativeTestJSON-1658309405-project] Calling method '.version_select at 0x7fa94bcdfd30>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:50.976259 n-d-850468-6 devstack@n-api.service[119463]: DEBUG neutronclient.v2_0.client [None req-c73b84a9-35a8-4acc-a8f2-8da87d2bed92 tempest-FloatingIPDetailsNegativeTestJSON-1658309405 tempest-FloatingIPDetailsNegativeTestJSON-1658309405-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a508acc3-513f-42d3-95bc-7bd168116dcd could not be found", "detail": ""}} {{(pid=119463) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 10:33:50.977209 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-c73b84a9-35a8-4acc-a8f2-8da87d2bed92 tempest-FloatingIPDetailsNegativeTestJSON-1658309405 tempest-FloatingIPDetailsNegativeTestJSON-1658309405-project] HTTP exception thrown: Floating IP not found for ID a508acc3-513f-42d3-95bc-7bd168116dcd Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c73b84a9-35a8-4acc-a8f2-8da87d2bed92 tempest-FloatingIPDetailsNegativeTestJSON-1658309405 tempest-FloatingIPDetailsNegativeTestJSON-1658309405-project] Request method failure captured: Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/os-floating-ips/a508acc3-513f-42d3-95bc-7bd168116dcd HTTP/1.1 Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mYOA99ucuFYrW_OmxnQdsl60_Zz4Cu3KL1flpZaFhaxKbpjXqAJguTiNBh7jpcrsQOqve1ofdQifzIRQrNKKqHz-C7J_-kcivsyTveoFBt2Gt4s3uu5UvleB40OXXw10Rjj1RiJoM6Fjz8wAenalxgj6Tg3TRH3AiYryZpfSdnEgzE Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: a4b94d3df55b4831b42a4549917e7ce8 Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1658309405 Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a4b94d3df55b4831b42a4549917e7ce8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a4b94d3df55b4831b42a4549917e7ce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a4b94d3df55b4831b42a4549917e7ce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a4b94d3df55b4831b42a4549917e7ce8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1658309405 Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: a4b94d3df55b4831b42a4549917e7ce8 Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1658309405 Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1658309405-project Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 02072958ec764f67947a4e22e37f0b12 Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1658309405-project Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: exception: Floating IP not found for ID a508acc3-513f-42d3-95bc-7bd168116dcd Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'a508acc3-513f-42d3-95bc-7bd168116dcd'} Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a508acc3-513f-42d3-95bc-7bd168116dcd could not be found Jul 28 10:33:50.979330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5aafb710-45c3-4961-9f85-db22e0275f06'] Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a508acc3-513f-42d3-95bc-7bd168116dcd. Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a508acc3-513f-42d3-95bc-7bd168116dcd Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a508acc3-513f-42d3-95bc-7bd168116dcd Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c73b84a9-35a8-4acc-a8f2-8da87d2bed92 tempest-FloatingIPDetailsNegativeTestJSON-1658309405 tempest-FloatingIPDetailsNegativeTestJSON-1658309405-project] Returning 404 to user: Floating IP not found for ID a508acc3-513f-42d3-95bc-7bd168116dcd {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c73b84a9-35a8-4acc-a8f2-8da87d2bed92 tempest-FloatingIPDetailsNegativeTestJSON-1658309405 tempest-FloatingIPDetailsNegativeTestJSON-1658309405-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips/a508acc3-513f-42d3-95bc-7bd168116dcd" status: 404 len: 111 microversion: 2.1 time: 0.433039 Jul 28 10:33:50.984945 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 298/633] 10.222.0.46 () {58 vars in 1260 bytes} [Thu Jul 28 10:33:50 2022] GET /compute/v2.1/os-floating-ips/a508acc3-513f-42d3-95bc-7bd168116dcd => generated 111 bytes in 436 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:33:57.223854 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:57.224643 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=10 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:57.226767 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:57.231858 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=12 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:57.776746 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-59dfc30a-b697-496b-b689-758f32953ce5 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1291877064", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": "none"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:33:57.909628 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-59dfc30a-b697-496b-b689-758f32953ce5 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:33:57.910090 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-59dfc30a-b697-496b-b689-758f32953ce5 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:33:57.910768 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-59dfc30a-b697-496b-b689-758f32953ce5 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:33:57.911341 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-59dfc30a-b697-496b-b689-758f32953ce5 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:33:57.911932 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-59dfc30a-b697-496b-b689-758f32953ce5 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:33:57.936609 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-59dfc30a-b697-496b-b689-758f32953ce5 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:57.937591 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-59dfc30a-b697-496b-b689-758f32953ce5 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:57.938906 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-59dfc30a-b697-496b-b689-758f32953ce5 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:57.939762 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-59dfc30a-b697-496b-b689-758f32953ce5 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:57.989196 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-59dfc30a-b697-496b-b689-758f32953ce5 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Getting quotas for project d41b986488f542cba289176167cb3723. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:33:58.004265 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-59dfc30a-b697-496b-b689-758f32953ce5 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Getting quotas for user ab99fc8808bb4b1385e7fe4c98207e18 and project d41b986488f542cba289176167cb3723. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:33:58.035301 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-59dfc30a-b697-496b-b689-758f32953ce5 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:33:58.044930 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-59dfc30a-b697-496b-b689-758f32953ce5 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] [instance: d718e333-7a1e-46d5-bcbb-36bbee4af943] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:33:58.144560 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-59dfc30a-b697-496b-b689-758f32953ce5 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.927613 Jul 28 10:33:58.159936 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-22403115-1f29-4703-9f10-f53eeca6389d tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:58.161139 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-22403115-1f29-4703-9f10-f53eeca6389d tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] [instance: d718e333-7a1e-46d5-bcbb-36bbee4af943] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:58.167549 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 336/634] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Jul 28 10:33:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 10:33:58.176232 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:58.177754 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:58.180275 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:33:58.645630 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-22403115-1f29-4703-9f10-f53eeca6389d tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99fc8808bb4b1385e7fe4c98207e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41b986488f542cba289176167cb3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:33:58.673728 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-22403115-1f29-4703-9f10-f53eeca6389d tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab99fc8808bb4b1385e7fe4c98207e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41b986488f542cba289176167cb3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:33:58.692345 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-22403115-1f29-4703-9f10-f53eeca6389d tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab99fc8808bb4b1385e7fe4c98207e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41b986488f542cba289176167cb3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:33:58.696193 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-22403115-1f29-4703-9f10-f53eeca6389d tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] 10.222.0.46 "GET /compute/v2.1/servers/d718e333-7a1e-46d5-bcbb-36bbee4af943" status: 200 len: 1281 microversion: 2.47 time: 0.540077 Jul 28 10:33:58.701895 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 299/635] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:33:58 2022] GET /compute/v2.1/servers/d718e333-7a1e-46d5-bcbb-36bbee4af943 => generated 1281 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:33:59.734147 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b985be0d-36e6-4828-8d7d-3d8513c10ddd tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:59.734775 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b985be0d-36e6-4828-8d7d-3d8513c10ddd tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] [instance: d718e333-7a1e-46d5-bcbb-36bbee4af943] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:33:59.765028 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b985be0d-36e6-4828-8d7d-3d8513c10ddd tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:59.770160 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b985be0d-36e6-4828-8d7d-3d8513c10ddd tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:33:59.773252 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b985be0d-36e6-4828-8d7d-3d8513c10ddd tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:33:59.781126 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b985be0d-36e6-4828-8d7d-3d8513c10ddd tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:00.103726 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b985be0d-36e6-4828-8d7d-3d8513c10ddd tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:00.104289 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b985be0d-36e6-4828-8d7d-3d8513c10ddd tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:00.104760 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-b985be0d-36e6-4828-8d7d-3d8513c10ddd tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lazy-loading 'fault' on Instance uuid d718e333-7a1e-46d5-bcbb-36bbee4af943 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:34:00.377779 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-b985be0d-36e6-4828-8d7d-3d8513c10ddd tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99fc8808bb4b1385e7fe4c98207e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41b986488f542cba289176167cb3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:34:00.396479 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-b985be0d-36e6-4828-8d7d-3d8513c10ddd tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab99fc8808bb4b1385e7fe4c98207e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41b986488f542cba289176167cb3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:34:00.406230 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-b985be0d-36e6-4828-8d7d-3d8513c10ddd tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab99fc8808bb4b1385e7fe4c98207e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41b986488f542cba289176167cb3723', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:34:00.407793 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b985be0d-36e6-4828-8d7d-3d8513c10ddd tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] 10.222.0.46 "GET /compute/v2.1/servers/d718e333-7a1e-46d5-bcbb-36bbee4af943" status: 200 len: 1354 microversion: 2.47 time: 0.680769 Jul 28 10:34:00.419773 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 337/636] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:33:59 2022] GET /compute/v2.1/servers/d718e333-7a1e-46d5-bcbb-36bbee4af943 => generated 1354 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:34:00.448644 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a83a900f-b613-4f88-8d31-92c6d4e30ea0 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:00.450681 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-a83a900f-b613-4f88-8d31-92c6d4e30ea0 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] [instance: d718e333-7a1e-46d5-bcbb-36bbee4af943] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:00.472288 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a83a900f-b613-4f88-8d31-92c6d4e30ea0 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:00.475961 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a83a900f-b613-4f88-8d31-92c6d4e30ea0 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:00.478623 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a83a900f-b613-4f88-8d31-92c6d4e30ea0 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:00.482780 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a83a900f-b613-4f88-8d31-92c6d4e30ea0 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:00.618012 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-a83a900f-b613-4f88-8d31-92c6d4e30ea0 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] [instance: d718e333-7a1e-46d5-bcbb-36bbee4af943] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:34:00.765365 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-a83a900f-b613-4f88-8d31-92c6d4e30ea0 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] [instance: d718e333-7a1e-46d5-bcbb-36bbee4af943] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:34:00.767201 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a83a900f-b613-4f88-8d31-92c6d4e30ea0 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:00.769669 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a83a900f-b613-4f88-8d31-92c6d4e30ea0 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:00.770276 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-a83a900f-b613-4f88-8d31-92c6d4e30ea0 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] [instance: d718e333-7a1e-46d5-bcbb-36bbee4af943] instance's host None is down, deleting from database Jul 28 10:34:00.779233 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-a83a900f-b613-4f88-8d31-92c6d4e30ea0 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] [instance: d718e333-7a1e-46d5-bcbb-36bbee4af943] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:34:01.131863 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-a83a900f-b613-4f88-8d31-92c6d4e30ea0 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] [instance: d718e333-7a1e-46d5-bcbb-36bbee4af943] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:34:01.136526 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-a83a900f-b613-4f88-8d31-92c6d4e30ea0 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] [instance: d718e333-7a1e-46d5-bcbb-36bbee4af943] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:34:01.629762 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a83a900f-b613-4f88-8d31-92c6d4e30ea0 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d718e333-7a1e-46d5-bcbb-36bbee4af943" status: 204 len: 0 microversion: 2.47 time: 1.194331 Jul 28 10:34:01.633769 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 300/637] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:34:00 2022] DELETE /compute/v2.1/servers/d718e333-7a1e-46d5-bcbb-36bbee4af943 => generated 0 bytes in 1196 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:34:01.653757 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-105d076f-e911-4b8a-9a7b-cca7c26afbf3 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:01.656771 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-105d076f-e911-4b8a-9a7b-cca7c26afbf3 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] [instance: d718e333-7a1e-46d5-bcbb-36bbee4af943] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:01.683539 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-105d076f-e911-4b8a-9a7b-cca7c26afbf3 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:01.685620 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-105d076f-e911-4b8a-9a7b-cca7c26afbf3 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:01.686464 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-105d076f-e911-4b8a-9a7b-cca7c26afbf3 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:01.686918 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-105d076f-e911-4b8a-9a7b-cca7c26afbf3 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:01.721577 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-def6372b-4a0c-43f2-9a93-bcd1d7833023 tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] Calling method '.version_select at 0x7fa94bc391f0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:01.856679 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-105d076f-e911-4b8a-9a7b-cca7c26afbf3 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] HTTP exception thrown: Instance d718e333-7a1e-46d5-bcbb-36bbee4af943 could not be found. Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-105d076f-e911-4b8a-9a7b-cca7c26afbf3 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Request method failure captured: Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/d718e333-7a1e-46d5-bcbb-36bbee4af943 HTTP/1.1 Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mYUGJe2JcHuiYMy7hg0qse0kBQJgIoWcEcBtfFpZWCPkF86cJ9rh09E12HfJgAIsO2Y_HpcbQVp7GdVrTiNlcf6VftX_GD3InO0xUqoH6DV_5ITg6beKwnNd6W2BLCWpC_UKN8dqMQkfcSkqtMOu0SrEf9XA_o0q5mffFYIHloS6pg Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: X-Openstack-Nova-Api-Version: 2.47 Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: d41b986488f542cba289176167cb3723 Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServersAaction247Test-1693927186 Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d41b986488f542cba289176167cb3723"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d41b986488f542cba289176167cb3723"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d41b986488f542cba289176167cb3723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d41b986488f542cba289176167cb3723", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServersAaction247Test-1693927186 Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: d41b986488f542cba289176167cb3723 Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServersAaction247Test-1693927186 Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServersAaction247Test-1693927186-project Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: ab99fc8808bb4b1385e7fe4c98207e18 Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServersAaction247Test-1693927186-project Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance d718e333-7a1e-46d5-bcbb-36bbee4af943 could not be found. Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'd718e333-7a1e-46d5-bcbb-36bbee4af943'} Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d718e333-7a1e-46d5-bcbb-36bbee4af943 could not be found. Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d718e333-7a1e-46d5-bcbb-36bbee4af943 could not be found. Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:01.865170 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:01.872913 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:01.872913 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:01.872913 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:01.872913 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:34:01.872913 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:34:01.872913 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d718e333-7a1e-46d5-bcbb-36bbee4af943 could not be found. Jul 28 10:34:01.872913 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:01.875164 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-105d076f-e911-4b8a-9a7b-cca7c26afbf3 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] Returning 404 to user: Instance d718e333-7a1e-46d5-bcbb-36bbee4af943 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:34:01.878608 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-105d076f-e911-4b8a-9a7b-cca7c26afbf3 tempest-ServersAaction247Test-1693927186 tempest-ServersAaction247Test-1693927186-project] 10.222.0.46 "GET /compute/v2.1/servers/d718e333-7a1e-46d5-bcbb-36bbee4af943" status: 404 len: 111 microversion: 2.47 time: 0.241302 Jul 28 10:34:01.881748 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 301/638] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:34:01 2022] GET /compute/v2.1/servers/d718e333-7a1e-46d5-bcbb-36bbee4af943 => generated 111 bytes in 247 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:34:02.077036 n-d-850468-6 devstack@n-api.service[119464]: DEBUG neutronclient.v2_0.client [None req-def6372b-4a0c-43f2-9a93-bcd1d7833023 tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 11083dcc-e326-406c-a18d-6bc3bd21cf3c does not exist", "detail": ""}} {{(pid=119464) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 10:34:02.078178 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.security_group_api [None req-def6372b-4a0c-43f2-9a93-bcd1d7833023 tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] Neutron security group 11083dcc-e326-406c-a18d-6bc3bd21cf3c not found {{(pid=119464) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 10:34:02.079200 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-def6372b-4a0c-43f2-9a93-bcd1d7833023 tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] HTTP exception thrown: Security group 11083dcc-e326-406c-a18d-6bc3bd21cf3c does not exist Jul 28 10:34:02.079200 n-d-850468-6 devstack@n-api.service[119464]: Neutron server returns request_ids: ['req-9f756fcb-ef32-47c0-bfd4-1c4b3ad10a7b'] Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-def6372b-4a0c-43f2-9a93-bcd1d7833023 tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] Request method failure captured: Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: request: DELETE /compute/v2.1/os-security-groups/11083dcc-e326-406c-a18d-6bc3bd21cf3c HTTP/1.1 Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mYZNi2og5ITz4nMDMuXLPDwJuL23kBo3_nGf3dLflZ6UH5T5yE46leUCe5_Twu_G94K4WBqgH0Q8SqffclTHehohtjJluBYxhm1jpO_JWafhta4Gr1YChVQsFoODvniIjUtTIjTocGId91drVM8u0wSjobS-Vssp1eNTHHcracJ42E Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: b3f4b241d557442e9d46300cf50160cf Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1709267486 Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b3f4b241d557442e9d46300cf50160cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3f4b241d557442e9d46300cf50160cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3f4b241d557442e9d46300cf50160cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b3f4b241d557442e9d46300cf50160cf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1709267486 Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: b3f4b241d557442e9d46300cf50160cf Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1709267486 Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-SecurityGroupsNegativeTestJSON-1709267486-project Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: ff5b1313198a4ceab4bd4e26656ebd5b Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1709267486-project Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: exception: Security group 11083dcc-e326-406c-a18d-6bc3bd21cf3c does not exist Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: Neutron server returns request_ids: ['req-9f756fcb-ef32-47c0-bfd4-1c4b3ad10a7b'] Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '11083dcc-e326-406c-a18d-6bc3bd21cf3c'} Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 10:34:02.082833 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 11083dcc-e326-406c-a18d-6bc3bd21cf3c does not exist Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f756fcb-ef32-47c0-bfd4-1c4b3ad10a7b'] Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 11083dcc-e326-406c-a18d-6bc3bd21cf3c does not exist Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f756fcb-ef32-47c0-bfd4-1c4b3ad10a7b'] Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 11083dcc-e326-406c-a18d-6bc3bd21cf3c does not exist Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f756fcb-ef32-47c0-bfd4-1c4b3ad10a7b'] Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 11083dcc-e326-406c-a18d-6bc3bd21cf3c does not exist Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f756fcb-ef32-47c0-bfd4-1c4b3ad10a7b'] Jul 28 10:34:02.086676 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:02.093790 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-def6372b-4a0c-43f2-9a93-bcd1d7833023 tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] Returning 404 to user: Security group 11083dcc-e326-406c-a18d-6bc3bd21cf3c does not exist Jul 28 10:34:02.093790 n-d-850468-6 devstack@n-api.service[119464]: Neutron server returns request_ids: ['req-9f756fcb-ef32-47c0-bfd4-1c4b3ad10a7b'] {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:34:02.095449 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-def6372b-4a0c-43f2-9a93-bcd1d7833023 tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/11083dcc-e326-406c-a18d-6bc3bd21cf3c" status: 404 len: 194 microversion: 2.1 time: 0.522041 Jul 28 10:34:02.097260 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 338/639] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:34:01 2022] DELETE /compute/v2.1/os-security-groups/11083dcc-e326-406c-a18d-6bc3bd21cf3c => generated 194 bytes in 524 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:34:02.106929 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-55a0f663-878d-401d-9f1f-1cb738489765 tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004109 Jul 28 10:34:02.108298 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 302/640] 10.222.0.46 () {58 vars in 1164 bytes} [Thu Jul 28 10:34:02 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 10:34:02.125208 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8f03cabf-ae48-4d39-ae01-1a49e04fbe9c tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] Calling method '.version_select at 0x7fa94bb2b310>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:04.032030 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-8f03cabf-ae48-4d39-ae01-1a49e04fbe9c tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.918744 Jul 28 10:34:04.032704 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 339/641] 10.222.0.46 () {58 vars in 1158 bytes} [Thu Jul 28 10:34:02 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:34:04.058383 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b0370ec1-68f8-4db3-9b44-fde57f529c03 tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] Calling method '.version_select at 0x7fa94bce84c0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:06.730368 n-d-850468-6 devstack@n-api.service[119463]: DEBUG neutronclient.v2_0.client [None req-b0370ec1-68f8-4db3-9b44-fde57f529c03 tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119463) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 10:34:06.731912 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-b0370ec1-68f8-4db3-9b44-fde57f529c03 tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 28 10:34:06.731912 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-93883bff-7c52-41cd-bc68-1f28fba56d53'] Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b0370ec1-68f8-4db3-9b44-fde57f529c03 tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] Request method failure captured: Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: request: DELETE /compute/v2.1/os-security-groups/129c236f-94e9-4420-9775-2fe84e9a4704 HTTP/1.1 Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mYZNi2og5ITz4nMDMuXLPDwJuL23kBo3_nGf3dLflZ6UH5T5yE46leUCe5_Twu_G94K4WBqgH0Q8SqffclTHehohtjJluBYxhm1jpO_JWafhta4Gr1YChVQsFoODvniIjUtTIjTocGId91drVM8u0wSjobS-Vssp1eNTHHcracJ42E Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: b3f4b241d557442e9d46300cf50160cf Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1709267486 Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b3f4b241d557442e9d46300cf50160cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3f4b241d557442e9d46300cf50160cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3f4b241d557442e9d46300cf50160cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b3f4b241d557442e9d46300cf50160cf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1709267486 Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: b3f4b241d557442e9d46300cf50160cf Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1709267486 Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-SecurityGroupsNegativeTestJSON-1709267486-project Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: ff5b1313198a4ceab4bd4e26656ebd5b Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1709267486-project Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: exception: Insufficient rights for removing default security group. Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-93883bff-7c52-41cd-bc68-1f28fba56d53'] Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '129c236f-94e9-4420-9775-2fe84e9a4704'} Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 10:34:06.734377 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93883bff-7c52-41cd-bc68-1f28fba56d53'] Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93883bff-7c52-41cd-bc68-1f28fba56d53'] Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93883bff-7c52-41cd-bc68-1f28fba56d53'] Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93883bff-7c52-41cd-bc68-1f28fba56d53'] Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b0370ec1-68f8-4db3-9b44-fde57f529c03 tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-93883bff-7c52-41cd-bc68-1f28fba56d53'] {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:34:06.738477 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b0370ec1-68f8-4db3-9b44-fde57f529c03 tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/129c236f-94e9-4420-9775-2fe84e9a4704" status: 400 len: 182 microversion: 2.1 time: 2.682107 Jul 28 10:34:06.748858 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 303/642] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:34:04 2022] DELETE /compute/v2.1/os-security-groups/129c236f-94e9-4420-9775-2fe84e9a4704 => generated 182 bytes in 2695 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:34:06.769979 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-bd419179-c0c0-4bf6-963f-6bd8a7ffcb6c tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] Calling method '.version_select at 0x7fa94bb2b160>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:06.910988 n-d-850468-6 devstack@n-api.service[119464]: DEBUG neutronclient.v2_0.client [None req-bd419179-c0c0-4bf6-963f-6bd8a7ffcb6c tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group da0a0632-099c-4714-91cf-8e93cf969d0f does not exist", "detail": ""}} {{(pid=119464) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 10:34:06.911602 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.security_group_api [None req-bd419179-c0c0-4bf6-963f-6bd8a7ffcb6c tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] Neutron security group da0a0632-099c-4714-91cf-8e93cf969d0f not found {{(pid=119464) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 10:34:06.912382 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-bd419179-c0c0-4bf6-963f-6bd8a7ffcb6c tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] HTTP exception thrown: Security group da0a0632-099c-4714-91cf-8e93cf969d0f does not exist Jul 28 10:34:06.912382 n-d-850468-6 devstack@n-api.service[119464]: Neutron server returns request_ids: ['req-31d20fca-1930-40f8-9ef2-f1ada6e09a8d'] Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-bd419179-c0c0-4bf6-963f-6bd8a7ffcb6c tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] Request method failure captured: Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-security-groups/da0a0632-099c-4714-91cf-8e93cf969d0f HTTP/1.1 Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mYZNi2og5ITz4nMDMuXLPDwJuL23kBo3_nGf3dLflZ6UH5T5yE46leUCe5_Twu_G94K4WBqgH0Q8SqffclTHehohtjJluBYxhm1jpO_JWafhta4Gr1YChVQsFoODvniIjUtTIjTocGId91drVM8u0wSjobS-Vssp1eNTHHcracJ42E Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: b3f4b241d557442e9d46300cf50160cf Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1709267486 Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b3f4b241d557442e9d46300cf50160cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3f4b241d557442e9d46300cf50160cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3f4b241d557442e9d46300cf50160cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b3f4b241d557442e9d46300cf50160cf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1709267486 Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: b3f4b241d557442e9d46300cf50160cf Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1709267486 Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-SecurityGroupsNegativeTestJSON-1709267486-project Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: ff5b1313198a4ceab4bd4e26656ebd5b Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1709267486-project Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: exception: Security group da0a0632-099c-4714-91cf-8e93cf969d0f does not exist Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: Neutron server returns request_ids: ['req-31d20fca-1930-40f8-9ef2-f1ada6e09a8d'] Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'da0a0632-099c-4714-91cf-8e93cf969d0f'} Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 10:34:06.915932 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group da0a0632-099c-4714-91cf-8e93cf969d0f does not exist Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31d20fca-1930-40f8-9ef2-f1ada6e09a8d'] Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group da0a0632-099c-4714-91cf-8e93cf969d0f does not exist Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31d20fca-1930-40f8-9ef2-f1ada6e09a8d'] Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group da0a0632-099c-4714-91cf-8e93cf969d0f does not exist Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31d20fca-1930-40f8-9ef2-f1ada6e09a8d'] Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group da0a0632-099c-4714-91cf-8e93cf969d0f does not exist Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31d20fca-1930-40f8-9ef2-f1ada6e09a8d'] Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-bd419179-c0c0-4bf6-963f-6bd8a7ffcb6c tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] Returning 404 to user: Security group da0a0632-099c-4714-91cf-8e93cf969d0f does not exist Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: Neutron server returns request_ids: ['req-31d20fca-1930-40f8-9ef2-f1ada6e09a8d'] {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:34:06.922391 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-bd419179-c0c0-4bf6-963f-6bd8a7ffcb6c tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/da0a0632-099c-4714-91cf-8e93cf969d0f" status: 404 len: 194 microversion: 2.1 time: 0.153054 Jul 28 10:34:06.926158 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 340/643] 10.222.0.46 () {58 vars in 1269 bytes} [Thu Jul 28 10:34:06 2022] GET /compute/v2.1/os-security-groups/da0a0632-099c-4714-91cf-8e93cf969d0f => generated 194 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:34:06.942832 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-24550d04-cbf8-4d88-a1d7-bba7ddb44ecf tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] Action: 'update', calling method: .version_select at 0x7fa94bcdff70>, body: {"security_group": {"name": "tempest-sg-1808250616", "description": "tempest-description-832014676"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:07.606540 n-d-850468-6 devstack@n-api.service[119463]: DEBUG neutronclient.v2_0.client [None req-24550d04-cbf8-4d88-a1d7-bba7ddb44ecf tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3dcd2419-e857-4393-a46c-4a069f5313be does not exist", "detail": ""}} {{(pid=119463) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 10:34:07.607654 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.security_group_api [None req-24550d04-cbf8-4d88-a1d7-bba7ddb44ecf tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] Neutron security group 3dcd2419-e857-4393-a46c-4a069f5313be not found {{(pid=119463) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 10:34:07.608482 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-24550d04-cbf8-4d88-a1d7-bba7ddb44ecf tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] HTTP exception thrown: Security group 3dcd2419-e857-4393-a46c-4a069f5313be does not exist Jul 28 10:34:07.608482 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-a65a3ec7-c292-432b-b4e9-25c4aee48a58'] Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-24550d04-cbf8-4d88-a1d7-bba7ddb44ecf tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] Request method failure captured: Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: request: PUT /compute/v2.1/os-security-groups/3dcd2419-e857-4393-a46c-4a069f5313be HTTP/1.1 Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 101 Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mYZNi2og5ITz4nMDMuXLPDwJuL23kBo3_nGf3dLflZ6UH5T5yE46leUCe5_Twu_G94K4WBqgH0Q8SqffclTHehohtjJluBYxhm1jpO_JWafhta4Gr1YChVQsFoODvniIjUtTIjTocGId91drVM8u0wSjobS-Vssp1eNTHHcracJ42E Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: b3f4b241d557442e9d46300cf50160cf Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1709267486 Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b3f4b241d557442e9d46300cf50160cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3f4b241d557442e9d46300cf50160cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3f4b241d557442e9d46300cf50160cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b3f4b241d557442e9d46300cf50160cf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1709267486 Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: b3f4b241d557442e9d46300cf50160cf Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1709267486 Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-SecurityGroupsNegativeTestJSON-1709267486-project Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: ff5b1313198a4ceab4bd4e26656ebd5b Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1709267486-project Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: {"security_group": {"name": "tempest-sg-1808250616", "description": "tempest-description-832014676"}} Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: exception: Security group 3dcd2419-e857-4393-a46c-4a069f5313be does not exist Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-a65a3ec7-c292-432b-b4e9-25c4aee48a58'] Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '3dcd2419-e857-4393-a46c-4a069f5313be', 'body': {'security_group': {'name': 'tempest-sg-1808250616', 'description': 'tempest-description-832014676'}}} Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 10:34:07.611729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3dcd2419-e857-4393-a46c-4a069f5313be does not exist Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a65a3ec7-c292-432b-b4e9-25c4aee48a58'] Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3dcd2419-e857-4393-a46c-4a069f5313be does not exist Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a65a3ec7-c292-432b-b4e9-25c4aee48a58'] Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3dcd2419-e857-4393-a46c-4a069f5313be does not exist Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a65a3ec7-c292-432b-b4e9-25c4aee48a58'] Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3dcd2419-e857-4393-a46c-4a069f5313be does not exist Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a65a3ec7-c292-432b-b4e9-25c4aee48a58'] Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-24550d04-cbf8-4d88-a1d7-bba7ddb44ecf tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] Returning 404 to user: Security group 3dcd2419-e857-4393-a46c-4a069f5313be does not exist Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-a65a3ec7-c292-432b-b4e9-25c4aee48a58'] {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:34:07.617139 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-24550d04-cbf8-4d88-a1d7-bba7ddb44ecf tempest-SecurityGroupsNegativeTestJSON-1709267486 tempest-SecurityGroupsNegativeTestJSON-1709267486-project] 10.222.0.46 "PUT /compute/v2.1/os-security-groups/3dcd2419-e857-4393-a46c-4a069f5313be" status: 404 len: 194 microversion: 2.1 time: 0.678332 Jul 28 10:34:07.630341 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 304/644] 10.222.0.46 () {60 vars in 1290 bytes} [Thu Jul 28 10:34:06 2022] PUT /compute/v2.1/os-security-groups/3dcd2419-e857-4393-a46c-4a069f5313be => generated 194 bytes in 690 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:34:14.799613 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:14.801283 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=6 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:14.803422 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:14.804666 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=10 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:15.002002 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-21b5e489-0456-4267-9487-25c83f3cc9cf tempest-ListImageFiltersNegativeTestJSON-1270736681 tempest-ListImageFiltersNegativeTestJSON-1270736681-project] Calling method '.version_select at 0x7fa94bc39040>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:15.043332 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-21b5e489-0456-4267-9487-25c83f3cc9cf tempest-ListImageFiltersNegativeTestJSON-1270736681 tempest-ListImageFiltersNegativeTestJSON-1270736681-project] HTTP exception thrown: Image not found. Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-21b5e489-0456-4267-9487-25c83f3cc9cf tempest-ListImageFiltersNegativeTestJSON-1270736681 tempest-ListImageFiltersNegativeTestJSON-1270736681-project] Request method failure captured: Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/images/37923df2-d279-4328-b922-eebd62599a51 HTTP/1.1 Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mYmhEQkpFpWgeThPslzA5HDWfOaWG9DFVHT05BfY5pNM2ppJ4hBwt2p9nqXMTUhM4SK2xEJFkBPOvqgwHsQxMdTQuK8jIfmvEHBwjUJBUeCv3Ho9i_YRNAWPMTS_DbPlwyXaCpdASpKvZeHrz7m7ca3oGoWcBiXuid209fGBqb0HYs Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 49f7f985a8de43daadd5450882f9e535 Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1270736681 Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49f7f985a8de43daadd5450882f9e535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49f7f985a8de43daadd5450882f9e535"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49f7f985a8de43daadd5450882f9e535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49f7f985a8de43daadd5450882f9e535", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1270736681 Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 49f7f985a8de43daadd5450882f9e535 Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1270736681 Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ListImageFiltersNegativeTestJSON-1270736681-project Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: bc80da2337e44ae4ad60c21f87282d4c Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1270736681-project Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: exception: Image not found. Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '37923df2-d279-4328-b922-eebd62599a51'} Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 37923df2-d279-4328-b922-eebd62599a51 Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 10:34:15.054161 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 37923df2-d279-4328-b922-eebd62599a51 could not be found. Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-21b5e489-0456-4267-9487-25c83f3cc9cf tempest-ListImageFiltersNegativeTestJSON-1270736681 tempest-ListImageFiltersNegativeTestJSON-1270736681-project] Returning 404 to user: Image not found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-21b5e489-0456-4267-9487-25c83f3cc9cf tempest-ListImageFiltersNegativeTestJSON-1270736681 tempest-ListImageFiltersNegativeTestJSON-1270736681-project] 10.222.0.46 "GET /compute/v2.1/images/37923df2-d279-4328-b922-eebd62599a51" status: 404 len: 62 microversion: 2.1 time: 0.271139 Jul 28 10:34:15.062810 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 341/645] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Jul 28 10:34:14 2022] GET /compute/v2.1/images/37923df2-d279-4328-b922-eebd62599a51 => generated 62 bytes in 273 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:34:20.851256 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:20.851256 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:20.851256 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=26,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:21.206192 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a69fcf60-e544-40c5-851b-d8c5ec07f28a tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Action: 'create', calling method: .version_select at 0x7fa94bc73e50>, body: {"keypair": {"name": "tempest-keypair-112669465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgNkz5erHuQ/+6Gqc8lqwj/Ck6SnNHcC24XErN8SHMZJjiKBnzz0p7VfUvgyHuz9IwTfZ32uGIkRTGkc7pDUSlRc+nMN4g5jT7iUHSRWkifNhlPXScRJWt3FyatUVu7wA=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:21.255285 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-a69fcf60-e544-40c5-851b-d8c5ec07f28a tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Getting quotas for project a40c7975f5864186ba3fce207a2b2c65. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:34:21.264581 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-a69fcf60-e544-40c5-851b-d8c5ec07f28a tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Getting quotas for user f554affb9d74495293e09daded324c6e and project a40c7975f5864186ba3fce207a2b2c65. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:34:21.316093 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a69fcf60-e544-40c5-851b-d8c5ec07f28a tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.468795 Jul 28 10:34:21.317470 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 305/646] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:34:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:34:21.329131 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2a1ce035-66f5-426b-8a6c-06c455e4aae3 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Calling method '.version_select at 0x7fa94bb2b3a0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:21.358802 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-2a1ce035-66f5-426b-8a6c-06c455e4aae3 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs/tempest-keypair-112669465" status: 200 len: 497 microversion: 2.1 time: 0.033770 Jul 28 10:34:21.372417 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 342/647] 10.222.0.46 () {58 vars in 1215 bytes} [Thu Jul 28 10:34:21 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-112669465 => generated 497 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:34:21.383086 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-85cc65c3-7364-443b-b644-e27d32ab3958 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Calling method '.version_select at 0x7fa94bce8820>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:21.435832 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-85cc65c3-7364-443b-b644-e27d32ab3958 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-112669465" status: 202 len: 0 microversion: 2.1 time: 0.058297 Jul 28 10:34:21.437207 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 306/648] 10.222.0.46 () {58 vars in 1218 bytes} [Thu Jul 28 10:34:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-112669465 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:34:21.450564 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-27fec868-6ea1-4264-8f17-4bc2f6a92a42 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Action: 'create', calling method: .version_select at 0x7fa94bd8af70>, body: {"keypair": {"name": "tempest-keypair-1329397838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7XdOhFtF1pfmxAAkKX5J6uOsddZlg21fItgTOWoD0U+LCnEcgXDjctVQuPFKFVwaD5bIhiYxEujV9tWEoEaursYmeS0HkloOIb4XZezR2r14LC2QkrtOFu0StGltcd0w=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:21.499636 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-27fec868-6ea1-4264-8f17-4bc2f6a92a42 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Getting quotas for project a40c7975f5864186ba3fce207a2b2c65. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:34:21.529011 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-27fec868-6ea1-4264-8f17-4bc2f6a92a42 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Getting quotas for user f554affb9d74495293e09daded324c6e and project a40c7975f5864186ba3fce207a2b2c65. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:34:21.613966 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-27fec868-6ea1-4264-8f17-4bc2f6a92a42 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.167238 Jul 28 10:34:21.615881 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 343/649] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:34:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:34:21.627966 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-30e1b5c8-7eba-4e4e-aa42-49f3f23b4331 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Calling method '.version_select at 0x7fa94bbe0790>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:21.694970 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-30e1b5c8-7eba-4e4e-aa42-49f3f23b4331 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1329397838" status: 202 len: 0 microversion: 2.1 time: 0.071294 Jul 28 10:34:21.696045 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 307/650] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Jul 28 10:34:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1329397838 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:34:21.706454 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fcdc7b27-9160-4a3f-a711-ae30849d98c1 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Action: 'create', calling method: .version_select at 0x7fa94badf700>, body: {"keypair": {"name": "tempest-keypair-707672674", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:21.752587 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-fcdc7b27-9160-4a3f-a711-ae30849d98c1 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Getting quotas for project a40c7975f5864186ba3fce207a2b2c65. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:34:21.771006 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-fcdc7b27-9160-4a3f-a711-ae30849d98c1 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Getting quotas for user f554affb9d74495293e09daded324c6e and project a40c7975f5864186ba3fce207a2b2c65. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:34:21.828615 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-fcdc7b27-9160-4a3f-a711-ae30849d98c1 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.126159 Jul 28 10:34:21.829317 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 344/651] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:34:21 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:34:21.848695 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4085eadf-4373-4f16-ab99-adac74338d36 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Calling method '.version_select at 0x7fa94bbf5700>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:21.919031 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-4085eadf-4373-4f16-ab99-adac74338d36 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-707672674" status: 202 len: 0 microversion: 2.1 time: 0.082853 Jul 28 10:34:21.920089 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 308/652] 10.222.0.46 () {58 vars in 1218 bytes} [Thu Jul 28 10:34:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-707672674 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:34:21.931813 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-117ff199-234c-4509-8694-fa2f4fdb393f tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Action: 'create', calling method: .version_select at 0x7fa94bb2b1f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1611038013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzGjzWFuE5bKWLm7ulwTyFUvXQFU0MBKnkA6L37sTFClm+4/Zyzin8GO5S4wChllAv+jS+1K5XP6H1nX/n77VrVB/zUYaIp3ARAI+bSrMC2ll/uRMWRQkFiqazNPLXhYA=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:21.971038 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-117ff199-234c-4509-8694-fa2f4fdb393f tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Getting quotas for project a40c7975f5864186ba3fce207a2b2c65. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:34:21.986677 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-117ff199-234c-4509-8694-fa2f4fdb393f tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Getting quotas for user f554affb9d74495293e09daded324c6e and project a40c7975f5864186ba3fce207a2b2c65. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:34:22.035625 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-117ff199-234c-4509-8694-fa2f4fdb393f tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.108183 Jul 28 10:34:22.037014 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 345/653] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:34:21 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:34:22.051947 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-75b348d3-7b5d-4d74-8ce5-5de3959afd73 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Action: 'create', calling method: .version_select at 0x7fa94bba84c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1559974382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmaX8c4FBvkBWxckKBkNxDbAs5DaQgFzL924e4FR2NpSeULyvBYrDXQuARzyf+PZTHhlZlDn9m64rh+00R7Hcbb5JIlpPCAlBkbPtFQjuYi6yOmS7VeGsF1fYZhYcySQQ=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:22.091900 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-75b348d3-7b5d-4d74-8ce5-5de3959afd73 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Getting quotas for project a40c7975f5864186ba3fce207a2b2c65. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:34:22.104410 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-75b348d3-7b5d-4d74-8ce5-5de3959afd73 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Getting quotas for user f554affb9d74495293e09daded324c6e and project a40c7975f5864186ba3fce207a2b2c65. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:34:22.170964 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-75b348d3-7b5d-4d74-8ce5-5de3959afd73 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.123315 Jul 28 10:34:22.172181 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 309/654] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:34:22 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:34:22.186203 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5c2d0d21-712e-433a-a8f8-2e527ac1a03c tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Action: 'create', calling method: .version_select at 0x7fa94bc39af0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-243904695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONlUC3X39t/fOVMSJyYbffOzST6BKe3aaFnWiEyyEZZ5j/wMQ8O1eUmRtYKwoWa4x32ZhXpw98/V0BTuowZp72iWKIU3nZ9Ky7ay+lBV9Lzp/WwEoUzesPs+7AvCDz4/Q=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:22.222373 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-5c2d0d21-712e-433a-a8f8-2e527ac1a03c tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Getting quotas for project a40c7975f5864186ba3fce207a2b2c65. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:34:22.236311 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-5c2d0d21-712e-433a-a8f8-2e527ac1a03c tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Getting quotas for user f554affb9d74495293e09daded324c6e and project a40c7975f5864186ba3fce207a2b2c65. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:34:22.297572 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-5c2d0d21-712e-433a-a8f8-2e527ac1a03c tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.115401 Jul 28 10:34:22.298429 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 346/655] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:34:22 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:34:22.310024 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-84be0d90-6bc2-45f1-8ba4-a3f081afba0a tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Calling method '.version_select at 0x7fa94bc16af0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:22.315079 n-d-850468-6 devstack@n-api.service[119463]: WARNING oslo_db.sqlalchemy.utils [None req-84be0d90-6bc2-45f1-8ba4-a3f081afba0a tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 28 10:34:22.334692 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-84be0d90-6bc2-45f1-8ba4-a3f081afba0a tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.028987 Jul 28 10:34:22.335754 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 310/656] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 10:34:22 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:34:22.346921 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-45d68c9c-6033-4c49-90a5-8b22b6b13f32 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Calling method '.version_select at 0x7fa94bc735e0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:22.386962 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-45d68c9c-6033-4c49-90a5-8b22b6b13f32 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-243904695" status: 202 len: 0 microversion: 2.1 time: 0.044079 Jul 28 10:34:22.388262 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 347/657] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Jul 28 10:34:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-243904695 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:34:22.396178 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8d11a3f0-8a14-415b-809b-56ebc04d06be tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Calling method '.version_select at 0x7fa94bc15280>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:22.453118 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-8d11a3f0-8a14-415b-809b-56ebc04d06be tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1559974382" status: 202 len: 0 microversion: 2.1 time: 0.060650 Jul 28 10:34:22.454321 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 311/658] 10.222.0.46 () {58 vars in 1278 bytes} [Thu Jul 28 10:34:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1559974382 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:34:22.462378 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fd9f37d6-4f81-48f1-9f82-74f15b70a9c5 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] Calling method '.version_select at 0x7fa94baa71f0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:22.508345 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-fd9f37d6-4f81-48f1-9f82-74f15b70a9c5 tempest-KeyPairsV2TestJSON-1066069336 tempest-KeyPairsV2TestJSON-1066069336-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1611038013" status: 202 len: 0 microversion: 2.1 time: 0.049826 Jul 28 10:34:22.509559 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 348/659] 10.222.0.46 () {58 vars in 1278 bytes} [Thu Jul 28 10:34:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1611038013 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:34:28.435475 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7b293bb9-7a11-4530-a553-dc9be91901a9 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Action: 'create', calling method: .version_select at 0x7fa94bcdfaf0>, body: {"keypair": {"name": "tempest-keypair-52299278", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANH/WSYmge56Ag412NDZTAPBw0uQNGQ/u/hodLHDTxLMMJntbNTngyCpokoOHejMj7NREhziwO6ORNymoAC2OTRRmpDZtoWTAWrXHU3BucD2f5BjUCPcIoAUnrQfbr24g=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:28.499121 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-7b293bb9-7a11-4530-a553-dc9be91901a9 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Getting quotas for project 085316428d834b6cb9dcb36971da849e. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:34:28.520436 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-7b293bb9-7a11-4530-a553-dc9be91901a9 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Getting quotas for user 26c9e7d2d9e749e083012fa3766bcdbf and project 085316428d834b6cb9dcb36971da849e. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:34:28.610213 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-7b293bb9-7a11-4530-a553-dc9be91901a9 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.552507 Jul 28 10:34:28.617405 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 312/660] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:34:28 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:34:38.395791 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=16 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:38.396480 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:38.664025 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1675349590", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "7d84b49c-cb51-4ace-8f82-73eee38a72f5"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:38.765785 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] validate_networks() for [('7d84b49c-cb51-4ace-8f82-73eee38a72f5', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:34:39.878353 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=12 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:39.880178 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:39.965113 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2c80bcf1-e7ff-4cf9-b084-89ac45e83c72 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Action: 'create', calling method: .version_select at 0x7fa94bba80d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-725341732", "description": "tempest-description-1394031356"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:40.909995 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:34:40.910604 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:34:40.912443 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:34:40.912973 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:34:40.916053 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:34:40.940910 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:40.950278 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:40.963100 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:40.964720 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:41.033128 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Getting quotas for project 3d3c6ce1bdd34c78800e0f6572353dc7. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:34:41.057546 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Getting quotas for user 5c6a8fcb371a49d99acc086a95a34671 and project 3d3c6ce1bdd34c78800e0f6572353dc7. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:34:41.118006 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:34:41.121273 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] [instance: dd650546-57be-43f7-b5d9-f356e11ec6bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:34:41.259762 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-56909670-e614-47e8-8e0b-a3aa84498648 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.864815 Jul 28 10:34:41.267217 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 349/661] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:34:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:34:41.298752 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ec220c7a-0e60-46a6-9684-206fe05f83a3 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:41.303839 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ec220c7a-0e60-46a6-9684-206fe05f83a3 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] [instance: dd650546-57be-43f7-b5d9-f356e11ec6bb] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:41.576636 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-2c80bcf1-e7ff-4cf9-b084-89ac45e83c72 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.704581 Jul 28 10:34:41.577225 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 313/662] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:34:39 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:34:41.591774 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-23a066f4-d8c0-458f-8104-ff10db3f1df7 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Action: 'create', calling method: .version_select at 0x7fa94bc738b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-586067630", "description": "tempest-description-1153881449"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:41.666266 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-ec220c7a-0e60-46a6-9684-206fe05f83a3 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6a8fcb371a49d99acc086a95a34671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3c6ce1bdd34c78800e0f6572353dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:34:41.676640 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ec220c7a-0e60-46a6-9684-206fe05f83a3 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] 10.222.0.46 "GET /compute/v2.1/servers/dd650546-57be-43f7-b5d9-f356e11ec6bb" status: 200 len: 1217 microversion: 2.1 time: 0.404078 Jul 28 10:34:41.702153 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 350/663] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:34:41 2022] GET /compute/v2.1/servers/dd650546-57be-43f7-b5d9-f356e11ec6bb => generated 1217 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:34:42.708556 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5d66cbc8-6bb3-44fc-a374-a29a31ea6b20 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:42.710317 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5d66cbc8-6bb3-44fc-a374-a29a31ea6b20 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] [instance: dd650546-57be-43f7-b5d9-f356e11ec6bb] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:42.731787 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5d66cbc8-6bb3-44fc-a374-a29a31ea6b20 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:42.737452 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5d66cbc8-6bb3-44fc-a374-a29a31ea6b20 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:42.739295 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5d66cbc8-6bb3-44fc-a374-a29a31ea6b20 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:42.740882 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5d66cbc8-6bb3-44fc-a374-a29a31ea6b20 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:42.845284 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5d66cbc8-6bb3-44fc-a374-a29a31ea6b20 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:42.847996 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5d66cbc8-6bb3-44fc-a374-a29a31ea6b20 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:42.851891 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-5d66cbc8-6bb3-44fc-a374-a29a31ea6b20 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lazy-loading 'fault' on Instance uuid dd650546-57be-43f7-b5d9-f356e11ec6bb {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:34:42.947207 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-5d66cbc8-6bb3-44fc-a374-a29a31ea6b20 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6a8fcb371a49d99acc086a95a34671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3c6ce1bdd34c78800e0f6572353dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:34:42.961324 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-5d66cbc8-6bb3-44fc-a374-a29a31ea6b20 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] 10.222.0.46 "GET /compute/v2.1/servers/dd650546-57be-43f7-b5d9-f356e11ec6bb" status: 200 len: 1290 microversion: 2.1 time: 0.254891 Jul 28 10:34:42.966720 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 351/664] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:34:42 2022] GET /compute/v2.1/servers/dd650546-57be-43f7-b5d9-f356e11ec6bb => generated 1290 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:34:43.160032 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-23a066f4-d8c0-458f-8104-ff10db3f1df7 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.573605 Jul 28 10:34:43.174481 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 314/665] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:34:41 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:34:43.264216 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1399b23b-40f7-4ced-a932-85853684adbe tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Action: 'create', calling method: .version_select at 0x7fa94badf9d0>, body: {"keypair": {"name": "tempest-keypair-1426958065", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4YAxaq+r28hQeDKP7z9P/ih3pICLxOhruFoOdNttjqFBiXbJNWto65aQ7R4RNzQ1zd/Dcnad8/qUbcCcV6fNX5QiDS3G1nTEhRoc4Pb+a8qeSW4Gs5uy7caxMBTB2BpA=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:43.351573 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-1399b23b-40f7-4ced-a932-85853684adbe tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Getting quotas for project b02b39bdd29b4b53b3a897e9eef4615e. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:34:43.366051 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-1399b23b-40f7-4ced-a932-85853684adbe tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Getting quotas for user c63c56a0062b4c8c89a94284857e17c2 and project b02b39bdd29b4b53b3a897e9eef4615e. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:34:43.431055 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2124132903", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "fc480ddc-689b-4a08-ab44-677bf4b84cd1"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:43.492898 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1399b23b-40f7-4ced-a932-85853684adbe tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.490597 Jul 28 10:34:43.522943 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 352/666] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:34:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:34:43.548728 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f777c7e3-297f-4e8d-b6ea-dff8b19a88f6 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:43.550978 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-f777c7e3-297f-4e8d-b6ea-dff8b19a88f6 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] [instance: dd650546-57be-43f7-b5d9-f356e11ec6bb] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:43.587062 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f777c7e3-297f-4e8d-b6ea-dff8b19a88f6 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:43.593823 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f777c7e3-297f-4e8d-b6ea-dff8b19a88f6 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:43.602129 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f777c7e3-297f-4e8d-b6ea-dff8b19a88f6 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:43.603629 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f777c7e3-297f-4e8d-b6ea-dff8b19a88f6 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:43.647146 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] validate_networks() for [('fc480ddc-689b-4a08-ab44-677bf4b84cd1', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:34:43.711026 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-f777c7e3-297f-4e8d-b6ea-dff8b19a88f6 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] [instance: dd650546-57be-43f7-b5d9-f356e11ec6bb] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:34:43.856688 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-f777c7e3-297f-4e8d-b6ea-dff8b19a88f6 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] [instance: dd650546-57be-43f7-b5d9-f356e11ec6bb] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:34:43.862548 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f777c7e3-297f-4e8d-b6ea-dff8b19a88f6 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:43.863260 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f777c7e3-297f-4e8d-b6ea-dff8b19a88f6 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:43.863876 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-f777c7e3-297f-4e8d-b6ea-dff8b19a88f6 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] [instance: dd650546-57be-43f7-b5d9-f356e11ec6bb] instance's host None is down, deleting from database Jul 28 10:34:43.874532 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-f777c7e3-297f-4e8d-b6ea-dff8b19a88f6 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] [instance: dd650546-57be-43f7-b5d9-f356e11ec6bb] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:34:43.937730 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-f777c7e3-297f-4e8d-b6ea-dff8b19a88f6 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] [instance: dd650546-57be-43f7-b5d9-f356e11ec6bb] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:34:43.945457 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-f777c7e3-297f-4e8d-b6ea-dff8b19a88f6 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] [instance: dd650546-57be-43f7-b5d9-f356e11ec6bb] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:34:44.323751 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f777c7e3-297f-4e8d-b6ea-dff8b19a88f6 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dd650546-57be-43f7-b5d9-f356e11ec6bb" status: 204 len: 0 microversion: 2.1 time: 0.794659 Jul 28 10:34:44.325133 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 353/667] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:34:43 2022] DELETE /compute/v2.1/servers/dd650546-57be-43f7-b5d9-f356e11ec6bb => generated 0 bytes in 801 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:34:44.332573 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-663229625", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "23de53e8-d4b8-427a-b6f2-f1a17846e4a1"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:44.451472 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] validate_networks() for [('23de53e8-d4b8-427a-b6f2-f1a17846e4a1', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:34:45.334537 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:34:45.335210 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:34:45.335781 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:34:45.336552 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:34:45.339055 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:34:45.367376 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:45.367840 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:45.372639 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:45.374414 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:45.436672 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Getting quotas for project c3c8659bbba84bbfb32e446ba294d81e. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:34:45.468841 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Getting quotas for user b654c9ee44d245a586f01fcdc20f3deb and project c3c8659bbba84bbfb32e446ba294d81e. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:34:45.524513 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:34:45.540680 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:34:45.683527 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-6ebcab10-bc2e-4dea-a73b-e146a92bfb81 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.356850 Jul 28 10:34:45.686314 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 354/668] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:34:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:34:45.694906 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-93b156f5-bd14-4385-a6b3-8919af73b365 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:45.695813 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-93b156f5-bd14-4385-a6b3-8919af73b365 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] [instance: dd650546-57be-43f7-b5d9-f356e11ec6bb] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:45.705649 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-93b156f5-bd14-4385-a6b3-8919af73b365 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:45.706551 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-93b156f5-bd14-4385-a6b3-8919af73b365 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:45.708149 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-93b156f5-bd14-4385-a6b3-8919af73b365 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:45.709372 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-93b156f5-bd14-4385-a6b3-8919af73b365 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:45.768569 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-93b156f5-bd14-4385-a6b3-8919af73b365 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] HTTP exception thrown: Instance dd650546-57be-43f7-b5d9-f356e11ec6bb could not be found. Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-93b156f5-bd14-4385-a6b3-8919af73b365 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Request method failure captured: Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/dd650546-57be-43f7-b5d9-f356e11ec6bb HTTP/1.1 Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mY9xEke2qict7tl6w0AGRRn3mFGrkxbLc8ICewR-qDUbXyDT4BlWjV9YEgYeEaf7RUsrAJvRd-4mjoFkI9KMhRAUcJ1PzVjdfAtfEBFyjz7WG06BZQ7qKhAXARRomuSwV5jBvR1VgXAj_lWiBX35ypmT1tpND9un5st8kOePyfikfc Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 3d3c6ce1bdd34c78800e0f6572353dc7 Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ServersNegativeTestJSON-1378896041 Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3d3c6ce1bdd34c78800e0f6572353dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3d3c6ce1bdd34c78800e0f6572353dc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3d3c6ce1bdd34c78800e0f6572353dc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3d3c6ce1bdd34c78800e0f6572353dc7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ServersNegativeTestJSON-1378896041 Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 3d3c6ce1bdd34c78800e0f6572353dc7 Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1378896041 Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ServersNegativeTestJSON-1378896041-project Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 5c6a8fcb371a49d99acc086a95a34671 Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ServersNegativeTestJSON-1378896041-project Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance dd650546-57be-43f7-b5d9-f356e11ec6bb could not be found. Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'dd650546-57be-43f7-b5d9-f356e11ec6bb'} Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd650546-57be-43f7-b5d9-f356e11ec6bb could not be found. Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd650546-57be-43f7-b5d9-f356e11ec6bb could not be found. Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:45.771508 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:45.777099 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:45.777099 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:45.777099 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:45.777099 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:34:45.777099 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:34:45.777099 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd650546-57be-43f7-b5d9-f356e11ec6bb could not be found. Jul 28 10:34:45.777099 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:45.778225 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-93b156f5-bd14-4385-a6b3-8919af73b365 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] Returning 404 to user: Instance dd650546-57be-43f7-b5d9-f356e11ec6bb could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:34:45.779816 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-93b156f5-bd14-4385-a6b3-8919af73b365 tempest-ServersNegativeTestJSON-1378896041 tempest-ServersNegativeTestJSON-1378896041-project] 10.222.0.46 "GET /compute/v2.1/servers/dd650546-57be-43f7-b5d9-f356e11ec6bb" status: 404 len: 111 microversion: 2.1 time: 0.093930 Jul 28 10:34:45.780721 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 355/669] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:34:45 2022] GET /compute/v2.1/servers/dd650546-57be-43f7-b5d9-f356e11ec6bb => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:34:45.912593 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-2061383272", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:46.005908 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] validate_networks() for [('6f902966-98c1-44c4-af50-2fc3082cde5c', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:34:46.464818 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:34:46.465411 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:34:46.468900 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:34:46.469763 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:34:46.471928 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:34:46.492830 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:46.494729 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:46.495754 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:46.498487 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:46.538486 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Getting quotas for project 70ceba76ab9744e7a0ae4f2438709f7d. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:34:46.553748 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Getting quotas for user e28dd90a9b204ee78200f89abd27052a and project 70ceba76ab9744e7a0ae4f2438709f7d. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:34:46.580563 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:34:46.583976 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: b1bdd966-5cf1-42b9-8be0-734e8cf8038c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:34:46.693348 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b2a62846-8738-4008-a488-15ac3efacf6f tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.517030 Jul 28 10:34:46.705403 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 315/670] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:34:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:34:46.737377 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-882533546", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5e9009e8-cc0d-47f0-b30c-3a342cf000b2"}], "security_groups": [{"name": "tempest-securitygroup--1467950131"}], "key_name": "tempest-keypair-52299278", "user_data": "}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:46.977540 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] validate_networks() for [('5e9009e8-cc0d-47f0-b30c-3a342cf000b2', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:34:48.298392 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:34:48.299164 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:34:48.299311 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:34:48.299672 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:34:48.304213 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:34:48.324312 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:48.325030 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:48.326124 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:48.329379 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:48.388579 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Getting quotas for project f6fa60c299e540a2a9c0781ddcf9edb6. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:34:48.403964 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Getting quotas for user bb5168111bae4c90bfb6fcf690e70b28 and project f6fa60c299e540a2a9c0781ddcf9edb6. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:34:48.455243 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:34:48.467971 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] [instance: b63a4244-5063-44f1-8ebd-5167853de2c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:34:48.587042 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f1477246-3dba-4136-9f68-60dc4a08367c tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.804386 Jul 28 10:34:48.596480 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 356/671] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:34:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 2815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:34:48.606509 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b2005b36-13ca-4a14-bc6a-610a75264e60 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:48.607246 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b2005b36-13ca-4a14-bc6a-610a75264e60 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:48.617426 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b2005b36-13ca-4a14-bc6a-610a75264e60 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:48.621006 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b2005b36-13ca-4a14-bc6a-610a75264e60 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:48.622051 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b2005b36-13ca-4a14-bc6a-610a75264e60 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:48.624684 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:34:48.625166 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:34:48.625277 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b2005b36-13ca-4a14-bc6a-610a75264e60 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:48.625571 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:34:48.626249 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:34:48.626676 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:34:48.657711 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:48.658306 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:48.659224 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:48.659667 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:48.707790 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b2005b36-13ca-4a14-bc6a-610a75264e60 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:48.708395 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b2005b36-13ca-4a14-bc6a-610a75264e60 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:48.708969 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-b2005b36-13ca-4a14-bc6a-610a75264e60 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lazy-loading 'fault' on Instance uuid fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:34:48.750718 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Getting quotas for project 085316428d834b6cb9dcb36971da849e. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:34:48.783166 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Getting quotas for user 26c9e7d2d9e749e083012fa3766bcdbf and project 085316428d834b6cb9dcb36971da849e. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:34:48.835154 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:34:48.838213 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] [instance: 8a8c328b-ff3d-47ce-9338-2365089417b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:34:48.906858 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e45de442-3840-4e12-ab8f-bf69c7cf6d1b tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.199731 Jul 28 10:34:48.907947 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 316/672] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:34:46 2022] POST /compute/v2.1/servers => generated 409 bytes in 2202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:34:48.917225 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-b2005b36-13ca-4a14-bc6a-610a75264e60 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654c9ee44d245a586f01fcdc20f3deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c8659bbba84bbfb32e446ba294d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:34:48.929029 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8f30e615-f527-4bbc-9b18-01326b655750 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:48.931405 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b2005b36-13ca-4a14-bc6a-610a75264e60 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb" status: 200 len: 1288 microversion: 2.1 time: 0.332776 Jul 28 10:34:48.931630 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-8f30e615-f527-4bbc-9b18-01326b655750 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: b1bdd966-5cf1-42b9-8be0-734e8cf8038c] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:48.934283 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 357/673] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:34:48 2022] GET /compute/v2.1/servers/fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb => generated 1288 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:34:48.956258 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e7339ee4-0055-4bb8-89b8-b27e77c98efd tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:48.956940 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-e7339ee4-0055-4bb8-89b8-b27e77c98efd tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] [instance: b63a4244-5063-44f1-8ebd-5167853de2c9] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:48.958722 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8f30e615-f527-4bbc-9b18-01326b655750 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:48.960203 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8f30e615-f527-4bbc-9b18-01326b655750 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:48.967735 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8f30e615-f527-4bbc-9b18-01326b655750 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:48.968358 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8f30e615-f527-4bbc-9b18-01326b655750 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:48.984408 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e7339ee4-0055-4bb8-89b8-b27e77c98efd tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:48.986082 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e7339ee4-0055-4bb8-89b8-b27e77c98efd tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:48.987134 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e7339ee4-0055-4bb8-89b8-b27e77c98efd tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:48.992689 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e7339ee4-0055-4bb8-89b8-b27e77c98efd tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:49.105842 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8f30e615-f527-4bbc-9b18-01326b655750 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:49.110488 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8f30e615-f527-4bbc-9b18-01326b655750 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:49.114201 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-8f30e615-f527-4bbc-9b18-01326b655750 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lazy-loading 'fault' on Instance uuid b1bdd966-5cf1-42b9-8be0-734e8cf8038c {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:34:49.325507 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-e7339ee4-0055-4bb8-89b8-b27e77c98efd tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5168111bae4c90bfb6fcf690e70b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fa60c299e540a2a9c0781ddcf9edb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:34:49.359555 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e7339ee4-0055-4bb8-89b8-b27e77c98efd tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] 10.222.0.46 "GET /compute/v2.1/servers/b63a4244-5063-44f1-8ebd-5167853de2c9" status: 200 len: 1223 microversion: 2.1 time: 0.422680 Jul 28 10:34:49.360524 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 358/674] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:34:48 2022] GET /compute/v2.1/servers/b63a4244-5063-44f1-8ebd-5167853de2c9 => generated 1223 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:34:49.389017 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a69257dc-ac7a-498e-991a-4c15f5bd84d6 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:49.391883 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a69257dc-ac7a-498e-991a-4c15f5bd84d6 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] [instance: 8a8c328b-ff3d-47ce-9338-2365089417b4] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:49.420604 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a69257dc-ac7a-498e-991a-4c15f5bd84d6 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:49.424505 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a69257dc-ac7a-498e-991a-4c15f5bd84d6 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:49.429129 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a69257dc-ac7a-498e-991a-4c15f5bd84d6 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:49.431245 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a69257dc-ac7a-498e-991a-4c15f5bd84d6 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:49.503633 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-8f30e615-f527-4bbc-9b18-01326b655750 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28dd90a9b204ee78200f89abd27052a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ceba76ab9744e7a0ae4f2438709f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:34:49.528682 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-8f30e615-f527-4bbc-9b18-01326b655750 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] 10.222.0.46 "GET /compute/v2.1/servers/b1bdd966-5cf1-42b9-8be0-734e8cf8038c" status: 200 len: 1284 microversion: 2.1 time: 0.618840 Jul 28 10:34:49.535011 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 317/675] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:34:48 2022] GET /compute/v2.1/servers/b1bdd966-5cf1-42b9-8be0-734e8cf8038c => generated 1284 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:34:49.672501 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-a69257dc-ac7a-498e-991a-4c15f5bd84d6 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9e7d2d9e749e083012fa3766bcdbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085316428d834b6cb9dcb36971da849e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:34:49.685725 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a69257dc-ac7a-498e-991a-4c15f5bd84d6 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] 10.222.0.46 "GET /compute/v2.1/servers/8a8c328b-ff3d-47ce-9338-2365089417b4" status: 200 len: 1236 microversion: 2.1 time: 0.318696 Jul 28 10:34:49.707111 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 359/676] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:34:49 2022] GET /compute/v2.1/servers/8a8c328b-ff3d-47ce-9338-2365089417b4 => generated 1236 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:34:49.959321 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-016b92ee-9bbf-43b5-b2ab-a14f25adaf62 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:49.960059 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-016b92ee-9bbf-43b5-b2ab-a14f25adaf62 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:49.982411 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-016b92ee-9bbf-43b5-b2ab-a14f25adaf62 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:49.984307 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-016b92ee-9bbf-43b5-b2ab-a14f25adaf62 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:49.987890 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-016b92ee-9bbf-43b5-b2ab-a14f25adaf62 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:49.989688 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-016b92ee-9bbf-43b5-b2ab-a14f25adaf62 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:50.135354 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-016b92ee-9bbf-43b5-b2ab-a14f25adaf62 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:50.147442 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-016b92ee-9bbf-43b5-b2ab-a14f25adaf62 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:50.147442 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-016b92ee-9bbf-43b5-b2ab-a14f25adaf62 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lazy-loading 'fault' on Instance uuid fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:34:50.342714 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-016b92ee-9bbf-43b5-b2ab-a14f25adaf62 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654c9ee44d245a586f01fcdc20f3deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c8659bbba84bbfb32e446ba294d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:34:50.356642 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-016b92ee-9bbf-43b5-b2ab-a14f25adaf62 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb" status: 200 len: 1288 microversion: 2.1 time: 0.401737 Jul 28 10:34:50.357684 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 318/677] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:34:49 2022] GET /compute/v2.1/servers/fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb => generated 1288 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:34:50.392369 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d09ba936-d578-4d52-a139-b6cba92d0d2b tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:50.395983 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-46dc98d9-e875-4d19-aa84-8d4f19e2f5e9 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:50.397228 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-d09ba936-d578-4d52-a139-b6cba92d0d2b tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:50.398175 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-46dc98d9-e875-4d19-aa84-8d4f19e2f5e9 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] [instance: b63a4244-5063-44f1-8ebd-5167853de2c9] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:50.415528 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d09ba936-d578-4d52-a139-b6cba92d0d2b tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:50.422898 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d09ba936-d578-4d52-a139-b6cba92d0d2b tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:50.425212 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d09ba936-d578-4d52-a139-b6cba92d0d2b tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:50.427354 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-46dc98d9-e875-4d19-aa84-8d4f19e2f5e9 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:50.427775 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d09ba936-d578-4d52-a139-b6cba92d0d2b tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:50.431324 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-46dc98d9-e875-4d19-aa84-8d4f19e2f5e9 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:50.433449 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-46dc98d9-e875-4d19-aa84-8d4f19e2f5e9 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:50.435878 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-46dc98d9-e875-4d19-aa84-8d4f19e2f5e9 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:50.486952 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-d09ba936-d578-4d52-a139-b6cba92d0d2b tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:34:50.554819 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-46dc98d9-e875-4d19-aa84-8d4f19e2f5e9 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:50.555271 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-46dc98d9-e875-4d19-aa84-8d4f19e2f5e9 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:50.560717 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-46dc98d9-e875-4d19-aa84-8d4f19e2f5e9 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lazy-loading 'fault' on Instance uuid b63a4244-5063-44f1-8ebd-5167853de2c9 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:34:50.584140 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-d09ba936-d578-4d52-a139-b6cba92d0d2b tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:34:50.585353 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d09ba936-d578-4d52-a139-b6cba92d0d2b tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:50.587708 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d09ba936-d578-4d52-a139-b6cba92d0d2b tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:50.597270 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-d09ba936-d578-4d52-a139-b6cba92d0d2b tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb] instance's host None is down, deleting from database Jul 28 10:34:50.601545 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-d09ba936-d578-4d52-a139-b6cba92d0d2b tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:34:50.779728 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-d09ba936-d578-4d52-a139-b6cba92d0d2b tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:34:50.786109 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-d09ba936-d578-4d52-a139-b6cba92d0d2b tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:34:50.929458 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-46dc98d9-e875-4d19-aa84-8d4f19e2f5e9 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5168111bae4c90bfb6fcf690e70b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fa60c299e540a2a9c0781ddcf9edb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:34:50.945160 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-46dc98d9-e875-4d19-aa84-8d4f19e2f5e9 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] 10.222.0.46 "GET /compute/v2.1/servers/b63a4244-5063-44f1-8ebd-5167853de2c9" status: 200 len: 1296 microversion: 2.1 time: 0.563655 Jul 28 10:34:50.960409 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 360/678] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:34:50 2022] GET /compute/v2.1/servers/b63a4244-5063-44f1-8ebd-5167853de2c9 => generated 1296 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:34:50.986919 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1abd41e9-24b8-44e0-a3fe-e6f7b6c08c33 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:50.988315 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-1abd41e9-24b8-44e0-a3fe-e6f7b6c08c33 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: b1bdd966-5cf1-42b9-8be0-734e8cf8038c] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:51.022431 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1abd41e9-24b8-44e0-a3fe-e6f7b6c08c33 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:51.023469 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1abd41e9-24b8-44e0-a3fe-e6f7b6c08c33 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:51.025665 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1abd41e9-24b8-44e0-a3fe-e6f7b6c08c33 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:51.026745 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1abd41e9-24b8-44e0-a3fe-e6f7b6c08c33 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:51.120083 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d09ba936-d578-4d52-a139-b6cba92d0d2b tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb" status: 204 len: 0 microversion: 2.1 time: 0.730484 Jul 28 10:34:51.121148 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 319/679] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:34:50 2022] DELETE /compute/v2.1/servers/fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb => generated 0 bytes in 734 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:34:51.130955 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1abd41e9-24b8-44e0-a3fe-e6f7b6c08c33 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:51.132163 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1abd41e9-24b8-44e0-a3fe-e6f7b6c08c33 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:51.134546 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c995ae7f-92fe-4a37-9fea-a60317a1a9e6 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:51.135693 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-1abd41e9-24b8-44e0-a3fe-e6f7b6c08c33 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lazy-loading 'fault' on Instance uuid b1bdd966-5cf1-42b9-8be0-734e8cf8038c {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:34:51.135812 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c995ae7f-92fe-4a37-9fea-a60317a1a9e6 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] [instance: 8a8c328b-ff3d-47ce-9338-2365089417b4] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:51.155685 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c995ae7f-92fe-4a37-9fea-a60317a1a9e6 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:51.156292 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c995ae7f-92fe-4a37-9fea-a60317a1a9e6 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:51.157145 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c995ae7f-92fe-4a37-9fea-a60317a1a9e6 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:51.158139 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c995ae7f-92fe-4a37-9fea-a60317a1a9e6 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:51.222243 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c995ae7f-92fe-4a37-9fea-a60317a1a9e6 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:51.225405 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c995ae7f-92fe-4a37-9fea-a60317a1a9e6 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:51.227300 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-c995ae7f-92fe-4a37-9fea-a60317a1a9e6 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lazy-loading 'fault' on Instance uuid 8a8c328b-ff3d-47ce-9338-2365089417b4 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:34:51.301107 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-1abd41e9-24b8-44e0-a3fe-e6f7b6c08c33 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28dd90a9b204ee78200f89abd27052a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ceba76ab9744e7a0ae4f2438709f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:34:51.313631 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1abd41e9-24b8-44e0-a3fe-e6f7b6c08c33 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] 10.222.0.46 "GET /compute/v2.1/servers/b1bdd966-5cf1-42b9-8be0-734e8cf8038c" status: 200 len: 1284 microversion: 2.1 time: 0.340003 Jul 28 10:34:51.318152 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 361/680] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:34:50 2022] GET /compute/v2.1/servers/b1bdd966-5cf1-42b9-8be0-734e8cf8038c => generated 1284 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:34:51.337817 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c2f1e63f-bca3-4a4d-afd8-7ec79fce3607 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:51.338475 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c2f1e63f-bca3-4a4d-afd8-7ec79fce3607 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] [instance: b63a4244-5063-44f1-8ebd-5167853de2c9] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:51.350848 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2f1e63f-bca3-4a4d-afd8-7ec79fce3607 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:51.352032 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2f1e63f-bca3-4a4d-afd8-7ec79fce3607 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:51.353893 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2f1e63f-bca3-4a4d-afd8-7ec79fce3607 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:51.354581 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2f1e63f-bca3-4a4d-afd8-7ec79fce3607 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:51.390673 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c2f1e63f-bca3-4a4d-afd8-7ec79fce3607 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] [instance: b63a4244-5063-44f1-8ebd-5167853de2c9] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:34:51.393017 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=81,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:51.477843 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:51.484293 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c2f1e63f-bca3-4a4d-afd8-7ec79fce3607 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] [instance: b63a4244-5063-44f1-8ebd-5167853de2c9] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:34:51.485117 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2f1e63f-bca3-4a4d-afd8-7ec79fce3607 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:51.489736 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2f1e63f-bca3-4a4d-afd8-7ec79fce3607 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:51.492032 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-c995ae7f-92fe-4a37-9fea-a60317a1a9e6 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c9e7d2d9e749e083012fa3766bcdbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085316428d834b6cb9dcb36971da849e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:34:51.493195 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-c2f1e63f-bca3-4a4d-afd8-7ec79fce3607 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] [instance: b63a4244-5063-44f1-8ebd-5167853de2c9] instance's host None is down, deleting from database Jul 28 10:34:51.500767 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-c2f1e63f-bca3-4a4d-afd8-7ec79fce3607 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] [instance: b63a4244-5063-44f1-8ebd-5167853de2c9] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:34:51.504815 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c995ae7f-92fe-4a37-9fea-a60317a1a9e6 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] 10.222.0.46 "GET /compute/v2.1/servers/8a8c328b-ff3d-47ce-9338-2365089417b4" status: 200 len: 1309 microversion: 2.1 time: 0.379620 Jul 28 10:34:51.506650 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 320/681] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:34:51 2022] GET /compute/v2.1/servers/8a8c328b-ff3d-47ce-9338-2365089417b4 => generated 1309 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:34:51.537405 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1de8e497-d04c-4892-b0c5-05f840a663bc tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:51.538065 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1de8e497-d04c-4892-b0c5-05f840a663bc tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:51.565210 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1de8e497-d04c-4892-b0c5-05f840a663bc tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:51.565658 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1de8e497-d04c-4892-b0c5-05f840a663bc tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:51.566611 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1de8e497-d04c-4892-b0c5-05f840a663bc tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:51.566912 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1de8e497-d04c-4892-b0c5-05f840a663bc tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:51.603269 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-1de8e497-d04c-4892-b0c5-05f840a663bc tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] HTTP exception thrown: Instance fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb could not be found. Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1de8e497-d04c-4892-b0c5-05f840a663bc tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Request method failure captured: Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb HTTP/1.1 Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mY_UmWvwobDpxuDusXuiN2X3phLX9PelsodhuWjeKwRX40vPDz77DGyfctYfO-WofaMuk0eodlXgeEoanzuSgoqD0L1e6dbbmhuN4lfHCBWTqD67dSSkuZfve2sLpg4DOdYZlERCclCFU8tmW6N6gpf-xnNEJ8JDLng7SySEVk-QqM Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: c3c8659bbba84bbfb32e446ba294d81e Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c3c8659bbba84bbfb32e446ba294d81e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: c3c8659bbba84bbfb32e446ba294d81e Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-SecurityGroupsTestJSON-1760984738-project Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: b654c9ee44d245a586f01fcdc20f3deb Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-SecurityGroupsTestJSON-1760984738-project Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb could not be found. Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb'} Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb could not be found. Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb could not be found. Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:51.604978 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:51.611868 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:51.611868 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:51.611868 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:51.611868 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:34:51.611868 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:34:51.611868 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb could not be found. Jul 28 10:34:51.611868 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:51.611868 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1de8e497-d04c-4892-b0c5-05f840a663bc tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Returning 404 to user: Instance fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:34:51.611868 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-1de8e497-d04c-4892-b0c5-05f840a663bc tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "GET /compute/v2.1/servers/fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb" status: 404 len: 111 microversion: 2.1 time: 0.085798 Jul 28 10:34:51.615906 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 321/682] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:34:51 2022] GET /compute/v2.1/servers/fa1d85a7-82d4-4029-bd9c-3ecb5acdcbdb => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:34:51.626483 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3e85c497-1199-4db5-ba22-0005e5abdf0b tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:51.626991 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3e85c497-1199-4db5-ba22-0005e5abdf0b tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: b1bdd966-5cf1-42b9-8be0-734e8cf8038c] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:51.640509 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3e85c497-1199-4db5-ba22-0005e5abdf0b tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:51.640963 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3e85c497-1199-4db5-ba22-0005e5abdf0b tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:51.641753 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3e85c497-1199-4db5-ba22-0005e5abdf0b tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:51.650226 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3e85c497-1199-4db5-ba22-0005e5abdf0b tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:51.710247 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-c2f1e63f-bca3-4a4d-afd8-7ec79fce3607 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] [instance: b63a4244-5063-44f1-8ebd-5167853de2c9] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:34:51.718101 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-c2f1e63f-bca3-4a4d-afd8-7ec79fce3607 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] [instance: b63a4244-5063-44f1-8ebd-5167853de2c9] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:34:51.719560 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3e85c497-1199-4db5-ba22-0005e5abdf0b tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: b1bdd966-5cf1-42b9-8be0-734e8cf8038c] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:34:51.828385 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3e85c497-1199-4db5-ba22-0005e5abdf0b tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: b1bdd966-5cf1-42b9-8be0-734e8cf8038c] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:34:51.829368 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3e85c497-1199-4db5-ba22-0005e5abdf0b tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:51.829875 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3e85c497-1199-4db5-ba22-0005e5abdf0b tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:51.830317 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-3e85c497-1199-4db5-ba22-0005e5abdf0b tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: b1bdd966-5cf1-42b9-8be0-734e8cf8038c] instance's host None is down, deleting from database Jul 28 10:34:51.842574 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-3e85c497-1199-4db5-ba22-0005e5abdf0b tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: b1bdd966-5cf1-42b9-8be0-734e8cf8038c] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:34:51.992170 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-3e85c497-1199-4db5-ba22-0005e5abdf0b tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: b1bdd966-5cf1-42b9-8be0-734e8cf8038c] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:34:52.004144 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-3e85c497-1199-4db5-ba22-0005e5abdf0b tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: b1bdd966-5cf1-42b9-8be0-734e8cf8038c] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:34:52.099572 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c2f1e63f-bca3-4a4d-afd8-7ec79fce3607 tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b63a4244-5063-44f1-8ebd-5167853de2c9" status: 204 len: 0 microversion: 2.1 time: 0.779907 Jul 28 10:34:52.100493 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 362/683] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:34:51 2022] DELETE /compute/v2.1/servers/b63a4244-5063-44f1-8ebd-5167853de2c9 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:34:52.112838 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1799810470", "imageRef": "eadb7bcd-74e9-426a-b427-eacbfae65980", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "bc9ddee4-ec9e-40b6-99fd-709c6fbc75d6"}], "security_groups": [{"name": "tempest-securitygroup--33545187"}], "key_name": "tempest-keypair-1426958065", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:52.398425 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=75,nova_cell0:UPDATE=19,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:52.446752 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3e85c497-1199-4db5-ba22-0005e5abdf0b tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b1bdd966-5cf1-42b9-8be0-734e8cf8038c" status: 204 len: 0 microversion: 2.1 time: 0.829571 Jul 28 10:34:52.453147 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 322/684] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:34:51 2022] DELETE /compute/v2.1/servers/b1bdd966-5cf1-42b9-8be0-734e8cf8038c => generated 0 bytes in 836 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:34:52.475858 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c36e713c-f45c-429c-b9ca-8147fc8d94d3 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:52.476375 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c36e713c-f45c-429c-b9ca-8147fc8d94d3 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] [instance: 8a8c328b-ff3d-47ce-9338-2365089417b4] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:52.488807 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c36e713c-f45c-429c-b9ca-8147fc8d94d3 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:52.489295 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c36e713c-f45c-429c-b9ca-8147fc8d94d3 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:52.503762 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c36e713c-f45c-429c-b9ca-8147fc8d94d3 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:52.504398 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c36e713c-f45c-429c-b9ca-8147fc8d94d3 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:52.568419 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] validate_networks() for [('bc9ddee4-ec9e-40b6-99fd-709c6fbc75d6', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:34:52.584549 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c36e713c-f45c-429c-b9ca-8147fc8d94d3 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] [instance: 8a8c328b-ff3d-47ce-9338-2365089417b4] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:34:52.767408 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c36e713c-f45c-429c-b9ca-8147fc8d94d3 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] [instance: 8a8c328b-ff3d-47ce-9338-2365089417b4] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:34:52.768778 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c36e713c-f45c-429c-b9ca-8147fc8d94d3 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:52.773092 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c36e713c-f45c-429c-b9ca-8147fc8d94d3 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:52.778924 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-c36e713c-f45c-429c-b9ca-8147fc8d94d3 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] [instance: 8a8c328b-ff3d-47ce-9338-2365089417b4] instance's host None is down, deleting from database Jul 28 10:34:52.799558 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-c36e713c-f45c-429c-b9ca-8147fc8d94d3 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] [instance: 8a8c328b-ff3d-47ce-9338-2365089417b4] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:34:52.972707 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-c36e713c-f45c-429c-b9ca-8147fc8d94d3 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] [instance: 8a8c328b-ff3d-47ce-9338-2365089417b4] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:34:52.980242 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-c36e713c-f45c-429c-b9ca-8147fc8d94d3 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] [instance: 8a8c328b-ff3d-47ce-9338-2365089417b4] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:34:53.390889 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c36e713c-f45c-429c-b9ca-8147fc8d94d3 tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8a8c328b-ff3d-47ce-9338-2365089417b4" status: 204 len: 0 microversion: 2.1 time: 0.933951 Jul 28 10:34:53.391864 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 323/685] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:34:52 2022] DELETE /compute/v2.1/servers/8a8c328b-ff3d-47ce-9338-2365089417b4 => generated 0 bytes in 938 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:34:53.403643 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-9678e574-426d-42f7-bf1d-30eecdba019e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Action: 'create', calling method: .version_select at 0x7fa94bbf3940>, body: {"security_group": {"name": " tempest-securitygroup -1615472267 ", "description": "tempest-description-1637450505"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:54.194293 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-9678e574-426d-42f7-bf1d-30eecdba019e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.801227 Jul 28 10:34:54.195563 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 324/686] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:34:53 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:34:54.200681 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e2e8bb17-ed51-4a4f-984d-f3a5ea8bc25f tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:54.201589 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-e2e8bb17-ed51-4a4f-984d-f3a5ea8bc25f tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] [instance: b63a4244-5063-44f1-8ebd-5167853de2c9] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:54.227826 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e2e8bb17-ed51-4a4f-984d-f3a5ea8bc25f tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:54.229773 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e2e8bb17-ed51-4a4f-984d-f3a5ea8bc25f tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:54.233970 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e2e8bb17-ed51-4a4f-984d-f3a5ea8bc25f tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:54.236252 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e2e8bb17-ed51-4a4f-984d-f3a5ea8bc25f tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:54.237711 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:34:54.238390 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:34:54.238821 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:34:54.239473 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:34:54.240101 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:34:54.270808 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:54.271137 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-e2e8bb17-ed51-4a4f-984d-f3a5ea8bc25f tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] HTTP exception thrown: Instance b63a4244-5063-44f1-8ebd-5167853de2c9 could not be found. Jul 28 10:34:54.271845 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:54.272912 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:54.274255 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e2e8bb17-ed51-4a4f-984d-f3a5ea8bc25f tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Request method failure captured: Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/b63a4244-5063-44f1-8ebd-5167853de2c9 HTTP/1.1 Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mZEBYhgtenuWrjeoGxdK3ucH63pR0dcRf_b9ama6B0gvbyJF5OZrvZ9YFn3Dcc2TyWKDTcWfGnO-A4mqYilBNOtjAo4e87suQHuWDc4K22GuQluhkivGm3BhtC5u6w5S7bQMdxHLErUXsgHC2AJPtt3rE88TwFHecRb5x8kSqPxLAA Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: f6fa60c299e540a2a9c0781ddcf9edb6 Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-506369624 Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f6fa60c299e540a2a9c0781ddcf9edb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f6fa60c299e540a2a9c0781ddcf9edb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f6fa60c299e540a2a9c0781ddcf9edb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f6fa60c299e540a2a9c0781ddcf9edb6", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-506369624 Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: f6fa60c299e540a2a9c0781ddcf9edb6 Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-506369624 Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServerRescueTestJSONUnderV235-506369624-project Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: bb5168111bae4c90bfb6fcf690e70b28 Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-506369624-project Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance b63a4244-5063-44f1-8ebd-5167853de2c9 could not be found. Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'b63a4244-5063-44f1-8ebd-5167853de2c9'} Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b63a4244-5063-44f1-8ebd-5167853de2c9 could not be found. Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b63a4244-5063-44f1-8ebd-5167853de2c9 could not be found. Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:54.275221 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:54.279439 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:54.279439 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:54.279439 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:54.279439 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:54.279439 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:34:54.279439 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:34:54.279439 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b63a4244-5063-44f1-8ebd-5167853de2c9 could not be found. Jul 28 10:34:54.279439 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:54.279439 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e2e8bb17-ed51-4a4f-984d-f3a5ea8bc25f tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] Returning 404 to user: Instance b63a4244-5063-44f1-8ebd-5167853de2c9 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:34:54.280377 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e2e8bb17-ed51-4a4f-984d-f3a5ea8bc25f tempest-ServerRescueTestJSONUnderV235-506369624 tempest-ServerRescueTestJSONUnderV235-506369624-project] 10.222.0.46 "GET /compute/v2.1/servers/b63a4244-5063-44f1-8ebd-5167853de2c9" status: 404 len: 111 microversion: 2.1 time: 0.083618 Jul 28 10:34:54.281116 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 325/687] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:34:54 2022] GET /compute/v2.1/servers/b63a4244-5063-44f1-8ebd-5167853de2c9 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:34:54.292820 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d3f0dd72-5586-4275-9b58-b4066c962f36 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:54.295259 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-d3f0dd72-5586-4275-9b58-b4066c962f36 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: b1bdd966-5cf1-42b9-8be0-734e8cf8038c] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:54.309601 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d3f0dd72-5586-4275-9b58-b4066c962f36 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:54.324992 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Getting quotas for project b02b39bdd29b4b53b3a897e9eef4615e. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:34:54.335061 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Getting quotas for user c63c56a0062b4c8c89a94284857e17c2 and project b02b39bdd29b4b53b3a897e9eef4615e. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:34:54.335664 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d3f0dd72-5586-4275-9b58-b4066c962f36 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:54.340554 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d3f0dd72-5586-4275-9b58-b4066c962f36 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:54.341298 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d3f0dd72-5586-4275-9b58-b4066c962f36 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:54.388612 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:34:54.392589 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] [instance: ecba838e-79a1-48eb-bdc6-1f4edf264ff2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eadb7bcd-74e9-426a-b427-eacbfae65980',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:34:54.397544 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-d3f0dd72-5586-4275-9b58-b4066c962f36 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] HTTP exception thrown: Instance b1bdd966-5cf1-42b9-8be0-734e8cf8038c could not be found. Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d3f0dd72-5586-4275-9b58-b4066c962f36 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Request method failure captured: Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/b1bdd966-5cf1-42b9-8be0-734e8cf8038c HTTP/1.1 Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mYptj_LZLwBL_87lWbKq6S8B7QLX8Lu1BoYegV2iknGz0pD7-au3YafcbfNWI5UjO6dSiBg9cg0UFSSRvaeGx_jRBevxKEt6gVvP5sWy0cU0yIKFXMUPoabtlPb2RRum07gTYLoxC94gQDIX_TkzArEedBfsTl_fKv7TMPVm82tJ9U Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 70ceba76ab9744e7a0ae4f2438709f7d Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-LiveMigrationTest-1443832547 Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/70ceba76ab9744e7a0ae4f2438709f7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/70ceba76ab9744e7a0ae4f2438709f7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/70ceba76ab9744e7a0ae4f2438709f7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_70ceba76ab9744e7a0ae4f2438709f7d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-LiveMigrationTest-1443832547 Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 70ceba76ab9744e7a0ae4f2438709f7d Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-LiveMigrationTest-1443832547 Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-LiveMigrationTest-1443832547-project Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: e28dd90a9b204ee78200f89abd27052a Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-LiveMigrationTest-1443832547-project Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance b1bdd966-5cf1-42b9-8be0-734e8cf8038c could not be found. Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'b1bdd966-5cf1-42b9-8be0-734e8cf8038c'} Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1bdd966-5cf1-42b9-8be0-734e8cf8038c could not be found. Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1bdd966-5cf1-42b9-8be0-734e8cf8038c could not be found. Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:54.399138 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:54.405710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:54.405710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:54.405710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:54.405710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:34:54.405710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:34:54.405710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1bdd966-5cf1-42b9-8be0-734e8cf8038c could not be found. Jul 28 10:34:54.405710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:54.412733 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d3f0dd72-5586-4275-9b58-b4066c962f36 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Returning 404 to user: Instance b1bdd966-5cf1-42b9-8be0-734e8cf8038c could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:34:54.424913 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d3f0dd72-5586-4275-9b58-b4066c962f36 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] 10.222.0.46 "GET /compute/v2.1/servers/b1bdd966-5cf1-42b9-8be0-734e8cf8038c" status: 404 len: 111 microversion: 2.1 time: 0.129681 Jul 28 10:34:54.426360 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 326/688] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:34:54 2022] GET /compute/v2.1/servers/b1bdd966-5cf1-42b9-8be0-734e8cf8038c => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:34:54.438492 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d1915279-9abb-4f4e-9d82-3151317c91ee tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:54.441211 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-d1915279-9abb-4f4e-9d82-3151317c91ee tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] [instance: 8a8c328b-ff3d-47ce-9338-2365089417b4] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:54.454408 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d1915279-9abb-4f4e-9d82-3151317c91ee tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:54.458748 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d1915279-9abb-4f4e-9d82-3151317c91ee tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:54.459933 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d1915279-9abb-4f4e-9d82-3151317c91ee tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:54.460826 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d1915279-9abb-4f4e-9d82-3151317c91ee tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:54.496170 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-d1915279-9abb-4f4e-9d82-3151317c91ee tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] HTTP exception thrown: Instance 8a8c328b-ff3d-47ce-9338-2365089417b4 could not be found. Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d1915279-9abb-4f4e-9d82-3151317c91ee tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Request method failure captured: Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/8a8c328b-ff3d-47ce-9338-2365089417b4 HTTP/1.1 Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mYzzT5kHkN3wC4GxZQrI9llHFU5j-9ay1uWsVo72YPphL5mmwvM-t_QhqDuf6t0hkIhXlORkuEVJNGN4Ei6-U619vOG-MArZPyzl9WxDW--jr0dB-gFl-DFLFkS-cJOMd0e9wy-k6RDEQavUIxkNU08go5lc8_xW4HyC4jShEKxkoQ Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 085316428d834b6cb9dcb36971da849e Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServerActionsTestJSON-1906990667 Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/085316428d834b6cb9dcb36971da849e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/085316428d834b6cb9dcb36971da849e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/085316428d834b6cb9dcb36971da849e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_085316428d834b6cb9dcb36971da849e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServerActionsTestJSON-1906990667 Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 085316428d834b6cb9dcb36971da849e Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServerActionsTestJSON-1906990667 Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServerActionsTestJSON-1906990667-project Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 26c9e7d2d9e749e083012fa3766bcdbf Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServerActionsTestJSON-1906990667-project Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 8a8c328b-ff3d-47ce-9338-2365089417b4 could not be found. Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '8a8c328b-ff3d-47ce-9338-2365089417b4'} Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a8c328b-ff3d-47ce-9338-2365089417b4 could not be found. Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a8c328b-ff3d-47ce-9338-2365089417b4 could not be found. Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:54.507578 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:54.513070 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:54.513070 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:54.513070 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:54.513070 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:34:54.513070 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:34:54.513070 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a8c328b-ff3d-47ce-9338-2365089417b4 could not be found. Jul 28 10:34:54.513070 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:34:54.514657 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d1915279-9abb-4f4e-9d82-3151317c91ee tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Returning 404 to user: Instance 8a8c328b-ff3d-47ce-9338-2365089417b4 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:34:54.515767 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d1915279-9abb-4f4e-9d82-3151317c91ee tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] 10.222.0.46 "GET /compute/v2.1/servers/8a8c328b-ff3d-47ce-9338-2365089417b4" status: 404 len: 111 microversion: 2.1 time: 0.088185 Jul 28 10:34:54.516625 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 327/689] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:34:54 2022] GET /compute/v2.1/servers/8a8c328b-ff3d-47ce-9338-2365089417b4 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:34:54.608176 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-946e7fa9-eb1c-4ef7-848e-b8aa9c407d1d tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.494487 Jul 28 10:34:54.611009 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 363/690] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:34:52 2022] POST /compute/v2.1/servers => generated 404 bytes in 2510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:34:54.623848 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0f07eebb-d725-4e1b-a25d-06acc20472a0 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '.version_select at 0x7fa94bc73160>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:54.701805 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-12dbbce3-fa2e-4b29-a211-c77193782a25 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Action: 'create', calling method: .version_select at 0x7fa94bcdfaf0>, body: {"keypair": {"name": "tempest-keypair-269454918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgq+FtO0clJYdy2oEdpfTIs8sOuEH/HCCMNAlhBuZETg72QNNYzioPY8Zlv6suTatq7A2sAE/zS711bsxfjdJZlWO3YqGOslk/5b2Je5aBWDdgz7YJqpACt1IIW3hr59g=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:54.747347 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-12dbbce3-fa2e-4b29-a211-c77193782a25 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Getting quotas for project 5927f7b9c41a40c28968dc9605d3b430. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:34:54.764152 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-12dbbce3-fa2e-4b29-a211-c77193782a25 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Getting quotas for user d392e28695084290953f90c3a36dcc1b and project 5927f7b9c41a40c28968dc9605d3b430. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:34:54.811613 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-12dbbce3-fa2e-4b29-a211-c77193782a25 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.293353 Jul 28 10:34:54.813323 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 328/691] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:34:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:34:54.819348 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-576027ef-705c-4f90-a2b6-c94c9e54c4da tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] Calling method '.version_select at 0x7fa94bc734c0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:54.840505 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:54.861638 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-576027ef-705c-4f90-a2b6-c94c9e54c4da tempest-ServerActionsTestJSON-1906990667 tempest-ServerActionsTestJSON-1906990667-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-52299278" status: 202 len: 0 microversion: 2.1 time: 0.044946 Jul 28 10:34:54.863109 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 329/692] 10.222.0.46 () {58 vars in 1215 bytes} [Thu Jul 28 10:34:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-52299278 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:34:54.881438 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2096998422", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "fc480ddc-689b-4a08-ab44-677bf4b84cd1"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:55.007091 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] validate_networks() for [('fc480ddc-689b-4a08-ab44-677bf4b84cd1', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:34:55.475380 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0f07eebb-d725-4e1b-a25d-06acc20472a0 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/c3de6c92-8f7c-4f0d-8648-7eca5eee9fad" status: 200 len: 224 microversion: 2.1 time: 0.860420 Jul 28 10:34:55.477835 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 364/693] 10.222.0.46 () {58 vars in 1269 bytes} [Thu Jul 28 10:34:54 2022] GET /compute/v2.1/os-security-groups/c3de6c92-8f7c-4f0d-8648-7eca5eee9fad => generated 224 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:34:55.495206 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9012e0b7-a33b-49a4-97b3-e28667979699 tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:55.497158 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-9012e0b7-a33b-49a4-97b3-e28667979699 tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] [instance: ecba838e-79a1-48eb-bdc6-1f4edf264ff2] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:55.504682 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9012e0b7-a33b-49a4-97b3-e28667979699 tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:55.505476 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9012e0b7-a33b-49a4-97b3-e28667979699 tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:55.506802 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9012e0b7-a33b-49a4-97b3-e28667979699 tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:55.508253 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9012e0b7-a33b-49a4-97b3-e28667979699 tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:55.579489 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9012e0b7-a33b-49a4-97b3-e28667979699 tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:55.580814 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9012e0b7-a33b-49a4-97b3-e28667979699 tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:55.582982 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-9012e0b7-a33b-49a4-97b3-e28667979699 tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lazy-loading 'fault' on Instance uuid ecba838e-79a1-48eb-bdc6-1f4edf264ff2 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:34:55.674840 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-9012e0b7-a33b-49a4-97b3-e28667979699 tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63c56a0062b4c8c89a94284857e17c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b39bdd29b4b53b3a897e9eef4615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:34:55.686397 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9012e0b7-a33b-49a4-97b3-e28667979699 tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] 10.222.0.46 "GET /compute/v2.1/servers/ecba838e-79a1-48eb-bdc6-1f4edf264ff2" status: 200 len: 1319 microversion: 2.1 time: 0.197023 Jul 28 10:34:55.689668 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 365/694] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:34:55 2022] GET /compute/v2.1/servers/ecba838e-79a1-48eb-bdc6-1f4edf264ff2 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:34:55.705604 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f7698fd6-70f9-48c6-807e-a33d028baa0f tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '.version_select at 0x7fa94baa7ee0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:56.373097 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f7698fd6-70f9-48c6-807e-a33d028baa0f tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/c3de6c92-8f7c-4f0d-8648-7eca5eee9fad" status: 202 len: 0 microversion: 2.1 time: 0.681789 Jul 28 10:34:56.374434 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 366/695] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:34:55 2022] DELETE /compute/v2.1/os-security-groups/c3de6c92-8f7c-4f0d-8648-7eca5eee9fad => generated 0 bytes in 684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:34:56.386726 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f79ab58f-1628-4669-8663-293f6d78143d tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '.version_select at 0x7fa94badf310>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:56.487110 n-d-850468-6 devstack@n-api.service[119464]: DEBUG neutronclient.v2_0.client [None req-f79ab58f-1628-4669-8663-293f6d78143d tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c3de6c92-8f7c-4f0d-8648-7eca5eee9fad does not exist", "detail": ""}} {{(pid=119464) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 10:34:56.488464 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.security_group_api [None req-f79ab58f-1628-4669-8663-293f6d78143d tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Neutron security group c3de6c92-8f7c-4f0d-8648-7eca5eee9fad not found {{(pid=119464) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 10:34:56.489527 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-f79ab58f-1628-4669-8663-293f6d78143d tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] HTTP exception thrown: Security group c3de6c92-8f7c-4f0d-8648-7eca5eee9fad does not exist Jul 28 10:34:56.489527 n-d-850468-6 devstack@n-api.service[119464]: Neutron server returns request_ids: ['req-a5365adb-5cfc-44c0-b7ff-268d2605a046'] Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f79ab58f-1628-4669-8663-293f6d78143d tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Request method failure captured: Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-security-groups/c3de6c92-8f7c-4f0d-8648-7eca5eee9fad HTTP/1.1 Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mY_UmWvwobDpxuDusXuiN2X3phLX9PelsodhuWjeKwRX40vPDz77DGyfctYfO-WofaMuk0eodlXgeEoanzuSgoqD0L1e6dbbmhuN4lfHCBWTqD67dSSkuZfve2sLpg4DOdYZlERCclCFU8tmW6N6gpf-xnNEJ8JDLng7SySEVk-QqM Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: c3c8659bbba84bbfb32e446ba294d81e Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c3c8659bbba84bbfb32e446ba294d81e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: c3c8659bbba84bbfb32e446ba294d81e Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-SecurityGroupsTestJSON-1760984738-project Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: b654c9ee44d245a586f01fcdc20f3deb Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-SecurityGroupsTestJSON-1760984738-project Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: exception: Security group c3de6c92-8f7c-4f0d-8648-7eca5eee9fad does not exist Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: Neutron server returns request_ids: ['req-a5365adb-5cfc-44c0-b7ff-268d2605a046'] Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'c3de6c92-8f7c-4f0d-8648-7eca5eee9fad'} Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 10:34:56.491485 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c3de6c92-8f7c-4f0d-8648-7eca5eee9fad does not exist Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5365adb-5cfc-44c0-b7ff-268d2605a046'] Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c3de6c92-8f7c-4f0d-8648-7eca5eee9fad does not exist Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5365adb-5cfc-44c0-b7ff-268d2605a046'] Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c3de6c92-8f7c-4f0d-8648-7eca5eee9fad does not exist Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5365adb-5cfc-44c0-b7ff-268d2605a046'] Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c3de6c92-8f7c-4f0d-8648-7eca5eee9fad does not exist Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5365adb-5cfc-44c0-b7ff-268d2605a046'] Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f79ab58f-1628-4669-8663-293f6d78143d tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Returning 404 to user: Security group c3de6c92-8f7c-4f0d-8648-7eca5eee9fad does not exist Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: Neutron server returns request_ids: ['req-a5365adb-5cfc-44c0-b7ff-268d2605a046'] {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f79ab58f-1628-4669-8663-293f6d78143d tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/c3de6c92-8f7c-4f0d-8648-7eca5eee9fad" status: 404 len: 194 microversion: 2.1 time: 0.113098 Jul 28 10:34:56.497256 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 367/696] 10.222.0.46 () {58 vars in 1269 bytes} [Thu Jul 28 10:34:56 2022] GET /compute/v2.1/os-security-groups/c3de6c92-8f7c-4f0d-8648-7eca5eee9fad => generated 194 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:34:56.509528 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-62b55dd7-f931-4d2f-a884-54336d01e106 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Action: 'create', calling method: .version_select at 0x7fa94bb2b9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1028680719", "description": "tempest-description-979642207"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:56.936047 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-62b55dd7-f931-4d2f-a884-54336d01e106 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.434634 Jul 28 10:34:56.938048 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 368/697] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:34:56 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:34:57.026714 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1381266774", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "91258437-70fd-4795-879b-2ceeb860ebc5"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:57.110900 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:34:57.111354 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:34:57.111806 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:34:57.112292 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:34:57.112780 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:34:57.132977 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:57.133777 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:57.135595 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:57.137950 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:57.146279 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] validate_networks() for [('91258437-70fd-4795-879b-2ceeb860ebc5', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:34:57.188701 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Getting quotas for project 70ceba76ab9744e7a0ae4f2438709f7d. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:34:57.203941 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Getting quotas for user e28dd90a9b204ee78200f89abd27052a and project 70ceba76ab9744e7a0ae4f2438709f7d. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:34:57.223174 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:34:57.226231 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 0c2fcf84-7113-49b1-afea-5da0980bbaca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:34:57.329158 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-dce42916-1536-45ce-bb69-222432b57e12 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.463060 Jul 28 10:34:57.334746 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 330/698] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:34:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:34:57.350904 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7208bebf-1893-4af0-a79a-183437c27c6c tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:57.355231 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-7208bebf-1893-4af0-a79a-183437c27c6c tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] [instance: ecba838e-79a1-48eb-bdc6-1f4edf264ff2] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:57.382340 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7208bebf-1893-4af0-a79a-183437c27c6c tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:57.385462 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7208bebf-1893-4af0-a79a-183437c27c6c tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:57.387517 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7208bebf-1893-4af0-a79a-183437c27c6c tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:57.388490 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7208bebf-1893-4af0-a79a-183437c27c6c tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:57.506626 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7208bebf-1893-4af0-a79a-183437c27c6c tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:57.507741 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7208bebf-1893-4af0-a79a-183437c27c6c tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:57.508432 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-7208bebf-1893-4af0-a79a-183437c27c6c tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lazy-loading 'fault' on Instance uuid ecba838e-79a1-48eb-bdc6-1f4edf264ff2 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:34:58.042494 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:34:58.043922 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:34:58.044863 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:34:58.045442 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:34:58.046046 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:34:58.063541 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:58.064312 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:58.065374 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:58.066000 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:58.095413 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Getting quotas for project 012167e98eaf4676b40d031cb86a03ad. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:34:58.102251 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Getting quotas for user e6c5088cf1094c19b300bfcf6a9dd5ae and project 012167e98eaf4676b40d031cb86a03ad. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:34:58.121377 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Going to run 2 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:34:58.123887 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 5267ac56-d5eb-411c-94f6-b22818207bbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:34:58.165302 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-7208bebf-1893-4af0-a79a-183437c27c6c tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63c56a0062b4c8c89a94284857e17c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b39bdd29b4b53b3a897e9eef4615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:34:58.168122 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 46c2ad81-8f71-46bd-8886-ec353a2cd80c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=5267ac56-d5eb-411c-94f6-b22818207bbb,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:34:58.177442 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-7208bebf-1893-4af0-a79a-183437c27c6c tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] 10.222.0.46 "GET /compute/v2.1/servers/ecba838e-79a1-48eb-bdc6-1f4edf264ff2" status: 200 len: 1319 microversion: 2.1 time: 0.838176 Jul 28 10:34:58.183258 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 331/699] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:34:57 2022] GET /compute/v2.1/servers/ecba838e-79a1-48eb-bdc6-1f4edf264ff2 => generated 1319 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:34:58.191128 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d604765c-9d47-4e48-a9dd-ce2099a6af22 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Action: 'create', calling method: .version_select at 0x7fa94bbe0670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-893967781", "description": "tempest-description-1797879187"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:58.279689 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-26bfbafc-8253-46fa-a87c-e630c15e9d6b tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.338560 Jul 28 10:34:58.281316 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 369/700] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:34:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:34:58.288652 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-250acc37-d4ed-4e9b-97e4-6a51d2d6241a tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:58.291490 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-250acc37-d4ed-4e9b-97e4-6a51d2d6241a tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 0c2fcf84-7113-49b1-afea-5da0980bbaca] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:58.304511 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-250acc37-d4ed-4e9b-97e4-6a51d2d6241a tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:58.305264 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-250acc37-d4ed-4e9b-97e4-6a51d2d6241a tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:58.307190 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-250acc37-d4ed-4e9b-97e4-6a51d2d6241a tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:58.307899 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-250acc37-d4ed-4e9b-97e4-6a51d2d6241a tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:58.421283 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-250acc37-d4ed-4e9b-97e4-6a51d2d6241a tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:58.421901 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-250acc37-d4ed-4e9b-97e4-6a51d2d6241a tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:58.422375 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-250acc37-d4ed-4e9b-97e4-6a51d2d6241a tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lazy-loading 'fault' on Instance uuid 0c2fcf84-7113-49b1-afea-5da0980bbaca {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:34:58.591687 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-250acc37-d4ed-4e9b-97e4-6a51d2d6241a tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28dd90a9b204ee78200f89abd27052a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ceba76ab9744e7a0ae4f2438709f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:34:58.622259 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-250acc37-d4ed-4e9b-97e4-6a51d2d6241a tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] 10.222.0.46 "GET /compute/v2.1/servers/0c2fcf84-7113-49b1-afea-5da0980bbaca" status: 200 len: 1284 microversion: 2.1 time: 0.326709 Jul 28 10:34:58.622259 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 370/701] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:34:58 2022] GET /compute/v2.1/servers/0c2fcf84-7113-49b1-afea-5da0980bbaca => generated 1284 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:34:58.637852 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e9d5853c-ee0d-49bf-b11d-2a7e506bd98a tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:58.639642 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-e9d5853c-ee0d-49bf-b11d-2a7e506bd98a tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] [instance: ecba838e-79a1-48eb-bdc6-1f4edf264ff2] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:34:58.669986 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e9d5853c-ee0d-49bf-b11d-2a7e506bd98a tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:58.675753 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e9d5853c-ee0d-49bf-b11d-2a7e506bd98a tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:58.686447 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e9d5853c-ee0d-49bf-b11d-2a7e506bd98a tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:58.692423 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e9d5853c-ee0d-49bf-b11d-2a7e506bd98a tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:58.797795 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-e9d5853c-ee0d-49bf-b11d-2a7e506bd98a tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] [instance: ecba838e-79a1-48eb-bdc6-1f4edf264ff2] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:34:58.929829 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-e9d5853c-ee0d-49bf-b11d-2a7e506bd98a tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] [instance: ecba838e-79a1-48eb-bdc6-1f4edf264ff2] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:34:58.933553 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e9d5853c-ee0d-49bf-b11d-2a7e506bd98a tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:58.935183 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e9d5853c-ee0d-49bf-b11d-2a7e506bd98a tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:58.935830 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-e9d5853c-ee0d-49bf-b11d-2a7e506bd98a tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] [instance: ecba838e-79a1-48eb-bdc6-1f4edf264ff2] instance's host None is down, deleting from database Jul 28 10:34:58.941042 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-e9d5853c-ee0d-49bf-b11d-2a7e506bd98a tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] [instance: ecba838e-79a1-48eb-bdc6-1f4edf264ff2] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:34:59.057243 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-e9d5853c-ee0d-49bf-b11d-2a7e506bd98a tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] [instance: ecba838e-79a1-48eb-bdc6-1f4edf264ff2] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:34:59.067003 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-e9d5853c-ee0d-49bf-b11d-2a7e506bd98a tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] [instance: ecba838e-79a1-48eb-bdc6-1f4edf264ff2] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:34:59.518978 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d604765c-9d47-4e48-a9dd-ce2099a6af22 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.334286 Jul 28 10:34:59.520597 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 332/702] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:34:58 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:34:59.532103 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-9bda3bb2-0845-40f7-b1c9-f9556e949786 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:34:59.547293 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=63,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=3 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:34:59.547751 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-9bda3bb2-0845-40f7-b1c9-f9556e949786 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6c5088cf1094c19b300bfcf6a9dd5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012167e98eaf4676b40d031cb86a03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:34:59.551572 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-9bda3bb2-0845-40f7-b1c9-f9556e949786 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Searching by: {'deleted': False, 'project_id': '012167e98eaf4676b40d031cb86a03ad'} {{(pid=119463) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 10:34:59.577819 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9bda3bb2-0845-40f7-b1c9-f9556e949786 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:59.581982 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9bda3bb2-0845-40f7-b1c9-f9556e949786 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:59.587330 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9bda3bb2-0845-40f7-b1c9-f9556e949786 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:34:59.587786 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9bda3bb2-0845-40f7-b1c9-f9556e949786 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:34:59.599043 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e9d5853c-ee0d-49bf-b11d-2a7e506bd98a tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ecba838e-79a1-48eb-bdc6-1f4edf264ff2" status: 204 len: 0 microversion: 2.1 time: 0.978523 Jul 28 10:34:59.599984 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 371/703] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:34:58 2022] DELETE /compute/v2.1/servers/ecba838e-79a1-48eb-bdc6-1f4edf264ff2 => generated 0 bytes in 984 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:34:59.616046 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7fc7e0aa-005a-44b5-936a-de5c4974620c tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Action: 'create', calling method: .version_select at 0x7fa94baa7280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-416615410", "description": "tempest-description-631944423"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:34:59.842357 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.multi_cell_list [None req-9bda3bb2-0845-40f7-b1c9-f9556e949786 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119463) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 10:35:00.062633 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-9bda3bb2-0845-40f7-b1c9-f9556e949786 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.540719 Jul 28 10:35:00.063611 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 333/704] 10.222.0.46 () {58 vars in 1125 bytes} [Thu Jul 28 10:34:59 2022] GET /compute/v2.1/servers => generated 677 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:00.068791 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d8c20c4d-8b45-4b1f-a1f9-914f2680924f tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:00.069611 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-d8c20c4d-8b45-4b1f-a1f9-914f2680924f tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] [instance: ecba838e-79a1-48eb-bdc6-1f4edf264ff2] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:00.077003 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d8c20c4d-8b45-4b1f-a1f9-914f2680924f tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:00.077751 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d8c20c4d-8b45-4b1f-a1f9-914f2680924f tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:00.078750 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d8c20c4d-8b45-4b1f-a1f9-914f2680924f tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:00.079352 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d8c20c4d-8b45-4b1f-a1f9-914f2680924f tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:00.116252 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-d8c20c4d-8b45-4b1f-a1f9-914f2680924f tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] HTTP exception thrown: Instance ecba838e-79a1-48eb-bdc6-1f4edf264ff2 could not be found. Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d8c20c4d-8b45-4b1f-a1f9-914f2680924f tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Request method failure captured: Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/ecba838e-79a1-48eb-bdc6-1f4edf264ff2 HTTP/1.1 Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mXz7AASEKP648ezoYQ81u1bBjyWfdZRDKPH5Ic2jORIpErtjjJX9MI_25xD3DODmOnDovk-pdC4OmiMN8AwsFF7PXzQleh8K1WqEinQNv_5qUT9xMK260L-sYgARigo71BsH_edKRDoKOq3uNV9RXD7XV6sbgSiyESOIC2X055ZA3Q Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: b02b39bdd29b4b53b3a897e9eef4615e Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-485026712 Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b02b39bdd29b4b53b3a897e9eef4615e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b02b39bdd29b4b53b3a897e9eef4615e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b02b39bdd29b4b53b3a897e9eef4615e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b02b39bdd29b4b53b3a897e9eef4615e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-485026712 Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: b02b39bdd29b4b53b3a897e9eef4615e Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-485026712 Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-AttachSCSIVolumeTestJSON-485026712-project Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: c63c56a0062b4c8c89a94284857e17c2 Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-485026712-project Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance ecba838e-79a1-48eb-bdc6-1f4edf264ff2 could not be found. Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'ecba838e-79a1-48eb-bdc6-1f4edf264ff2'} Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecba838e-79a1-48eb-bdc6-1f4edf264ff2 could not be found. Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecba838e-79a1-48eb-bdc6-1f4edf264ff2 could not be found. Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:00.119451 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:00.126857 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:00.126857 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:00.126857 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:00.126857 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:00.126857 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:00.126857 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecba838e-79a1-48eb-bdc6-1f4edf264ff2 could not be found. Jul 28 10:35:00.126857 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:00.126857 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d8c20c4d-8b45-4b1f-a1f9-914f2680924f tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Returning 404 to user: Instance ecba838e-79a1-48eb-bdc6-1f4edf264ff2 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:00.126857 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d8c20c4d-8b45-4b1f-a1f9-914f2680924f tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] 10.222.0.46 "GET /compute/v2.1/servers/ecba838e-79a1-48eb-bdc6-1f4edf264ff2" status: 404 len: 111 microversion: 2.1 time: 0.059273 Jul 28 10:35:00.128124 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 334/705] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:00 2022] GET /compute/v2.1/servers/ecba838e-79a1-48eb-bdc6-1f4edf264ff2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:00.133802 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-54858255-0a40-4f8e-883d-3cc990a70792 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:00.150330 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-54858255-0a40-4f8e-883d-3cc990a70792 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 0c2fcf84-7113-49b1-afea-5da0980bbaca] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:00.158327 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-54858255-0a40-4f8e-883d-3cc990a70792 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:00.158766 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-54858255-0a40-4f8e-883d-3cc990a70792 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:00.159895 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-54858255-0a40-4f8e-883d-3cc990a70792 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:00.160550 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-54858255-0a40-4f8e-883d-3cc990a70792 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:00.230026 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-54858255-0a40-4f8e-883d-3cc990a70792 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:00.230481 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-54858255-0a40-4f8e-883d-3cc990a70792 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:00.230945 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-54858255-0a40-4f8e-883d-3cc990a70792 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lazy-loading 'fault' on Instance uuid 0c2fcf84-7113-49b1-afea-5da0980bbaca {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:35:00.317543 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7fc7e0aa-005a-44b5-936a-de5c4974620c tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.715736 Jul 28 10:35:00.319508 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 372/706] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:34:59 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:00.331188 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-09c38636-688c-4ecf-b6d6-7a91f70148fa tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:00.332012 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-09c38636-688c-4ecf-b6d6-7a91f70148fa tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 46c2ad81-8f71-46bd-8886-ec353a2cd80c] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:00.345766 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-09c38636-688c-4ecf-b6d6-7a91f70148fa tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:00.346593 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-09c38636-688c-4ecf-b6d6-7a91f70148fa tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:00.348203 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-09c38636-688c-4ecf-b6d6-7a91f70148fa tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:00.351088 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-54858255-0a40-4f8e-883d-3cc990a70792 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28dd90a9b204ee78200f89abd27052a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ceba76ab9744e7a0ae4f2438709f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:00.357235 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-09c38636-688c-4ecf-b6d6-7a91f70148fa tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:00.369948 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-54858255-0a40-4f8e-883d-3cc990a70792 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] 10.222.0.46 "GET /compute/v2.1/servers/0c2fcf84-7113-49b1-afea-5da0980bbaca" status: 200 len: 1284 microversion: 2.1 time: 0.240387 Jul 28 10:35:00.371539 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 335/707] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:00 2022] GET /compute/v2.1/servers/0c2fcf84-7113-49b1-afea-5da0980bbaca => generated 1284 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:35:00.382703 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a09f00f3-4d20-42f8-a9ff-efea1e67b86f tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] Calling method '.version_select at 0x7fa94bce8a60>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:00.418677 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-09c38636-688c-4ecf-b6d6-7a91f70148fa tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:00.419126 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-09c38636-688c-4ecf-b6d6-7a91f70148fa tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:00.422080 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-09c38636-688c-4ecf-b6d6-7a91f70148fa tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lazy-loading 'fault' on Instance uuid 46c2ad81-8f71-46bd-8886-ec353a2cd80c {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:35:00.434246 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a09f00f3-4d20-42f8-a9ff-efea1e67b86f tempest-AttachSCSIVolumeTestJSON-485026712 tempest-AttachSCSIVolumeTestJSON-485026712-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1426958065" status: 202 len: 0 microversion: 2.1 time: 0.061490 Jul 28 10:35:00.435247 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 336/708] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Jul 28 10:35:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1426958065 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:35:00.440290 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-db04de82-01f9-4f48-a648-194e9f1986b0 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '.version_select at 0x7fa94bba8ee0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:00.529889 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-09c38636-688c-4ecf-b6d6-7a91f70148fa tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c5088cf1094c19b300bfcf6a9dd5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012167e98eaf4676b40d031cb86a03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:00.543307 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-09c38636-688c-4ecf-b6d6-7a91f70148fa tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] 10.222.0.46 "GET /compute/v2.1/servers/46c2ad81-8f71-46bd-8886-ec353a2cd80c" status: 200 len: 1293 microversion: 2.1 time: 0.222500 Jul 28 10:35:00.544221 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 373/709] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:00 2022] GET /compute/v2.1/servers/46c2ad81-8f71-46bd-8886-ec353a2cd80c => generated 1293 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:35:00.552748 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ecfab556-39a3-4a11-88b3-d9fb6ceec117 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:00.554447 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ecfab556-39a3-4a11-88b3-d9fb6ceec117 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 0c2fcf84-7113-49b1-afea-5da0980bbaca] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:00.573653 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ecfab556-39a3-4a11-88b3-d9fb6ceec117 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:00.577943 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ecfab556-39a3-4a11-88b3-d9fb6ceec117 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:00.580868 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ecfab556-39a3-4a11-88b3-d9fb6ceec117 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:00.582349 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ecfab556-39a3-4a11-88b3-d9fb6ceec117 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:00.637758 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ecfab556-39a3-4a11-88b3-d9fb6ceec117 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 0c2fcf84-7113-49b1-afea-5da0980bbaca] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:35:00.738962 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ecfab556-39a3-4a11-88b3-d9fb6ceec117 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 0c2fcf84-7113-49b1-afea-5da0980bbaca] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:35:00.740714 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ecfab556-39a3-4a11-88b3-d9fb6ceec117 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:00.741516 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ecfab556-39a3-4a11-88b3-d9fb6ceec117 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:00.742346 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-ecfab556-39a3-4a11-88b3-d9fb6ceec117 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 0c2fcf84-7113-49b1-afea-5da0980bbaca] instance's host None is down, deleting from database Jul 28 10:35:00.748245 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-ecfab556-39a3-4a11-88b3-d9fb6ceec117 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 0c2fcf84-7113-49b1-afea-5da0980bbaca] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:35:00.794766 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-ecfab556-39a3-4a11-88b3-d9fb6ceec117 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 0c2fcf84-7113-49b1-afea-5da0980bbaca] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:35:00.811144 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-ecfab556-39a3-4a11-88b3-d9fb6ceec117 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 0c2fcf84-7113-49b1-afea-5da0980bbaca] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:35:01.087759 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ecfab556-39a3-4a11-88b3-d9fb6ceec117 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0c2fcf84-7113-49b1-afea-5da0980bbaca" status: 204 len: 0 microversion: 2.1 time: 0.541819 Jul 28 10:35:01.088689 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 374/710] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:35:00 2022] DELETE /compute/v2.1/servers/0c2fcf84-7113-49b1-afea-5da0980bbaca => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:35:01.277705 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e8536f3d-5d32-42c9-853f-401590c81fea tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Action: 'create', calling method: .version_select at 0x7fa94baa7940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-453161289"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:35:02.011204 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e8536f3d-5d32-42c9-853f-401590c81fea tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.921713 Jul 28 10:35:02.018074 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 375/711] 10.222.0.46 () {60 vars in 1155 bytes} [Thu Jul 28 10:35:01 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 924 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 10:35:02.018074 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0850f5ae-f5f4-40cf-b44b-8a0107e58075 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:02.018374 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0850f5ae-f5f4-40cf-b44b-8a0107e58075 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 0c2fcf84-7113-49b1-afea-5da0980bbaca] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:02.031408 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0850f5ae-f5f4-40cf-b44b-8a0107e58075 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:02.032208 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0850f5ae-f5f4-40cf-b44b-8a0107e58075 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:02.033216 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0850f5ae-f5f4-40cf-b44b-8a0107e58075 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:02.033840 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0850f5ae-f5f4-40cf-b44b-8a0107e58075 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:02.038275 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-db04de82-01f9-4f48-a648-194e9f1986b0 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 1.601831 Jul 28 10:35:02.038860 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 337/712] 10.222.0.46 () {58 vars in 1158 bytes} [Thu Jul 28 10:35:00 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:35:02.055841 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-018539c7-ad49-4c4f-afd9-3ee67fb66c03 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:02.057110 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-018539c7-ad49-4c4f-afd9-3ee67fb66c03 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 46c2ad81-8f71-46bd-8886-ec353a2cd80c] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:02.066207 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-018539c7-ad49-4c4f-afd9-3ee67fb66c03 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:02.067561 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-018539c7-ad49-4c4f-afd9-3ee67fb66c03 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:02.068942 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-018539c7-ad49-4c4f-afd9-3ee67fb66c03 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:02.069971 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-018539c7-ad49-4c4f-afd9-3ee67fb66c03 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:02.086802 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-0850f5ae-f5f4-40cf-b44b-8a0107e58075 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] HTTP exception thrown: Instance 0c2fcf84-7113-49b1-afea-5da0980bbaca could not be found. Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0850f5ae-f5f4-40cf-b44b-8a0107e58075 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Request method failure captured: Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/0c2fcf84-7113-49b1-afea-5da0980bbaca HTTP/1.1 Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mYptj_LZLwBL_87lWbKq6S8B7QLX8Lu1BoYegV2iknGz0pD7-au3YafcbfNWI5UjO6dSiBg9cg0UFSSRvaeGx_jRBevxKEt6gVvP5sWy0cU0yIKFXMUPoabtlPb2RRum07gTYLoxC94gQDIX_TkzArEedBfsTl_fKv7TMPVm82tJ9U Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 70ceba76ab9744e7a0ae4f2438709f7d Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-LiveMigrationTest-1443832547 Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/70ceba76ab9744e7a0ae4f2438709f7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/70ceba76ab9744e7a0ae4f2438709f7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/70ceba76ab9744e7a0ae4f2438709f7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_70ceba76ab9744e7a0ae4f2438709f7d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-LiveMigrationTest-1443832547 Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 70ceba76ab9744e7a0ae4f2438709f7d Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-LiveMigrationTest-1443832547 Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-LiveMigrationTest-1443832547-project Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: e28dd90a9b204ee78200f89abd27052a Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-LiveMigrationTest-1443832547-project Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 0c2fcf84-7113-49b1-afea-5da0980bbaca could not be found. Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '0c2fcf84-7113-49b1-afea-5da0980bbaca'} Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c2fcf84-7113-49b1-afea-5da0980bbaca could not be found. Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c2fcf84-7113-49b1-afea-5da0980bbaca could not be found. Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:02.089220 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:02.093618 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:02.093618 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:02.093618 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:02.093618 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:02.093618 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:02.093618 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c2fcf84-7113-49b1-afea-5da0980bbaca could not be found. Jul 28 10:35:02.093618 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:02.093618 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0850f5ae-f5f4-40cf-b44b-8a0107e58075 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Returning 404 to user: Instance 0c2fcf84-7113-49b1-afea-5da0980bbaca could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:02.093618 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0850f5ae-f5f4-40cf-b44b-8a0107e58075 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] 10.222.0.46 "GET /compute/v2.1/servers/0c2fcf84-7113-49b1-afea-5da0980bbaca" status: 404 len: 111 microversion: 2.1 time: 0.077314 Jul 28 10:35:02.093618 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 376/713] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:02 2022] GET /compute/v2.1/servers/0c2fcf84-7113-49b1-afea-5da0980bbaca => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:02.095789 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f26435fd-7587-4136-987f-8b42c3f6890e tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Calling method '.version_select at 0x7fa94b9d8790>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:02.164550 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-018539c7-ad49-4c4f-afd9-3ee67fb66c03 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:02.164926 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-018539c7-ad49-4c4f-afd9-3ee67fb66c03 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:02.165981 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-018539c7-ad49-4c4f-afd9-3ee67fb66c03 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lazy-loading 'fault' on Instance uuid 46c2ad81-8f71-46bd-8886-ec353a2cd80c {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:35:02.223966 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f26435fd-7587-4136-987f-8b42c3f6890e tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1f44a7d7-0763-4c7b-85f1-b9b92d7b1980" status: 200 len: 344 microversion: 2.1 time: 0.131677 Jul 28 10:35:02.225371 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 377/714] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:35:02 2022] GET /compute/v2.1/os-volumes/1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 => generated 344 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:02.231068 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b94d68ce-ebf8-4730-889a-d0bd97daea39 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '.version_select at 0x7fa94b9d8940>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:02.538856 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-018539c7-ad49-4c4f-afd9-3ee67fb66c03 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c5088cf1094c19b300bfcf6a9dd5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012167e98eaf4676b40d031cb86a03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:02.543134 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=68,nova_cell0:UPDATE=26,nova_cell0:DELETE=4,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:02.558602 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-018539c7-ad49-4c4f-afd9-3ee67fb66c03 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] 10.222.0.46 "GET /compute/v2.1/servers/46c2ad81-8f71-46bd-8886-ec353a2cd80c" status: 200 len: 1293 microversion: 2.1 time: 0.500817 Jul 28 10:35:02.559952 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 338/715] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:02 2022] GET /compute/v2.1/servers/46c2ad81-8f71-46bd-8886-ec353a2cd80c => generated 1293 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:35:02.565891 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6ac74b2d-424c-493e-a595-28203c1ead60 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Action: 'create', calling method: .version_select at 0x7fa94bbab4c0>, body: {"keypair": {"name": "tempest-keypair-42878079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk8ddFEYHJFoHMgtc1g0BUVN+pdH0bcsasY7BFz4/uFfYIOKX5Ybs+CkQckr9vquokgt16pGIKgjgY5n35OrwleyzbImnJEtSQH/mEMXYyHR6fzTbc0JH1vxoGZJ4y9jA=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:35:02.615577 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-6ac74b2d-424c-493e-a595-28203c1ead60 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Getting quotas for project 70ceba76ab9744e7a0ae4f2438709f7d. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:35:02.628066 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-6ac74b2d-424c-493e-a595-28203c1ead60 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Getting quotas for user e28dd90a9b204ee78200f89abd27052a and project 70ceba76ab9744e7a0ae4f2438709f7d. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:35:02.679636 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b94d68ce-ebf8-4730-889a-d0bd97daea39 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/1d6114e0-446f-4e1d-9490-8b6a70b175ec" status: 202 len: 0 microversion: 2.1 time: 0.452978 Jul 28 10:35:02.680462 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 378/716] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:35:02 2022] DELETE /compute/v2.1/os-security-groups/1d6114e0-446f-4e1d-9490-8b6a70b175ec => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:35:02.688653 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-079e9d00-3c3f-4091-8322-7fc1662cfe04 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:02.690581 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-079e9d00-3c3f-4091-8322-7fc1662cfe04 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 46c2ad81-8f71-46bd-8886-ec353a2cd80c] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:02.706183 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-079e9d00-3c3f-4091-8322-7fc1662cfe04 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:02.707402 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-079e9d00-3c3f-4091-8322-7fc1662cfe04 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:02.708300 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-079e9d00-3c3f-4091-8322-7fc1662cfe04 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:02.710474 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-079e9d00-3c3f-4091-8322-7fc1662cfe04 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:02.713465 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6ac74b2d-424c-493e-a595-28203c1ead60 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.151739 Jul 28 10:35:02.714753 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 339/717] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:35:02 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:02.727016 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2f8ff983-3987-45d7-9f87-a73276fe223f tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '.version_select at 0x7fa94bbabd30>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:02.771136 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-079e9d00-3c3f-4091-8322-7fc1662cfe04 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 46c2ad81-8f71-46bd-8886-ec353a2cd80c] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:35:02.927285 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-079e9d00-3c3f-4091-8322-7fc1662cfe04 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 46c2ad81-8f71-46bd-8886-ec353a2cd80c] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:35:02.932531 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-079e9d00-3c3f-4091-8322-7fc1662cfe04 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:02.932995 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-079e9d00-3c3f-4091-8322-7fc1662cfe04 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:02.933457 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-079e9d00-3c3f-4091-8322-7fc1662cfe04 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 46c2ad81-8f71-46bd-8886-ec353a2cd80c] instance's host None is down, deleting from database Jul 28 10:35:02.941106 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-079e9d00-3c3f-4091-8322-7fc1662cfe04 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 46c2ad81-8f71-46bd-8886-ec353a2cd80c] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:35:03.060494 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-079e9d00-3c3f-4091-8322-7fc1662cfe04 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 46c2ad81-8f71-46bd-8886-ec353a2cd80c] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:35:03.068643 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-079e9d00-3c3f-4091-8322-7fc1662cfe04 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 46c2ad81-8f71-46bd-8886-ec353a2cd80c] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:35:03.295622 n-d-850468-6 devstack@n-api.service[119463]: DEBUG neutronclient.v2_0.client [None req-2f8ff983-3987-45d7-9f87-a73276fe223f tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1d6114e0-446f-4e1d-9490-8b6a70b175ec does not exist", "detail": ""}} {{(pid=119463) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 10:35:03.296418 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.security_group_api [None req-2f8ff983-3987-45d7-9f87-a73276fe223f tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Neutron security group 1d6114e0-446f-4e1d-9490-8b6a70b175ec not found {{(pid=119463) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 10:35:03.297056 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-2f8ff983-3987-45d7-9f87-a73276fe223f tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] HTTP exception thrown: Security group 1d6114e0-446f-4e1d-9490-8b6a70b175ec does not exist Jul 28 10:35:03.297056 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-a6898164-c9e2-41e5-be2a-5a43087e76cd'] Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2f8ff983-3987-45d7-9f87-a73276fe223f tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Request method failure captured: Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/os-security-groups/1d6114e0-446f-4e1d-9490-8b6a70b175ec HTTP/1.1 Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mY_UmWvwobDpxuDusXuiN2X3phLX9PelsodhuWjeKwRX40vPDz77DGyfctYfO-WofaMuk0eodlXgeEoanzuSgoqD0L1e6dbbmhuN4lfHCBWTqD67dSSkuZfve2sLpg4DOdYZlERCclCFU8tmW6N6gpf-xnNEJ8JDLng7SySEVk-QqM Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: c3c8659bbba84bbfb32e446ba294d81e Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c3c8659bbba84bbfb32e446ba294d81e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: c3c8659bbba84bbfb32e446ba294d81e Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-SecurityGroupsTestJSON-1760984738-project Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: b654c9ee44d245a586f01fcdc20f3deb Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-SecurityGroupsTestJSON-1760984738-project Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: exception: Security group 1d6114e0-446f-4e1d-9490-8b6a70b175ec does not exist Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-a6898164-c9e2-41e5-be2a-5a43087e76cd'] Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '1d6114e0-446f-4e1d-9490-8b6a70b175ec'} Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 10:35:03.299115 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1d6114e0-446f-4e1d-9490-8b6a70b175ec does not exist Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a6898164-c9e2-41e5-be2a-5a43087e76cd'] Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1d6114e0-446f-4e1d-9490-8b6a70b175ec does not exist Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a6898164-c9e2-41e5-be2a-5a43087e76cd'] Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1d6114e0-446f-4e1d-9490-8b6a70b175ec does not exist Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a6898164-c9e2-41e5-be2a-5a43087e76cd'] Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1d6114e0-446f-4e1d-9490-8b6a70b175ec does not exist Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a6898164-c9e2-41e5-be2a-5a43087e76cd'] Jul 28 10:35:03.303632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:03.307149 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2f8ff983-3987-45d7-9f87-a73276fe223f tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Returning 404 to user: Security group 1d6114e0-446f-4e1d-9490-8b6a70b175ec does not exist Jul 28 10:35:03.307149 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-a6898164-c9e2-41e5-be2a-5a43087e76cd'] {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:03.309217 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-2f8ff983-3987-45d7-9f87-a73276fe223f tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/1d6114e0-446f-4e1d-9490-8b6a70b175ec" status: 404 len: 194 microversion: 2.1 time: 0.591526 Jul 28 10:35:03.311829 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 340/718] 10.222.0.46 () {58 vars in 1269 bytes} [Thu Jul 28 10:35:02 2022] GET /compute/v2.1/os-security-groups/1d6114e0-446f-4e1d-9490-8b6a70b175ec => generated 194 bytes in 596 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:03.324203 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-63081025-22fd-49cd-a299-49aa86df4b3c tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Calling method '.version_select at 0x7fa94bcdff70>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:03.507319 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-079e9d00-3c3f-4091-8322-7fc1662cfe04 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] 10.222.0.46 "DELETE /compute/v2.1/servers/46c2ad81-8f71-46bd-8886-ec353a2cd80c" status: 204 len: 0 microversion: 2.1 time: 0.823037 Jul 28 10:35:03.508397 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 379/719] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:35:02 2022] DELETE /compute/v2.1/servers/46c2ad81-8f71-46bd-8886-ec353a2cd80c => generated 0 bytes in 827 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:35:03.520603 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1cc49e2a-db1d-4cec-a8b9-8b8ede8cf756 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '.version_select at 0x7fa94baa7d30>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:03.563218 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-63081025-22fd-49cd-a299-49aa86df4b3c tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1f44a7d7-0763-4c7b-85f1-b9b92d7b1980" status: 200 len: 344 microversion: 2.1 time: 0.250091 Jul 28 10:35:03.569509 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 341/720] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:35:03 2022] GET /compute/v2.1/os-volumes/1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 => generated 344 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:03.575799 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-adae7e71-c876-4b8e-8162-9eece64a2945 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:03.576310 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-adae7e71-c876-4b8e-8162-9eece64a2945 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 5267ac56-d5eb-411c-94f6-b22818207bbb] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:03.609140 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-adae7e71-c876-4b8e-8162-9eece64a2945 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:03.609650 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-adae7e71-c876-4b8e-8162-9eece64a2945 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:03.615069 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-adae7e71-c876-4b8e-8162-9eece64a2945 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:03.619450 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-adae7e71-c876-4b8e-8162-9eece64a2945 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:03.692354 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-adae7e71-c876-4b8e-8162-9eece64a2945 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 5267ac56-d5eb-411c-94f6-b22818207bbb] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:35:03.776231 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-adae7e71-c876-4b8e-8162-9eece64a2945 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 5267ac56-d5eb-411c-94f6-b22818207bbb] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:35:03.777380 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-adae7e71-c876-4b8e-8162-9eece64a2945 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:03.777836 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-adae7e71-c876-4b8e-8162-9eece64a2945 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:03.780635 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-adae7e71-c876-4b8e-8162-9eece64a2945 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 5267ac56-d5eb-411c-94f6-b22818207bbb] instance's host None is down, deleting from database Jul 28 10:35:03.788197 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-adae7e71-c876-4b8e-8162-9eece64a2945 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 5267ac56-d5eb-411c-94f6-b22818207bbb] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:35:04.287428 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1cc49e2a-db1d-4cec-a8b9-8b8ede8cf756 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/fce40580-34ea-4436-8547-018672deea3f" status: 202 len: 0 microversion: 2.1 time: 0.776813 Jul 28 10:35:04.288335 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 380/721] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:35:03 2022] DELETE /compute/v2.1/os-security-groups/fce40580-34ea-4436-8547-018672deea3f => generated 0 bytes in 779 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:35:04.298621 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-dd8334b8-b4fc-49ec-b611-a1df50aa306e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '.version_select at 0x7fa94b9e7dc0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:04.305982 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-adae7e71-c876-4b8e-8162-9eece64a2945 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 5267ac56-d5eb-411c-94f6-b22818207bbb] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:35:04.313101 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-adae7e71-c876-4b8e-8162-9eece64a2945 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 5267ac56-d5eb-411c-94f6-b22818207bbb] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:35:04.405838 n-d-850468-6 devstack@n-api.service[119464]: DEBUG neutronclient.v2_0.client [None req-dd8334b8-b4fc-49ec-b611-a1df50aa306e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fce40580-34ea-4436-8547-018672deea3f does not exist", "detail": ""}} {{(pid=119464) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 10:35:04.407148 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.security_group_api [None req-dd8334b8-b4fc-49ec-b611-a1df50aa306e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Neutron security group fce40580-34ea-4436-8547-018672deea3f not found {{(pid=119464) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 10:35:04.410497 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-dd8334b8-b4fc-49ec-b611-a1df50aa306e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] HTTP exception thrown: Security group fce40580-34ea-4436-8547-018672deea3f does not exist Jul 28 10:35:04.410497 n-d-850468-6 devstack@n-api.service[119464]: Neutron server returns request_ids: ['req-b94eb74d-1897-4981-8a60-e0e1fdbf8e1d'] Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-dd8334b8-b4fc-49ec-b611-a1df50aa306e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Request method failure captured: Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-security-groups/fce40580-34ea-4436-8547-018672deea3f HTTP/1.1 Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mY_UmWvwobDpxuDusXuiN2X3phLX9PelsodhuWjeKwRX40vPDz77DGyfctYfO-WofaMuk0eodlXgeEoanzuSgoqD0L1e6dbbmhuN4lfHCBWTqD67dSSkuZfve2sLpg4DOdYZlERCclCFU8tmW6N6gpf-xnNEJ8JDLng7SySEVk-QqM Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: c3c8659bbba84bbfb32e446ba294d81e Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c3c8659bbba84bbfb32e446ba294d81e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: c3c8659bbba84bbfb32e446ba294d81e Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-SecurityGroupsTestJSON-1760984738-project Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: b654c9ee44d245a586f01fcdc20f3deb Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-SecurityGroupsTestJSON-1760984738-project Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: exception: Security group fce40580-34ea-4436-8547-018672deea3f does not exist Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: Neutron server returns request_ids: ['req-b94eb74d-1897-4981-8a60-e0e1fdbf8e1d'] Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'fce40580-34ea-4436-8547-018672deea3f'} Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 10:35:04.412976 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fce40580-34ea-4436-8547-018672deea3f does not exist Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b94eb74d-1897-4981-8a60-e0e1fdbf8e1d'] Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fce40580-34ea-4436-8547-018672deea3f does not exist Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b94eb74d-1897-4981-8a60-e0e1fdbf8e1d'] Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fce40580-34ea-4436-8547-018672deea3f does not exist Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b94eb74d-1897-4981-8a60-e0e1fdbf8e1d'] Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fce40580-34ea-4436-8547-018672deea3f does not exist Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b94eb74d-1897-4981-8a60-e0e1fdbf8e1d'] Jul 28 10:35:04.419188 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:04.426463 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-dd8334b8-b4fc-49ec-b611-a1df50aa306e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Returning 404 to user: Security group fce40580-34ea-4436-8547-018672deea3f does not exist Jul 28 10:35:04.426463 n-d-850468-6 devstack@n-api.service[119464]: Neutron server returns request_ids: ['req-b94eb74d-1897-4981-8a60-e0e1fdbf8e1d'] {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:04.426463 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-dd8334b8-b4fc-49ec-b611-a1df50aa306e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/fce40580-34ea-4436-8547-018672deea3f" status: 404 len: 194 microversion: 2.1 time: 0.131333 Jul 28 10:35:04.429878 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 381/722] 10.222.0.46 () {58 vars in 1269 bytes} [Thu Jul 28 10:35:04 2022] GET /compute/v2.1/os-security-groups/fce40580-34ea-4436-8547-018672deea3f => generated 194 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:04.443399 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d0d53143-03c0-4c50-9548-8346b4a31146 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '.version_select at 0x7fa94ba3bf70>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:04.761061 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-adae7e71-c876-4b8e-8162-9eece64a2945 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5267ac56-d5eb-411c-94f6-b22818207bbb" status: 204 len: 0 microversion: 2.1 time: 1.189961 Jul 28 10:35:04.764852 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 342/723] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:35:03 2022] DELETE /compute/v2.1/servers/5267ac56-d5eb-411c-94f6-b22818207bbb => generated 0 bytes in 1195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:35:04.773954 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b21398e9-8dc3-408c-b86a-d3ac0e2c33f0 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Calling method '.version_select at 0x7fa94bbabe50>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:04.866174 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b21398e9-8dc3-408c-b86a-d3ac0e2c33f0 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1f44a7d7-0763-4c7b-85f1-b9b92d7b1980" status: 200 len: 345 microversion: 2.1 time: 0.098878 Jul 28 10:35:04.867228 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 343/724] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:35:04 2022] GET /compute/v2.1/os-volumes/1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 => generated 345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:04.874007 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-731de8a5-5ffc-4086-819d-f44a349ee60d tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:04.874610 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-731de8a5-5ffc-4086-819d-f44a349ee60d tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 46c2ad81-8f71-46bd-8886-ec353a2cd80c] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:04.902505 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-731de8a5-5ffc-4086-819d-f44a349ee60d tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:04.902869 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-731de8a5-5ffc-4086-819d-f44a349ee60d tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:04.904999 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-731de8a5-5ffc-4086-819d-f44a349ee60d tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:04.905228 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-731de8a5-5ffc-4086-819d-f44a349ee60d tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:04.958346 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-731de8a5-5ffc-4086-819d-f44a349ee60d tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] HTTP exception thrown: Instance 46c2ad81-8f71-46bd-8886-ec353a2cd80c could not be found. Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-731de8a5-5ffc-4086-819d-f44a349ee60d tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Request method failure captured: Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/46c2ad81-8f71-46bd-8886-ec353a2cd80c HTTP/1.1 Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mZQI4M74wX697W-chGa1L4dZ25kHDj5b7rpPFrBAZ-BaEBzCg_zafuWsLOtfImL67T0LRREKYcn_6RCxpV7vmFD1Xnuc1GNqo8so8PH0pNhoqvwb7Lm4RFA9ykbbyfFAE1TQ7BufdxiJCK9jIDtAidmAODCB_k-4vRRbvKKjXKQ9o0 Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 012167e98eaf4676b40d031cb86a03ad Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-MultipleCreateTestJSON-445292188 Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/012167e98eaf4676b40d031cb86a03ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/012167e98eaf4676b40d031cb86a03ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/012167e98eaf4676b40d031cb86a03ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_012167e98eaf4676b40d031cb86a03ad", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-MultipleCreateTestJSON-445292188 Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 012167e98eaf4676b40d031cb86a03ad Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-MultipleCreateTestJSON-445292188 Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-MultipleCreateTestJSON-445292188-project Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: e6c5088cf1094c19b300bfcf6a9dd5ae Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-MultipleCreateTestJSON-445292188-project Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 46c2ad81-8f71-46bd-8886-ec353a2cd80c could not be found. Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '46c2ad81-8f71-46bd-8886-ec353a2cd80c'} Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c2ad81-8f71-46bd-8886-ec353a2cd80c could not be found. Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c2ad81-8f71-46bd-8886-ec353a2cd80c could not be found. Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:04.960761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:04.967666 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:04.967666 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:04.967666 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:04.967666 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:04.967666 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:04.967666 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c2ad81-8f71-46bd-8886-ec353a2cd80c could not be found. Jul 28 10:35:04.967666 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:04.967666 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-731de8a5-5ffc-4086-819d-f44a349ee60d tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Returning 404 to user: Instance 46c2ad81-8f71-46bd-8886-ec353a2cd80c could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:04.967666 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-731de8a5-5ffc-4086-819d-f44a349ee60d tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] 10.222.0.46 "GET /compute/v2.1/servers/46c2ad81-8f71-46bd-8886-ec353a2cd80c" status: 404 len: 111 microversion: 2.1 time: 0.091847 Jul 28 10:35:04.967666 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 344/725] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:04 2022] GET /compute/v2.1/servers/46c2ad81-8f71-46bd-8886-ec353a2cd80c => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:04.972157 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4ffc1696-0b1e-4378-9d94-4f0543f9c5ec tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Action: 'create', calling method: .version_select at 0x7fa94bcdf670>, body: {"snapshot": {"volume_id": "1f44a7d7-0763-4c7b-85f1-b9b92d7b1980", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1026267662"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:35:05.467856 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-d0d53143-03c0-4c50-9548-8346b4a31146 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/46b77589-584d-43f7-a576-9947358ae992" status: 202 len: 0 microversion: 2.1 time: 1.035126 Jul 28 10:35:05.469271 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 382/726] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:35:04 2022] DELETE /compute/v2.1/os-security-groups/46b77589-584d-43f7-a576-9947358ae992 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:35:05.482756 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-57bdd6ea-a27c-4dd1-ad27-11668b512c64 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:05.483687 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-57bdd6ea-a27c-4dd1-ad27-11668b512c64 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 5267ac56-d5eb-411c-94f6-b22818207bbb] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:05.510669 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-57bdd6ea-a27c-4dd1-ad27-11668b512c64 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:05.511308 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-57bdd6ea-a27c-4dd1-ad27-11668b512c64 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:05.513489 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-57bdd6ea-a27c-4dd1-ad27-11668b512c64 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:05.516917 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-57bdd6ea-a27c-4dd1-ad27-11668b512c64 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:05.526421 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-4ffc1696-0b1e-4378-9d94-4f0543f9c5ec tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.557832 Jul 28 10:35:05.527883 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 345/727] 10.222.0.46 () {60 vars in 1162 bytes} [Thu Jul 28 10:35:04 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:05.533180 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ace16eaa-12c2-4b43-a1f5-eb5f9b731481 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '.version_select at 0x7fa94ba07d30>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:05.559618 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-57bdd6ea-a27c-4dd1-ad27-11668b512c64 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] HTTP exception thrown: Instance 5267ac56-d5eb-411c-94f6-b22818207bbb could not be found. Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-57bdd6ea-a27c-4dd1-ad27-11668b512c64 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Request method failure captured: Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/5267ac56-d5eb-411c-94f6-b22818207bbb HTTP/1.1 Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mZQI4M74wX697W-chGa1L4dZ25kHDj5b7rpPFrBAZ-BaEBzCg_zafuWsLOtfImL67T0LRREKYcn_6RCxpV7vmFD1Xnuc1GNqo8so8PH0pNhoqvwb7Lm4RFA9ykbbyfFAE1TQ7BufdxiJCK9jIDtAidmAODCB_k-4vRRbvKKjXKQ9o0 Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 012167e98eaf4676b40d031cb86a03ad Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-MultipleCreateTestJSON-445292188 Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/012167e98eaf4676b40d031cb86a03ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/012167e98eaf4676b40d031cb86a03ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/012167e98eaf4676b40d031cb86a03ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_012167e98eaf4676b40d031cb86a03ad", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-MultipleCreateTestJSON-445292188 Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 012167e98eaf4676b40d031cb86a03ad Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-MultipleCreateTestJSON-445292188 Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-MultipleCreateTestJSON-445292188-project Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: e6c5088cf1094c19b300bfcf6a9dd5ae Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-MultipleCreateTestJSON-445292188-project Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 5267ac56-d5eb-411c-94f6-b22818207bbb could not be found. Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '5267ac56-d5eb-411c-94f6-b22818207bbb'} Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5267ac56-d5eb-411c-94f6-b22818207bbb could not be found. Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5267ac56-d5eb-411c-94f6-b22818207bbb could not be found. Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:05.563301 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:05.568685 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:05.568685 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:05.568685 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:05.568685 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:05.568685 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:05.568685 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5267ac56-d5eb-411c-94f6-b22818207bbb could not be found. Jul 28 10:35:05.568685 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:05.574210 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-57bdd6ea-a27c-4dd1-ad27-11668b512c64 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Returning 404 to user: Instance 5267ac56-d5eb-411c-94f6-b22818207bbb could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:05.575792 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-57bdd6ea-a27c-4dd1-ad27-11668b512c64 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] 10.222.0.46 "GET /compute/v2.1/servers/5267ac56-d5eb-411c-94f6-b22818207bbb" status: 404 len: 111 microversion: 2.1 time: 0.098469 Jul 28 10:35:05.577812 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 383/728] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:05 2022] GET /compute/v2.1/servers/5267ac56-d5eb-411c-94f6-b22818207bbb => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:05.598131 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-70cc40b9-6d44-4a6d-b9be-dfbed4b7e4a7 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Calling method '.version_select at 0x7fa94b9e74c0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:05.737111 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-70cc40b9-6d44-4a6d-b9be-dfbed4b7e4a7 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/3eec1693-bf54-4a7e-845c-5e4e4cef0b04" status: 200 len: 287 microversion: 2.1 time: 0.157961 Jul 28 10:35:05.738303 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 384/729] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Jul 28 10:35:05 2022] GET /compute/v2.1/os-snapshots/3eec1693-bf54-4a7e-845c-5e4e4cef0b04 => generated 287 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:05.751180 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6af49905-d309-4be6-9ec6-a63b74517bc8 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Calling method '.version_select at 0x7fa94ba3b940>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:05.762506 n-d-850468-6 devstack@n-api.service[119463]: DEBUG neutronclient.v2_0.client [None req-ace16eaa-12c2-4b43-a1f5-eb5f9b731481 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 46b77589-584d-43f7-a576-9947358ae992 does not exist", "detail": ""}} {{(pid=119463) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 10:35:05.763102 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.security_group_api [None req-ace16eaa-12c2-4b43-a1f5-eb5f9b731481 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Neutron security group 46b77589-584d-43f7-a576-9947358ae992 not found {{(pid=119463) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 10:35:05.763614 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-ace16eaa-12c2-4b43-a1f5-eb5f9b731481 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] HTTP exception thrown: Security group 46b77589-584d-43f7-a576-9947358ae992 does not exist Jul 28 10:35:05.763614 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-e8f2ba27-b4af-4edd-8a96-5ef16a458d5c'] Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ace16eaa-12c2-4b43-a1f5-eb5f9b731481 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Request method failure captured: Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/os-security-groups/46b77589-584d-43f7-a576-9947358ae992 HTTP/1.1 Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mY_UmWvwobDpxuDusXuiN2X3phLX9PelsodhuWjeKwRX40vPDz77DGyfctYfO-WofaMuk0eodlXgeEoanzuSgoqD0L1e6dbbmhuN4lfHCBWTqD67dSSkuZfve2sLpg4DOdYZlERCclCFU8tmW6N6gpf-xnNEJ8JDLng7SySEVk-QqM Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: c3c8659bbba84bbfb32e446ba294d81e Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c3c8659bbba84bbfb32e446ba294d81e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: c3c8659bbba84bbfb32e446ba294d81e Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-SecurityGroupsTestJSON-1760984738-project Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: b654c9ee44d245a586f01fcdc20f3deb Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-SecurityGroupsTestJSON-1760984738-project Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: exception: Security group 46b77589-584d-43f7-a576-9947358ae992 does not exist Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-e8f2ba27-b4af-4edd-8a96-5ef16a458d5c'] Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '46b77589-584d-43f7-a576-9947358ae992'} Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 10:35:05.769469 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 46b77589-584d-43f7-a576-9947358ae992 does not exist Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8f2ba27-b4af-4edd-8a96-5ef16a458d5c'] Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 46b77589-584d-43f7-a576-9947358ae992 does not exist Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8f2ba27-b4af-4edd-8a96-5ef16a458d5c'] Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 46b77589-584d-43f7-a576-9947358ae992 does not exist Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8f2ba27-b4af-4edd-8a96-5ef16a458d5c'] Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 46b77589-584d-43f7-a576-9947358ae992 does not exist Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8f2ba27-b4af-4edd-8a96-5ef16a458d5c'] Jul 28 10:35:05.773938 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:05.781333 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ace16eaa-12c2-4b43-a1f5-eb5f9b731481 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Returning 404 to user: Security group 46b77589-584d-43f7-a576-9947358ae992 does not exist Jul 28 10:35:05.781333 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-e8f2ba27-b4af-4edd-8a96-5ef16a458d5c'] {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:05.782722 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ace16eaa-12c2-4b43-a1f5-eb5f9b731481 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/46b77589-584d-43f7-a576-9947358ae992" status: 404 len: 194 microversion: 2.1 time: 0.252996 Jul 28 10:35:05.786272 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 346/730] 10.222.0.46 () {58 vars in 1269 bytes} [Thu Jul 28 10:35:05 2022] GET /compute/v2.1/os-security-groups/46b77589-584d-43f7-a576-9947358ae992 => generated 194 bytes in 257 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:05.803989 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ca54989e-477d-4e55-a56a-343b0de81b23 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '.version_select at 0x7fa94bd2e0d0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:05.881783 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-6af49905-d309-4be6-9ec6-a63b74517bc8 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.127242 Jul 28 10:35:05.881783 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 385/731] 10.222.0.46 () {58 vars in 1140 bytes} [Thu Jul 28 10:35:05 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:05.895070 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-287805387", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "91258437-70fd-4795-879b-2ceeb860ebc5"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:35:06.038652 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] validate_networks() for [('91258437-70fd-4795-879b-2ceeb860ebc5', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:35:06.266252 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ca54989e-477d-4e55-a56a-343b0de81b23 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.466000 Jul 28 10:35:06.267575 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 347/732] 10.222.0.46 () {58 vars in 1158 bytes} [Thu Jul 28 10:35:05 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:35:06.272737 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-08d4f0ed-f2a1-414c-8c29-eb3318c2f0ee tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Calling method '.version_select at 0x7fa94ba07ee0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:06.347446 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-08d4f0ed-f2a1-414c-8c29-eb3318c2f0ee tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/3eec1693-bf54-4a7e-845c-5e4e4cef0b04" status: 200 len: 287 microversion: 2.1 time: 0.078344 Jul 28 10:35:06.349233 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 348/733] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Jul 28 10:35:06 2022] GET /compute/v2.1/os-snapshots/3eec1693-bf54-4a7e-845c-5e4e4cef0b04 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:06.356092 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-2064781227", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "0d14eb0e-4ca4-4859-a123-b42bd0e087e4"}], "security_groups": [{"name": "tempest-securitygroup--465435415"}], "key_name": "tempest-keypair-269454918", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:35:06.839789 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] validate_networks() for [('0d14eb0e-4ca4-4859-a123-b42bd0e087e4', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:35:08.079661 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=10 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:08.130237 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=36 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:08.462551 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Getting quotas for project 5927f7b9c41a40c28968dc9605d3b430. Resources: dict_keys(['metadata_items']) {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:35:08.480266 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Getting quotas for user d392e28695084290953f90c3a36dcc1b and project 5927f7b9c41a40c28968dc9605d3b430. Resources: dict_keys(['metadata_items']) {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:35:08.481689 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:35:08.482489 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:35:08.483167 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:35:08.483770 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:35:08.485974 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:35:08.506896 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:08.507699 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:08.509514 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:08.511129 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:08.527443 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:35:08.531566 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:35:08.532226 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:35:08.537017 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:35:08.539892 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:35:08.568696 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:08.569351 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:08.570353 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:08.577195 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:08.596963 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:DELETE=5,nova_cell0:SELECT=61,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:08.630944 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Getting quotas for project 012167e98eaf4676b40d031cb86a03ad. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:35:08.631206 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Getting quotas for project 5927f7b9c41a40c28968dc9605d3b430. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:35:08.640081 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Getting quotas for user d392e28695084290953f90c3a36dcc1b and project 5927f7b9c41a40c28968dc9605d3b430. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:35:08.647810 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Getting quotas for user e6c5088cf1094c19b300bfcf6a9dd5ae and project 012167e98eaf4676b40d031cb86a03ad. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:35:08.659191 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=4,nova_api:INSERT=9 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:08.678809 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:35:08.684389 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] [instance: 6e95c8f3-aa5d-4384-bd43-8434776b69a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:35:08.694794 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Going to run 2 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:35:08.705999 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 171f826d-0eb7-4772-95d4-2ffc1fad43e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:35:08.777099 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: ae65f84b-209e-47a9-b887-5190f803e3ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=171f826d-0eb7-4772-95d4-2ffc1fad43e3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:35:08.798253 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-2482d0f5-93ca-455e-af10-4d1e5b014192 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.447327 Jul 28 10:35:08.823095 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 349/734] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:35:06 2022] POST /compute/v2.1/servers => generated 408 bytes in 2472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:35:08.828247 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-96f30cb4-ff83-43ab-a84b-cb4b0e5e3cf6 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Action: 'create', calling method: .version_select at 0x7fa94ba224c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1870211804", "description": "tempest-description-165535776"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:35:08.941151 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-fdce1522-c530-40cc-9859-eeb900598218 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.064259 Jul 28 10:35:08.947630 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 386/735] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:35:05 2022] POST /compute/v2.1/servers => generated 32 bytes in 3071 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 28 10:35:08.965937 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8b2befad-5b22-4ac3-90f1-4c03bf054b6f tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Calling method '.version_select at 0x7fa94baa7ee0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:09.142754 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-8b2befad-5b22-4ac3-90f1-4c03bf054b6f tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/3eec1693-bf54-4a7e-845c-5e4e4cef0b04" status: 200 len: 288 microversion: 2.1 time: 0.192904 Jul 28 10:35:09.143989 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 387/736] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Jul 28 10:35:08 2022] GET /compute/v2.1/os-snapshots/3eec1693-bf54-4a7e-845c-5e4e4cef0b04 => generated 288 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:09.149103 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1da81244-29c1-485e-82fd-79f6c0bd6217 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:09.151185 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-1da81244-29c1-485e-82fd-79f6c0bd6217 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] [instance: 6e95c8f3-aa5d-4384-bd43-8434776b69a2] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:09.385350 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-96f30cb4-ff83-43ab-a84b-cb4b0e5e3cf6 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.559906 Jul 28 10:35:09.386581 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 350/737] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:35:08 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:09.392589 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e2d58012-835c-45d1-8817-9d43f3649d49 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:09.417657 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-e2d58012-835c-45d1-8817-9d43f3649d49 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6c5088cf1094c19b300bfcf6a9dd5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012167e98eaf4676b40d031cb86a03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:09.419728 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-e2d58012-835c-45d1-8817-9d43f3649d49 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Searching by: {'deleted': False, 'project_id': '012167e98eaf4676b40d031cb86a03ad'} {{(pid=119463) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 10:35:09.452076 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-1da81244-29c1-485e-82fd-79f6c0bd6217 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd392e28695084290953f90c3a36dcc1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5927f7b9c41a40c28968dc9605d3b430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:09.459812 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e2d58012-835c-45d1-8817-9d43f3649d49 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:09.461123 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e2d58012-835c-45d1-8817-9d43f3649d49 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:09.462542 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e2d58012-835c-45d1-8817-9d43f3649d49 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:09.463306 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e2d58012-835c-45d1-8817-9d43f3649d49 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:09.476236 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1da81244-29c1-485e-82fd-79f6c0bd6217 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] 10.222.0.46 "GET /compute/v2.1/servers/6e95c8f3-aa5d-4384-bd43-8434776b69a2" status: 200 len: 1277 microversion: 2.1 time: 0.330963 Jul 28 10:35:09.489239 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 388/738] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:09 2022] GET /compute/v2.1/servers/6e95c8f3-aa5d-4384-bd43-8434776b69a2 => generated 1277 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:35:09.500679 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9a8e764b-49aa-4b9c-95c1-d77de2ef926e tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Calling method '.version_select at 0x7fa94b9e7940>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:09.516990 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.multi_cell_list [None req-e2d58012-835c-45d1-8817-9d43f3649d49 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=119463) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 10:35:09.591247 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e2d58012-835c-45d1-8817-9d43f3649d49 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 671 microversion: 2.1 time: 0.203072 Jul 28 10:35:09.592294 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 351/739] 10.222.0.46 () {58 vars in 1125 bytes} [Thu Jul 28 10:35:09 2022] GET /compute/v2.1/servers => generated 671 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:09.606706 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1027424060", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "fc480ddc-689b-4a08-ab44-677bf4b84cd1"}], "security_groups": [{"name": "tempest-securitygroup--733085434"}], "key_name": "tempest-keypair-42878079", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:35:09.707760 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9a8e764b-49aa-4b9c-95c1-d77de2ef926e tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/3eec1693-bf54-4a7e-845c-5e4e4cef0b04" status: 202 len: 0 microversion: 2.1 time: 0.210843 Jul 28 10:35:09.713314 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 389/740] 10.222.0.46 () {58 vars in 1254 bytes} [Thu Jul 28 10:35:09 2022] DELETE /compute/v2.1/os-snapshots/3eec1693-bf54-4a7e-845c-5e4e4cef0b04 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:35:09.719369 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4dba536e-1a0e-4fd0-83f3-0f164e38697c tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Action: 'create', calling method: .version_select at 0x7fa94b9e7ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1631026725", "description": "tempest-description-1980049851"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:35:09.923301 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] validate_networks() for [('fc480ddc-689b-4a08-ab44-677bf4b84cd1', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:35:10.625852 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:35:10.627758 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:35:10.628594 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:35:10.629201 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:35:10.629834 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:35:10.638634 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=37 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:10.647605 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:10.648059 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:10.650869 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:10.654703 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:10.675503 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=13 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:10.691654 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Getting quotas for project 70ceba76ab9744e7a0ae4f2438709f7d. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:35:10.697719 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Getting quotas for user e28dd90a9b204ee78200f89abd27052a and project 70ceba76ab9744e7a0ae4f2438709f7d. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:35:10.702486 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:10.716921 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:35:10.716921 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 744bccb9-89b5-4309-a75d-c5faf07eb0a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:35:10.781824 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d6ab958d-0cf5-4d86-bc4c-1ae64e8f94b8 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.187443 Jul 28 10:35:10.783168 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 352/741] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:35:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:35:10.795579 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-44574c38-8d6a-4a5e-a4a9-fa1dbe3ead12 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:10.799039 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-44574c38-8d6a-4a5e-a4a9-fa1dbe3ead12 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: ae65f84b-209e-47a9-b887-5190f803e3ef] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:10.818656 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-44574c38-8d6a-4a5e-a4a9-fa1dbe3ead12 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:10.819281 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-44574c38-8d6a-4a5e-a4a9-fa1dbe3ead12 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:10.820254 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-44574c38-8d6a-4a5e-a4a9-fa1dbe3ead12 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:10.820804 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-44574c38-8d6a-4a5e-a4a9-fa1dbe3ead12 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:10.886974 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-44574c38-8d6a-4a5e-a4a9-fa1dbe3ead12 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:10.888054 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-44574c38-8d6a-4a5e-a4a9-fa1dbe3ead12 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:10.889182 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-44574c38-8d6a-4a5e-a4a9-fa1dbe3ead12 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lazy-loading 'fault' on Instance uuid ae65f84b-209e-47a9-b887-5190f803e3ef {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:35:10.980121 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-44574c38-8d6a-4a5e-a4a9-fa1dbe3ead12 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c5088cf1094c19b300bfcf6a9dd5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012167e98eaf4676b40d031cb86a03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:10.988222 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-44574c38-8d6a-4a5e-a4a9-fa1dbe3ead12 tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] 10.222.0.46 "GET /compute/v2.1/servers/ae65f84b-209e-47a9-b887-5190f803e3ef" status: 200 len: 1290 microversion: 2.1 time: 0.203650 Jul 28 10:35:10.989345 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 353/742] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:10 2022] GET /compute/v2.1/servers/ae65f84b-209e-47a9-b887-5190f803e3ef => generated 1290 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:35:10.995368 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0a99d185-a627-4076-8be4-7dfaf5559d1e tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Calling method '.version_select at 0x7fa94bbab3a0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:11.006759 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-4dba536e-1a0e-4fd0-83f3-0f164e38697c tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.291639 Jul 28 10:35:11.007358 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 390/743] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:35:09 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:11.015020 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-30629e34-8a03-47d2-b3e1-74b00d159a5c tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:11.015643 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-30629e34-8a03-47d2-b3e1-74b00d159a5c tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] [instance: 6e95c8f3-aa5d-4384-bd43-8434776b69a2] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:11.046010 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-30629e34-8a03-47d2-b3e1-74b00d159a5c tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:11.046476 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-30629e34-8a03-47d2-b3e1-74b00d159a5c tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:11.050746 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-0a99d185-a627-4076-8be4-7dfaf5559d1e tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/3eec1693-bf54-4a7e-845c-5e4e4cef0b04" status: 200 len: 287 microversion: 2.1 time: 0.060165 Jul 28 10:35:11.051436 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 354/744] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Jul 28 10:35:10 2022] GET /compute/v2.1/os-snapshots/3eec1693-bf54-4a7e-845c-5e4e4cef0b04 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:11.058167 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ebd17cac-5092-41ad-b406-e3bd5ac3180b tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:11.060909 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-30629e34-8a03-47d2-b3e1-74b00d159a5c tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:11.061939 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ebd17cac-5092-41ad-b406-e3bd5ac3180b tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 744bccb9-89b5-4309-a75d-c5faf07eb0a0] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:11.066142 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-30629e34-8a03-47d2-b3e1-74b00d159a5c tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:11.215730 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-30629e34-8a03-47d2-b3e1-74b00d159a5c tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:11.216246 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-30629e34-8a03-47d2-b3e1-74b00d159a5c tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:11.217007 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-30629e34-8a03-47d2-b3e1-74b00d159a5c tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lazy-loading 'fault' on Instance uuid 6e95c8f3-aa5d-4384-bd43-8434776b69a2 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:35:11.320790 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-30629e34-8a03-47d2-b3e1-74b00d159a5c tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd392e28695084290953f90c3a36dcc1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5927f7b9c41a40c28968dc9605d3b430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:11.332926 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-ebd17cac-5092-41ad-b406-e3bd5ac3180b tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28dd90a9b204ee78200f89abd27052a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ceba76ab9744e7a0ae4f2438709f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:11.338852 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-30629e34-8a03-47d2-b3e1-74b00d159a5c tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] 10.222.0.46 "GET /compute/v2.1/servers/6e95c8f3-aa5d-4384-bd43-8434776b69a2" status: 200 len: 1350 microversion: 2.1 time: 0.330398 Jul 28 10:35:11.344581 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 391/745] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:11 2022] GET /compute/v2.1/servers/6e95c8f3-aa5d-4384-bd43-8434776b69a2 => generated 1350 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:35:11.361521 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1090482542", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "23de53e8-d4b8-427a-b6f2-f1a17846e4a1"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:35:11.366094 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ebd17cac-5092-41ad-b406-e3bd5ac3180b tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] 10.222.0.46 "GET /compute/v2.1/servers/744bccb9-89b5-4309-a75d-c5faf07eb0a0" status: 200 len: 1233 microversion: 2.1 time: 0.312505 Jul 28 10:35:11.367349 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 355/746] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:11 2022] GET /compute/v2.1/servers/744bccb9-89b5-4309-a75d-c5faf07eb0a0 => generated 1233 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:35:11.396850 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c3c4bc56-23a6-451b-98e3-1509a682c9a8 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:11.397706 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c3c4bc56-23a6-451b-98e3-1509a682c9a8 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] [instance: 6e95c8f3-aa5d-4384-bd43-8434776b69a2] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:11.428242 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c3c4bc56-23a6-451b-98e3-1509a682c9a8 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:11.433500 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c3c4bc56-23a6-451b-98e3-1509a682c9a8 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:11.434707 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c3c4bc56-23a6-451b-98e3-1509a682c9a8 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:11.448241 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c3c4bc56-23a6-451b-98e3-1509a682c9a8 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:11.467194 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] validate_networks() for [('23de53e8-d4b8-427a-b6f2-f1a17846e4a1', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:35:11.515710 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c3c4bc56-23a6-451b-98e3-1509a682c9a8 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] [instance: 6e95c8f3-aa5d-4384-bd43-8434776b69a2] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:35:11.622530 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c3c4bc56-23a6-451b-98e3-1509a682c9a8 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] [instance: 6e95c8f3-aa5d-4384-bd43-8434776b69a2] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:35:11.623385 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c3c4bc56-23a6-451b-98e3-1509a682c9a8 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:11.623822 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c3c4bc56-23a6-451b-98e3-1509a682c9a8 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:11.624253 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-c3c4bc56-23a6-451b-98e3-1509a682c9a8 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] [instance: 6e95c8f3-aa5d-4384-bd43-8434776b69a2] instance's host None is down, deleting from database Jul 28 10:35:11.642029 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-c3c4bc56-23a6-451b-98e3-1509a682c9a8 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] [instance: 6e95c8f3-aa5d-4384-bd43-8434776b69a2] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:35:11.754001 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-c3c4bc56-23a6-451b-98e3-1509a682c9a8 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] [instance: 6e95c8f3-aa5d-4384-bd43-8434776b69a2] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:35:11.764944 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-c3c4bc56-23a6-451b-98e3-1509a682c9a8 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] [instance: 6e95c8f3-aa5d-4384-bd43-8434776b69a2] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:35:12.027123 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=71,nova_cell0:UPDATE=23,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:12.100982 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c3c4bc56-23a6-451b-98e3-1509a682c9a8 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6e95c8f3-aa5d-4384-bd43-8434776b69a2" status: 204 len: 0 microversion: 2.1 time: 0.731711 Jul 28 10:35:12.105552 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 356/747] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:35:11 2022] DELETE /compute/v2.1/servers/6e95c8f3-aa5d-4384-bd43-8434776b69a2 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:35:12.120793 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e0c4dd23-b418-4a68-9ea2-115bd5b9fd3d tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:12.125756 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-e0c4dd23-b418-4a68-9ea2-115bd5b9fd3d tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: ae65f84b-209e-47a9-b887-5190f803e3ef] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:12.143717 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e0c4dd23-b418-4a68-9ea2-115bd5b9fd3d tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:12.144183 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e0c4dd23-b418-4a68-9ea2-115bd5b9fd3d tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:12.145453 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e0c4dd23-b418-4a68-9ea2-115bd5b9fd3d tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:12.147181 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e0c4dd23-b418-4a68-9ea2-115bd5b9fd3d tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:12.193719 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e0c4dd23-b418-4a68-9ea2-115bd5b9fd3d tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:12.194403 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e0c4dd23-b418-4a68-9ea2-115bd5b9fd3d tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:12.194811 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-e0c4dd23-b418-4a68-9ea2-115bd5b9fd3d tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lazy-loading 'fault' on Instance uuid ae65f84b-209e-47a9-b887-5190f803e3ef {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:35:12.280163 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-e0c4dd23-b418-4a68-9ea2-115bd5b9fd3d tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c5088cf1094c19b300bfcf6a9dd5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012167e98eaf4676b40d031cb86a03ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:12.293729 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e0c4dd23-b418-4a68-9ea2-115bd5b9fd3d tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] 10.222.0.46 "GET /compute/v2.1/servers/ae65f84b-209e-47a9-b887-5190f803e3ef" status: 200 len: 1290 microversion: 2.1 time: 0.186308 Jul 28 10:35:12.301934 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 357/748] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:12 2022] GET /compute/v2.1/servers/ae65f84b-209e-47a9-b887-5190f803e3ef => generated 1290 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:35:12.314547 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-cd065024-8d12-4829-ae63-49f0bdc3dbb3 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Calling method '.version_select at 0x7fa94ba223a0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:12.351360 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-cd065024-8d12-4829-ae63-49f0bdc3dbb3 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] HTTP exception thrown: Snapshot 3eec1693-bf54-4a7e-845c-5e4e4cef0b04 could not be found. Jul 28 10:35:12.374731 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:35:12.375261 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:35:12.376334 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:35:12.376850 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:35:12.377365 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:35:12.390158 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:12.390932 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:12.392003 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:12.392721 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-cd065024-8d12-4829-ae63-49f0bdc3dbb3 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Request method failure captured: Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/os-snapshots/3eec1693-bf54-4a7e-845c-5e4e4cef0b04 HTTP/1.1 Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mZUAS6HEZNJMsL-TI_ZHzk-rM_vmMI3By_OK9KnyNmiLapXVVNfu7GdxAKwCeB0i7Au1BD43eAy5JheGXE8C6dj_y1E3b0LTT30JTHnM5tCb2FQ-TUqoi4a7sGBPMIRzpN6fbOD6Vp-M7XipVduQyn-TkSpcHMMm1-0fRL2_FAcyT0 Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: c91816fbea234d25ae14c2b7fcbf769d Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2034448652 Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c91816fbea234d25ae14c2b7fcbf769d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c91816fbea234d25ae14c2b7fcbf769d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c91816fbea234d25ae14c2b7fcbf769d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c91816fbea234d25ae14c2b7fcbf769d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2034448652 Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: c91816fbea234d25ae14c2b7fcbf769d Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2034448652 Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-VolumesSnapshotsTestJSON-2034448652-project Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: c7698475cfb24721a443b015a52af552 Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2034448652-project Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: exception: Snapshot 3eec1693-bf54-4a7e-845c-5e4e4cef0b04 could not be found. Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '3eec1693-bf54-4a7e-845c-5e4e4cef0b04'} Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3eec1693-bf54-4a7e-845c-5e4e4cef0b04 could not be found. (HTTP 404) (Request-ID: req-aa1ff331-8612-49a4-a6d3-fb1bb18c006c) Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 10:35:12.396380 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3eec1693-bf54-4a7e-845c-5e4e4cef0b04 could not be found. Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3eec1693-bf54-4a7e-845c-5e4e4cef0b04 could not be found. Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3eec1693-bf54-4a7e-845c-5e4e4cef0b04 could not be found. Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-cd065024-8d12-4829-ae63-49f0bdc3dbb3 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Returning 404 to user: Snapshot 3eec1693-bf54-4a7e-845c-5e4e4cef0b04 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-cd065024-8d12-4829-ae63-49f0bdc3dbb3 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/3eec1693-bf54-4a7e-845c-5e4e4cef0b04" status: 404 len: 111 microversion: 2.1 time: 0.101264 Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 358/749] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Jul 28 10:35:12 2022] GET /compute/v2.1/os-snapshots/3eec1693-bf54-4a7e-845c-5e4e4cef0b04 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:12.406296 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4c38fe73-fa06-4631-a7c0-0ebd878aa199 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:12.410609 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-4c38fe73-fa06-4631-a7c0-0ebd878aa199 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] [instance: 6e95c8f3-aa5d-4384-bd43-8434776b69a2] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:12.423304 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Getting quotas for project c3c8659bbba84bbfb32e446ba294d81e. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:35:12.424729 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4c38fe73-fa06-4631-a7c0-0ebd878aa199 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:12.425643 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4c38fe73-fa06-4631-a7c0-0ebd878aa199 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:12.428090 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4c38fe73-fa06-4631-a7c0-0ebd878aa199 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:12.428580 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4c38fe73-fa06-4631-a7c0-0ebd878aa199 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:12.431659 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Getting quotas for user b654c9ee44d245a586f01fcdc20f3deb and project c3c8659bbba84bbfb32e446ba294d81e. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:35:12.454612 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:35:12.457710 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: 48eaec93-d976-4eee-834a-6ebbc4250e8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:35:12.470116 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-4c38fe73-fa06-4631-a7c0-0ebd878aa199 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] HTTP exception thrown: Instance 6e95c8f3-aa5d-4384-bd43-8434776b69a2 could not be found. Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4c38fe73-fa06-4631-a7c0-0ebd878aa199 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Request method failure captured: Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/6e95c8f3-aa5d-4384-bd43-8434776b69a2 HTTP/1.1 Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mZN6hmPEgJLX1xzL9YSYktu6fMq3iqfPayFPf6jR8GqeZ_m6kli4VXd6ubD97ejzhH7lLEZk8qBIg4ptgbkRVdiEYdal6s99p7JvlGrGQZTlYtgzQ8U4_8fK2dXuwOye2r1F3RK1Rr2bn1t4vYV1Sgk5bWEu-ZDSk2_fDbjFDFDFPI Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 5927f7b9c41a40c28968dc9605d3b430 Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServersTestManualDisk-1353618979 Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5927f7b9c41a40c28968dc9605d3b430"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5927f7b9c41a40c28968dc9605d3b430"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5927f7b9c41a40c28968dc9605d3b430"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5927f7b9c41a40c28968dc9605d3b430", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServersTestManualDisk-1353618979 Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 5927f7b9c41a40c28968dc9605d3b430 Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServersTestManualDisk-1353618979 Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServersTestManualDisk-1353618979-project Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: d392e28695084290953f90c3a36dcc1b Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServersTestManualDisk-1353618979-project Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 6e95c8f3-aa5d-4384-bd43-8434776b69a2 could not be found. Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '6e95c8f3-aa5d-4384-bd43-8434776b69a2'} Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e95c8f3-aa5d-4384-bd43-8434776b69a2 could not be found. Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e95c8f3-aa5d-4384-bd43-8434776b69a2 could not be found. Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:12.476041 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:12.486084 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:12.486084 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:12.486084 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:12.486084 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:12.486084 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:12.486084 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e95c8f3-aa5d-4384-bd43-8434776b69a2 could not be found. Jul 28 10:35:12.486084 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:12.486084 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4c38fe73-fa06-4631-a7c0-0ebd878aa199 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Returning 404 to user: Instance 6e95c8f3-aa5d-4384-bd43-8434776b69a2 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:12.486084 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-4c38fe73-fa06-4631-a7c0-0ebd878aa199 tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] 10.222.0.46 "GET /compute/v2.1/servers/6e95c8f3-aa5d-4384-bd43-8434776b69a2" status: 404 len: 111 microversion: 2.1 time: 0.079499 Jul 28 10:35:12.486084 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 359/750] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:12 2022] GET /compute/v2.1/servers/6e95c8f3-aa5d-4384-bd43-8434776b69a2 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:12.490107 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-83fa669f-3e4e-4869-bbbe-7993c64fc0cb tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:12.490620 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-83fa669f-3e4e-4869-bbbe-7993c64fc0cb tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: ae65f84b-209e-47a9-b887-5190f803e3ef] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:12.506712 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-83fa669f-3e4e-4869-bbbe-7993c64fc0cb tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:12.510116 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-83fa669f-3e4e-4869-bbbe-7993c64fc0cb tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:12.511906 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-83fa669f-3e4e-4869-bbbe-7993c64fc0cb tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:12.520237 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-83fa669f-3e4e-4869-bbbe-7993c64fc0cb tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:12.594109 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c2fed20d-eb01-4280-b2c7-798d00bf7637 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.247910 Jul 28 10:35:12.600530 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-83fa669f-3e4e-4869-bbbe-7993c64fc0cb tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: ae65f84b-209e-47a9-b887-5190f803e3ef] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:35:12.601763 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 392/751] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:35:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:35:12.610683 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-bf8bee77-7f09-453c-b6a1-8ba4f8a75858 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:12.611682 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-bf8bee77-7f09-453c-b6a1-8ba4f8a75858 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 744bccb9-89b5-4309-a75d-c5faf07eb0a0] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:12.622472 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-bf8bee77-7f09-453c-b6a1-8ba4f8a75858 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:12.623779 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-bf8bee77-7f09-453c-b6a1-8ba4f8a75858 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:12.624778 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-bf8bee77-7f09-453c-b6a1-8ba4f8a75858 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:12.625516 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-bf8bee77-7f09-453c-b6a1-8ba4f8a75858 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:12.718914 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-83fa669f-3e4e-4869-bbbe-7993c64fc0cb tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: ae65f84b-209e-47a9-b887-5190f803e3ef] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:35:12.721418 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-83fa669f-3e4e-4869-bbbe-7993c64fc0cb tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:12.729218 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-83fa669f-3e4e-4869-bbbe-7993c64fc0cb tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:12.729218 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-83fa669f-3e4e-4869-bbbe-7993c64fc0cb tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: ae65f84b-209e-47a9-b887-5190f803e3ef] instance's host None is down, deleting from database Jul 28 10:35:12.739504 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-bf8bee77-7f09-453c-b6a1-8ba4f8a75858 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:12.739970 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-bf8bee77-7f09-453c-b6a1-8ba4f8a75858 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:12.740428 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-bf8bee77-7f09-453c-b6a1-8ba4f8a75858 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lazy-loading 'fault' on Instance uuid 744bccb9-89b5-4309-a75d-c5faf07eb0a0 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:35:12.741188 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-83fa669f-3e4e-4869-bbbe-7993c64fc0cb tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: ae65f84b-209e-47a9-b887-5190f803e3ef] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:35:12.808360 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-83fa669f-3e4e-4869-bbbe-7993c64fc0cb tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: ae65f84b-209e-47a9-b887-5190f803e3ef] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:35:12.819086 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-83fa669f-3e4e-4869-bbbe-7993c64fc0cb tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: ae65f84b-209e-47a9-b887-5190f803e3ef] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:35:12.871233 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-bf8bee77-7f09-453c-b6a1-8ba4f8a75858 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28dd90a9b204ee78200f89abd27052a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ceba76ab9744e7a0ae4f2438709f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:12.884813 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-bf8bee77-7f09-453c-b6a1-8ba4f8a75858 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] 10.222.0.46 "GET /compute/v2.1/servers/744bccb9-89b5-4309-a75d-c5faf07eb0a0" status: 200 len: 1306 microversion: 2.1 time: 0.279456 Jul 28 10:35:12.885997 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 393/752] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:12 2022] GET /compute/v2.1/servers/744bccb9-89b5-4309-a75d-c5faf07eb0a0 => generated 1306 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:35:12.903722 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d499311f-1e64-4b32-9488-fd2c60e1bd82 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Calling method '.version_select at 0x7fa94b9fe700>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:13.016276 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-d499311f-1e64-4b32-9488-fd2c60e1bd82 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/1f44a7d7-0763-4c7b-85f1-b9b92d7b1980" status: 202 len: 0 microversion: 2.1 time: 0.128449 Jul 28 10:35:13.021649 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 394/753] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Jul 28 10:35:12 2022] DELETE /compute/v2.1/os-volumes/1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:35:13.035741 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ff6ff59b-b49f-4848-885f-8fb75bc59bbe tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] Calling method '.version_select at 0x7fa94b9d8310>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:13.092912 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ff6ff59b-b49f-4848-885f-8fb75bc59bbe tempest-ServersTestManualDisk-1353618979 tempest-ServersTestManualDisk-1353618979-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-269454918" status: 202 len: 0 microversion: 2.1 time: 0.070000 Jul 28 10:35:13.093749 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 395/754] 10.222.0.46 () {58 vars in 1218 bytes} [Thu Jul 28 10:35:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-269454918 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:35:13.106531 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a2f69db7-6440-4c25-b5b0-e6ad671dad30 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:13.107216 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a2f69db7-6440-4c25-b5b0-e6ad671dad30 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: 48eaec93-d976-4eee-834a-6ebbc4250e8c] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:13.124489 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a2f69db7-6440-4c25-b5b0-e6ad671dad30 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:13.124937 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a2f69db7-6440-4c25-b5b0-e6ad671dad30 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:13.128660 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a2f69db7-6440-4c25-b5b0-e6ad671dad30 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:13.129106 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a2f69db7-6440-4c25-b5b0-e6ad671dad30 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:13.192070 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a2f69db7-6440-4c25-b5b0-e6ad671dad30 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:13.192843 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a2f69db7-6440-4c25-b5b0-e6ad671dad30 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:13.193608 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-a2f69db7-6440-4c25-b5b0-e6ad671dad30 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lazy-loading 'fault' on Instance uuid 48eaec93-d976-4eee-834a-6ebbc4250e8c {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:35:13.203131 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-83fa669f-3e4e-4869-bbbe-7993c64fc0cb tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ae65f84b-209e-47a9-b887-5190f803e3ef" status: 204 len: 0 microversion: 2.1 time: 0.722387 Jul 28 10:35:13.204060 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 360/755] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:35:12 2022] DELETE /compute/v2.1/servers/ae65f84b-209e-47a9-b887-5190f803e3ef => generated 0 bytes in 724 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:35:13.209066 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-dadf8438-e28a-4df9-9622-e1fc34125a3d tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:13.218871 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-dadf8438-e28a-4df9-9622-e1fc34125a3d tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 744bccb9-89b5-4309-a75d-c5faf07eb0a0] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:13.237778 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dadf8438-e28a-4df9-9622-e1fc34125a3d tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:13.238318 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dadf8438-e28a-4df9-9622-e1fc34125a3d tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:13.239165 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dadf8438-e28a-4df9-9622-e1fc34125a3d tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:13.239678 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dadf8438-e28a-4df9-9622-e1fc34125a3d tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:13.293952 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-dadf8438-e28a-4df9-9622-e1fc34125a3d tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 744bccb9-89b5-4309-a75d-c5faf07eb0a0] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:35:13.311937 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-a2f69db7-6440-4c25-b5b0-e6ad671dad30 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654c9ee44d245a586f01fcdc20f3deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c8659bbba84bbfb32e446ba294d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:13.321776 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a2f69db7-6440-4c25-b5b0-e6ad671dad30 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "GET /compute/v2.1/servers/48eaec93-d976-4eee-834a-6ebbc4250e8c" status: 200 len: 1289 microversion: 2.1 time: 0.223376 Jul 28 10:35:13.333896 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 396/756] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:13 2022] GET /compute/v2.1/servers/48eaec93-d976-4eee-834a-6ebbc4250e8c => generated 1289 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:35:13.333896 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f4ad3457-2217-4fe9-8726-3f385f1df79a tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Calling method '.version_select at 0x7fa94b9d8280>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:13.427856 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-dadf8438-e28a-4df9-9622-e1fc34125a3d tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 744bccb9-89b5-4309-a75d-c5faf07eb0a0] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:35:13.428676 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dadf8438-e28a-4df9-9622-e1fc34125a3d tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:13.429303 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dadf8438-e28a-4df9-9622-e1fc34125a3d tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:13.429933 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-dadf8438-e28a-4df9-9622-e1fc34125a3d tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 744bccb9-89b5-4309-a75d-c5faf07eb0a0] instance's host None is down, deleting from database Jul 28 10:35:13.434762 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-dadf8438-e28a-4df9-9622-e1fc34125a3d tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 744bccb9-89b5-4309-a75d-c5faf07eb0a0] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:35:13.440206 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f4ad3457-2217-4fe9-8726-3f385f1df79a tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1f44a7d7-0763-4c7b-85f1-b9b92d7b1980" status: 200 len: 344 microversion: 2.1 time: 0.115542 Jul 28 10:35:13.441778 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 397/757] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:35:13 2022] GET /compute/v2.1/os-volumes/1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 => generated 344 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:13.447562 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-3e79cb52-7e8d-4a06-87d8-ec1133100a7f tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:13.448496 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-3e79cb52-7e8d-4a06-87d8-ec1133100a7f tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 171f826d-0eb7-4772-95d4-2ffc1fad43e3] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:13.457119 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3e79cb52-7e8d-4a06-87d8-ec1133100a7f tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:13.457983 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3e79cb52-7e8d-4a06-87d8-ec1133100a7f tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:13.459107 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3e79cb52-7e8d-4a06-87d8-ec1133100a7f tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:13.459860 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3e79cb52-7e8d-4a06-87d8-ec1133100a7f tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:13.499574 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-3e79cb52-7e8d-4a06-87d8-ec1133100a7f tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 171f826d-0eb7-4772-95d4-2ffc1fad43e3] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:35:13.569501 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-3e79cb52-7e8d-4a06-87d8-ec1133100a7f tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 171f826d-0eb7-4772-95d4-2ffc1fad43e3] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:35:13.571967 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3e79cb52-7e8d-4a06-87d8-ec1133100a7f tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:13.572700 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3e79cb52-7e8d-4a06-87d8-ec1133100a7f tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:13.573366 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-3e79cb52-7e8d-4a06-87d8-ec1133100a7f tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 171f826d-0eb7-4772-95d4-2ffc1fad43e3] instance's host None is down, deleting from database Jul 28 10:35:13.578802 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-3e79cb52-7e8d-4a06-87d8-ec1133100a7f tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 171f826d-0eb7-4772-95d4-2ffc1fad43e3] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:35:13.641538 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-3e79cb52-7e8d-4a06-87d8-ec1133100a7f tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 171f826d-0eb7-4772-95d4-2ffc1fad43e3] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:35:13.650297 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-3e79cb52-7e8d-4a06-87d8-ec1133100a7f tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 171f826d-0eb7-4772-95d4-2ffc1fad43e3] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:35:13.812257 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-dadf8438-e28a-4df9-9622-e1fc34125a3d tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 744bccb9-89b5-4309-a75d-c5faf07eb0a0] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:35:13.821781 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-dadf8438-e28a-4df9-9622-e1fc34125a3d tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 744bccb9-89b5-4309-a75d-c5faf07eb0a0] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:35:14.082185 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-3e79cb52-7e8d-4a06-87d8-ec1133100a7f tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] 10.222.0.46 "DELETE /compute/v2.1/servers/171f826d-0eb7-4772-95d4-2ffc1fad43e3" status: 204 len: 0 microversion: 2.1 time: 0.638919 Jul 28 10:35:14.083313 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 398/758] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:35:13 2022] DELETE /compute/v2.1/servers/171f826d-0eb7-4772-95d4-2ffc1fad43e3 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:35:14.094485 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b0172bc4-7a94-489c-86b8-bcdf3a9dd63c tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:14.096957 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b0172bc4-7a94-489c-86b8-bcdf3a9dd63c tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: ae65f84b-209e-47a9-b887-5190f803e3ef] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:14.110762 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b0172bc4-7a94-489c-86b8-bcdf3a9dd63c tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:14.111689 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b0172bc4-7a94-489c-86b8-bcdf3a9dd63c tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:14.112715 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b0172bc4-7a94-489c-86b8-bcdf3a9dd63c tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:14.113382 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b0172bc4-7a94-489c-86b8-bcdf3a9dd63c tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:14.124699 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:UPDATE=34,nova_cell0:DELETE=4,nova_cell0:SELECT=58,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:14.135349 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-dadf8438-e28a-4df9-9622-e1fc34125a3d tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] 10.222.0.46 "DELETE /compute/v2.1/servers/744bccb9-89b5-4309-a75d-c5faf07eb0a0" status: 204 len: 0 microversion: 2.1 time: 0.929830 Jul 28 10:35:14.141984 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 361/759] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:35:13 2022] DELETE /compute/v2.1/servers/744bccb9-89b5-4309-a75d-c5faf07eb0a0 => generated 0 bytes in 932 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:35:14.143429 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-b0172bc4-7a94-489c-86b8-bcdf3a9dd63c tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] HTTP exception thrown: Instance ae65f84b-209e-47a9-b887-5190f803e3ef could not be found. Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b0172bc4-7a94-489c-86b8-bcdf3a9dd63c tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Request method failure captured: Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/ae65f84b-209e-47a9-b887-5190f803e3ef HTTP/1.1 Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mZQI4M74wX697W-chGa1L4dZ25kHDj5b7rpPFrBAZ-BaEBzCg_zafuWsLOtfImL67T0LRREKYcn_6RCxpV7vmFD1Xnuc1GNqo8so8PH0pNhoqvwb7Lm4RFA9ykbbyfFAE1TQ7BufdxiJCK9jIDtAidmAODCB_k-4vRRbvKKjXKQ9o0 Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 012167e98eaf4676b40d031cb86a03ad Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-MultipleCreateTestJSON-445292188 Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/012167e98eaf4676b40d031cb86a03ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/012167e98eaf4676b40d031cb86a03ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/012167e98eaf4676b40d031cb86a03ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_012167e98eaf4676b40d031cb86a03ad", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-MultipleCreateTestJSON-445292188 Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 012167e98eaf4676b40d031cb86a03ad Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-MultipleCreateTestJSON-445292188 Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-MultipleCreateTestJSON-445292188-project Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: e6c5088cf1094c19b300bfcf6a9dd5ae Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-MultipleCreateTestJSON-445292188-project Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance ae65f84b-209e-47a9-b887-5190f803e3ef could not be found. Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'ae65f84b-209e-47a9-b887-5190f803e3ef'} Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae65f84b-209e-47a9-b887-5190f803e3ef could not be found. Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae65f84b-209e-47a9-b887-5190f803e3ef could not be found. Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:14.145540 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:14.155397 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:14.155397 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:14.155397 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:14.155397 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:14.155397 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:14.155397 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae65f84b-209e-47a9-b887-5190f803e3ef could not be found. Jul 28 10:35:14.155397 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:14.158501 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b0172bc4-7a94-489c-86b8-bcdf3a9dd63c tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Returning 404 to user: Instance ae65f84b-209e-47a9-b887-5190f803e3ef could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:14.159561 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b0172bc4-7a94-489c-86b8-bcdf3a9dd63c tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] 10.222.0.46 "GET /compute/v2.1/servers/ae65f84b-209e-47a9-b887-5190f803e3ef" status: 404 len: 111 microversion: 2.1 time: 0.070865 Jul 28 10:35:14.171824 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-422fb085-6137-45f3-b073-5c769dd9e5cc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:14.171824 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-422fb085-6137-45f3-b073-5c769dd9e5cc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: 744bccb9-89b5-4309-a75d-c5faf07eb0a0] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:14.172949 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 399/760] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:14 2022] GET /compute/v2.1/servers/ae65f84b-209e-47a9-b887-5190f803e3ef => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:35:14.181607 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b3e7045b-c3ee-4a45-ab36-8461b3da33ff tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:14.183079 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b3e7045b-c3ee-4a45-ab36-8461b3da33ff tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] [instance: 171f826d-0eb7-4772-95d4-2ffc1fad43e3] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:14.185953 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-422fb085-6137-45f3-b073-5c769dd9e5cc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:14.192142 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b3e7045b-c3ee-4a45-ab36-8461b3da33ff tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:14.192916 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-422fb085-6137-45f3-b073-5c769dd9e5cc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:14.193896 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-422fb085-6137-45f3-b073-5c769dd9e5cc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:14.194598 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b3e7045b-c3ee-4a45-ab36-8461b3da33ff tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:14.196438 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b3e7045b-c3ee-4a45-ab36-8461b3da33ff tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:14.197041 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-422fb085-6137-45f3-b073-5c769dd9e5cc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:14.198432 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b3e7045b-c3ee-4a45-ab36-8461b3da33ff tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:14.229799 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-422fb085-6137-45f3-b073-5c769dd9e5cc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] HTTP exception thrown: Instance 744bccb9-89b5-4309-a75d-c5faf07eb0a0 could not be found. Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-422fb085-6137-45f3-b073-5c769dd9e5cc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Request method failure captured: Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/744bccb9-89b5-4309-a75d-c5faf07eb0a0 HTTP/1.1 Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mYptj_LZLwBL_87lWbKq6S8B7QLX8Lu1BoYegV2iknGz0pD7-au3YafcbfNWI5UjO6dSiBg9cg0UFSSRvaeGx_jRBevxKEt6gVvP5sWy0cU0yIKFXMUPoabtlPb2RRum07gTYLoxC94gQDIX_TkzArEedBfsTl_fKv7TMPVm82tJ9U Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 70ceba76ab9744e7a0ae4f2438709f7d Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-LiveMigrationTest-1443832547 Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/70ceba76ab9744e7a0ae4f2438709f7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/70ceba76ab9744e7a0ae4f2438709f7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/70ceba76ab9744e7a0ae4f2438709f7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_70ceba76ab9744e7a0ae4f2438709f7d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-LiveMigrationTest-1443832547 Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 70ceba76ab9744e7a0ae4f2438709f7d Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-LiveMigrationTest-1443832547 Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-LiveMigrationTest-1443832547-project Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: e28dd90a9b204ee78200f89abd27052a Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-LiveMigrationTest-1443832547-project Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 744bccb9-89b5-4309-a75d-c5faf07eb0a0 could not be found. Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '744bccb9-89b5-4309-a75d-c5faf07eb0a0'} Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 744bccb9-89b5-4309-a75d-c5faf07eb0a0 could not be found. Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 744bccb9-89b5-4309-a75d-c5faf07eb0a0 could not be found. Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:14.235529 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:14.241790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:14.241790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:14.241790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:14.241790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:14.241790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:14.241790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 744bccb9-89b5-4309-a75d-c5faf07eb0a0 could not be found. Jul 28 10:35:14.241790 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:14.241790 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-422fb085-6137-45f3-b073-5c769dd9e5cc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Returning 404 to user: Instance 744bccb9-89b5-4309-a75d-c5faf07eb0a0 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:14.243447 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-422fb085-6137-45f3-b073-5c769dd9e5cc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] 10.222.0.46 "GET /compute/v2.1/servers/744bccb9-89b5-4309-a75d-c5faf07eb0a0" status: 404 len: 111 microversion: 2.1 time: 0.098133 Jul 28 10:35:14.244717 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-b3e7045b-c3ee-4a45-ab36-8461b3da33ff tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] HTTP exception thrown: Instance 171f826d-0eb7-4772-95d4-2ffc1fad43e3 could not be found. Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b3e7045b-c3ee-4a45-ab36-8461b3da33ff tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Request method failure captured: Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/171f826d-0eb7-4772-95d4-2ffc1fad43e3 HTTP/1.1 Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mZQI4M74wX697W-chGa1L4dZ25kHDj5b7rpPFrBAZ-BaEBzCg_zafuWsLOtfImL67T0LRREKYcn_6RCxpV7vmFD1Xnuc1GNqo8so8PH0pNhoqvwb7Lm4RFA9ykbbyfFAE1TQ7BufdxiJCK9jIDtAidmAODCB_k-4vRRbvKKjXKQ9o0 Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 012167e98eaf4676b40d031cb86a03ad Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-MultipleCreateTestJSON-445292188 Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/012167e98eaf4676b40d031cb86a03ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/012167e98eaf4676b40d031cb86a03ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/012167e98eaf4676b40d031cb86a03ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_012167e98eaf4676b40d031cb86a03ad", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-MultipleCreateTestJSON-445292188 Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 012167e98eaf4676b40d031cb86a03ad Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-MultipleCreateTestJSON-445292188 Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-MultipleCreateTestJSON-445292188-project Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: e6c5088cf1094c19b300bfcf6a9dd5ae Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-MultipleCreateTestJSON-445292188-project Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 171f826d-0eb7-4772-95d4-2ffc1fad43e3 could not be found. Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '171f826d-0eb7-4772-95d4-2ffc1fad43e3'} Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 171f826d-0eb7-4772-95d4-2ffc1fad43e3 could not be found. Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 171f826d-0eb7-4772-95d4-2ffc1fad43e3 could not be found. Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:14.246601 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:14.251724 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:14.251724 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:14.251724 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:14.251724 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:14.251724 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:14.251724 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 171f826d-0eb7-4772-95d4-2ffc1fad43e3 could not be found. Jul 28 10:35:14.251724 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:14.252681 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 362/761] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:14 2022] GET /compute/v2.1/servers/744bccb9-89b5-4309-a75d-c5faf07eb0a0 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:14.263814 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b3e7045b-c3ee-4a45-ab36-8461b3da33ff tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] Returning 404 to user: Instance 171f826d-0eb7-4772-95d4-2ffc1fad43e3 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:14.273360 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b3e7045b-c3ee-4a45-ab36-8461b3da33ff tempest-MultipleCreateTestJSON-445292188 tempest-MultipleCreateTestJSON-445292188-project] 10.222.0.46 "GET /compute/v2.1/servers/171f826d-0eb7-4772-95d4-2ffc1fad43e3" status: 404 len: 111 microversion: 2.1 time: 0.098290 Jul 28 10:35:14.281078 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 400/762] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:14 2022] GET /compute/v2.1/servers/171f826d-0eb7-4772-95d4-2ffc1fad43e3 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:14.347891 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b73cc991-96a0-4cf6-a1e4-4f9f12b87cf5 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:14.348803 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b73cc991-96a0-4cf6-a1e4-4f9f12b87cf5 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: 48eaec93-d976-4eee-834a-6ebbc4250e8c] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:14.371046 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b73cc991-96a0-4cf6-a1e4-4f9f12b87cf5 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:14.380241 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b73cc991-96a0-4cf6-a1e4-4f9f12b87cf5 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:14.381391 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b73cc991-96a0-4cf6-a1e4-4f9f12b87cf5 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:14.381978 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b73cc991-96a0-4cf6-a1e4-4f9f12b87cf5 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:14.455157 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4eec2a82-aa57-4a5e-a656-4649b6e98492 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Calling method '.version_select at 0x7fa94b9e7c10>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:14.489457 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b73cc991-96a0-4cf6-a1e4-4f9f12b87cf5 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:14.502258 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b73cc991-96a0-4cf6-a1e4-4f9f12b87cf5 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:14.503335 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-b73cc991-96a0-4cf6-a1e4-4f9f12b87cf5 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lazy-loading 'fault' on Instance uuid 48eaec93-d976-4eee-834a-6ebbc4250e8c {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:35:14.581199 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-4eec2a82-aa57-4a5e-a656-4649b6e98492 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1f44a7d7-0763-4c7b-85f1-b9b92d7b1980" status: 200 len: 344 microversion: 2.1 time: 0.129644 Jul 28 10:35:14.586302 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 401/763] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:35:14 2022] GET /compute/v2.1/os-volumes/1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 => generated 344 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:14.813281 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-b73cc991-96a0-4cf6-a1e4-4f9f12b87cf5 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654c9ee44d245a586f01fcdc20f3deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c8659bbba84bbfb32e446ba294d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:14.829800 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b73cc991-96a0-4cf6-a1e4-4f9f12b87cf5 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "GET /compute/v2.1/servers/48eaec93-d976-4eee-834a-6ebbc4250e8c" status: 200 len: 1289 microversion: 2.1 time: 0.486458 Jul 28 10:35:14.831541 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 363/764] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:14 2022] GET /compute/v2.1/servers/48eaec93-d976-4eee-834a-6ebbc4250e8c => generated 1289 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:35:14.854821 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-982fab30-a9de-4318-a9c4-c4110484f77e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:14.855714 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-982fab30-a9de-4318-a9c4-c4110484f77e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: 48eaec93-d976-4eee-834a-6ebbc4250e8c] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:14.865721 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-982fab30-a9de-4318-a9c4-c4110484f77e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:14.869846 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-982fab30-a9de-4318-a9c4-c4110484f77e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:14.871021 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-982fab30-a9de-4318-a9c4-c4110484f77e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:14.871615 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-982fab30-a9de-4318-a9c4-c4110484f77e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:14.946365 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-982fab30-a9de-4318-a9c4-c4110484f77e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: 48eaec93-d976-4eee-834a-6ebbc4250e8c] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:35:15.038916 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-982fab30-a9de-4318-a9c4-c4110484f77e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: 48eaec93-d976-4eee-834a-6ebbc4250e8c] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:35:15.040418 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-982fab30-a9de-4318-a9c4-c4110484f77e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:15.041181 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-982fab30-a9de-4318-a9c4-c4110484f77e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:15.041897 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-982fab30-a9de-4318-a9c4-c4110484f77e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: 48eaec93-d976-4eee-834a-6ebbc4250e8c] instance's host None is down, deleting from database Jul 28 10:35:15.047636 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-982fab30-a9de-4318-a9c4-c4110484f77e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: 48eaec93-d976-4eee-834a-6ebbc4250e8c] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:35:15.191249 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-982fab30-a9de-4318-a9c4-c4110484f77e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: 48eaec93-d976-4eee-834a-6ebbc4250e8c] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:35:15.200138 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-982fab30-a9de-4318-a9c4-c4110484f77e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: 48eaec93-d976-4eee-834a-6ebbc4250e8c] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:35:15.379514 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=75,nova_cell0:UPDATE=19,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:15.606187 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d83e9abb-a1ba-44ea-806b-a2832d023df8 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Calling method '.version_select at 0x7fa94ba61a60>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:15.735869 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-982fab30-a9de-4318-a9c4-c4110484f77e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "DELETE /compute/v2.1/servers/48eaec93-d976-4eee-834a-6ebbc4250e8c" status: 204 len: 0 microversion: 2.1 time: 0.887894 Jul 28 10:35:15.737793 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 402/765] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:35:14 2022] DELETE /compute/v2.1/servers/48eaec93-d976-4eee-834a-6ebbc4250e8c => generated 0 bytes in 890 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:35:15.742335 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d83e9abb-a1ba-44ea-806b-a2832d023df8 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1f44a7d7-0763-4c7b-85f1-b9b92d7b1980" status: 200 len: 344 microversion: 2.1 time: 0.150186 Jul 28 10:35:15.743743 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 364/766] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:35:15 2022] GET /compute/v2.1/os-volumes/1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:35:15.749324 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-46ac43a7-1cbe-4f16-b001-3b541578dc01 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:15.752136 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-46ac43a7-1cbe-4f16-b001-3b541578dc01 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] [instance: 48eaec93-d976-4eee-834a-6ebbc4250e8c] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:15.763953 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-46ac43a7-1cbe-4f16-b001-3b541578dc01 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:15.764622 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-46ac43a7-1cbe-4f16-b001-3b541578dc01 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:15.767283 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-46ac43a7-1cbe-4f16-b001-3b541578dc01 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:15.769996 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-46ac43a7-1cbe-4f16-b001-3b541578dc01 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:15.824571 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-46ac43a7-1cbe-4f16-b001-3b541578dc01 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] HTTP exception thrown: Instance 48eaec93-d976-4eee-834a-6ebbc4250e8c could not be found. Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-46ac43a7-1cbe-4f16-b001-3b541578dc01 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Request method failure captured: Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/48eaec93-d976-4eee-834a-6ebbc4250e8c HTTP/1.1 Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mY_UmWvwobDpxuDusXuiN2X3phLX9PelsodhuWjeKwRX40vPDz77DGyfctYfO-WofaMuk0eodlXgeEoanzuSgoqD0L1e6dbbmhuN4lfHCBWTqD67dSSkuZfve2sLpg4DOdYZlERCclCFU8tmW6N6gpf-xnNEJ8JDLng7SySEVk-QqM Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: c3c8659bbba84bbfb32e446ba294d81e Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c3c8659bbba84bbfb32e446ba294d81e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: c3c8659bbba84bbfb32e446ba294d81e Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-SecurityGroupsTestJSON-1760984738-project Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: b654c9ee44d245a586f01fcdc20f3deb Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-SecurityGroupsTestJSON-1760984738-project Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 48eaec93-d976-4eee-834a-6ebbc4250e8c could not be found. Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '48eaec93-d976-4eee-834a-6ebbc4250e8c'} Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48eaec93-d976-4eee-834a-6ebbc4250e8c could not be found. Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48eaec93-d976-4eee-834a-6ebbc4250e8c could not be found. Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:15.828764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:15.835219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:15.835219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:15.835219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:15.835219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:15.835219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:15.835219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48eaec93-d976-4eee-834a-6ebbc4250e8c could not be found. Jul 28 10:35:15.835219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:15.835219 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-46ac43a7-1cbe-4f16-b001-3b541578dc01 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Returning 404 to user: Instance 48eaec93-d976-4eee-834a-6ebbc4250e8c could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:15.835219 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-46ac43a7-1cbe-4f16-b001-3b541578dc01 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "GET /compute/v2.1/servers/48eaec93-d976-4eee-834a-6ebbc4250e8c" status: 404 len: 111 microversion: 2.1 time: 0.088407 Jul 28 10:35:15.835219 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 403/767] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:15 2022] GET /compute/v2.1/servers/48eaec93-d976-4eee-834a-6ebbc4250e8c => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:15.846674 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4c11facf-239a-41ac-9a20-e8e8a06afa48 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Action: 'create', calling method: .version_select at 0x7fa94ba07670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1849858915", "description": "tempest-description-1081307442"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:35:16.756590 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f4897214-581e-4aa1-9958-b2052a4964f0 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Calling method '.version_select at 0x7fa94b9e7310>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:17.163845 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-4c11facf-239a-41ac-9a20-e8e8a06afa48 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.323169 Jul 28 10:35:17.165025 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 365/768] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:35:15 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:17.180879 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4cf9b3b1-4df6-4f2b-82e3-758eb56f8f1e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Action: 'update', calling method: .version_select at 0x7fa94ba37f70>, body: {"security_group": {"name": "tempest-sg-hth-95852478", "description": "tempest-description-hth-1538637632"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:35:17.223264 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-f4897214-581e-4aa1-9958-b2052a4964f0 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] HTTP exception thrown: Volume 1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 could not be found. Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f4897214-581e-4aa1-9958-b2052a4964f0 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Request method failure captured: Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-volumes/1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 HTTP/1.1 Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mZUAS6HEZNJMsL-TI_ZHzk-rM_vmMI3By_OK9KnyNmiLapXVVNfu7GdxAKwCeB0i7Au1BD43eAy5JheGXE8C6dj_y1E3b0LTT30JTHnM5tCb2FQ-TUqoi4a7sGBPMIRzpN6fbOD6Vp-M7XipVduQyn-TkSpcHMMm1-0fRL2_FAcyT0 Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: c91816fbea234d25ae14c2b7fcbf769d Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2034448652 Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c91816fbea234d25ae14c2b7fcbf769d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c91816fbea234d25ae14c2b7fcbf769d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c91816fbea234d25ae14c2b7fcbf769d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c91816fbea234d25ae14c2b7fcbf769d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2034448652 Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: c91816fbea234d25ae14c2b7fcbf769d Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2034448652 Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-VolumesSnapshotsTestJSON-2034448652-project Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: c7698475cfb24721a443b015a52af552 Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2034448652-project Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: exception: Volume 1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 could not be found. Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '1f44a7d7-0763-4c7b-85f1-b9b92d7b1980'} Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 could not be found. (HTTP 404) (Request-ID: req-343445db-2f9f-446b-adbe-6b74a3fef929) Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 10:35:17.235914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 could not be found. Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 could not be found. Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 could not be found. Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:17.242117 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f4897214-581e-4aa1-9958-b2052a4964f0 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Returning 404 to user: Volume 1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:17.247933 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f4897214-581e-4aa1-9958-b2052a4964f0 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1f44a7d7-0763-4c7b-85f1-b9b92d7b1980" status: 404 len: 109 microversion: 2.1 time: 0.489125 Jul 28 10:35:17.247933 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 404/769] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:35:16 2022] GET /compute/v2.1/os-volumes/1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 => generated 109 bytes in 491 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:35:17.253654 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-cf6a9e44-de92-4c3a-800f-6e39ce603072 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Calling method '.version_select at 0x7fa94b9feee0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:17.313519 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-cf6a9e44-de92-4c3a-800f-6e39ce603072 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] HTTP exception thrown: Volume 1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 could not be found. Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-cf6a9e44-de92-4c3a-800f-6e39ce603072 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Request method failure captured: Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: request: DELETE /compute/v2.1/os-volumes/1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 HTTP/1.1 Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mZUAS6HEZNJMsL-TI_ZHzk-rM_vmMI3By_OK9KnyNmiLapXVVNfu7GdxAKwCeB0i7Au1BD43eAy5JheGXE8C6dj_y1E3b0LTT30JTHnM5tCb2FQ-TUqoi4a7sGBPMIRzpN6fbOD6Vp-M7XipVduQyn-TkSpcHMMm1-0fRL2_FAcyT0 Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: c91816fbea234d25ae14c2b7fcbf769d Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2034448652 Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c91816fbea234d25ae14c2b7fcbf769d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c91816fbea234d25ae14c2b7fcbf769d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c91816fbea234d25ae14c2b7fcbf769d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c91816fbea234d25ae14c2b7fcbf769d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2034448652 Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: c91816fbea234d25ae14c2b7fcbf769d Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2034448652 Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-VolumesSnapshotsTestJSON-2034448652-project Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: c7698475cfb24721a443b015a52af552 Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2034448652-project Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: exception: Volume 1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 could not be found. Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '1f44a7d7-0763-4c7b-85f1-b9b92d7b1980'} Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 could not be found. (HTTP 404) (Request-ID: req-d1477681-b058-4ee4-895a-1be4fd2a0a61) Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 10:35:17.315969 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 could not be found. Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 could not be found. Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 could not be found. Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-cf6a9e44-de92-4c3a-800f-6e39ce603072 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Returning 404 to user: Volume 1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:17.320211 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-cf6a9e44-de92-4c3a-800f-6e39ce603072 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/1f44a7d7-0763-4c7b-85f1-b9b92d7b1980" status: 404 len: 109 microversion: 2.1 time: 0.070482 Jul 28 10:35:17.326010 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 405/770] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Jul 28 10:35:17 2022] DELETE /compute/v2.1/os-volumes/1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:17.338606 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b159208e-a7dd-471e-84d8-8fb3308df705 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Calling method '.version_select at 0x7fa94b9e7790>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:17.389087 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-b159208e-a7dd-471e-84d8-8fb3308df705 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] HTTP exception thrown: Volume 1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 could not be found. Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b159208e-a7dd-471e-84d8-8fb3308df705 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Request method failure captured: Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-volumes/1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 HTTP/1.1 Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mZUAS6HEZNJMsL-TI_ZHzk-rM_vmMI3By_OK9KnyNmiLapXVVNfu7GdxAKwCeB0i7Au1BD43eAy5JheGXE8C6dj_y1E3b0LTT30JTHnM5tCb2FQ-TUqoi4a7sGBPMIRzpN6fbOD6Vp-M7XipVduQyn-TkSpcHMMm1-0fRL2_FAcyT0 Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: c91816fbea234d25ae14c2b7fcbf769d Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2034448652 Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c91816fbea234d25ae14c2b7fcbf769d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c91816fbea234d25ae14c2b7fcbf769d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c91816fbea234d25ae14c2b7fcbf769d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c91816fbea234d25ae14c2b7fcbf769d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2034448652 Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: c91816fbea234d25ae14c2b7fcbf769d Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2034448652 Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-VolumesSnapshotsTestJSON-2034448652-project Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: c7698475cfb24721a443b015a52af552 Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2034448652-project Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: exception: Volume 1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 could not be found. Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '1f44a7d7-0763-4c7b-85f1-b9b92d7b1980'} Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 could not be found. (HTTP 404) (Request-ID: req-a9774af8-63e1-49ed-a0e8-076092de4c4b) Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 10:35:17.391082 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 could not be found. Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 could not be found. Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 could not be found. Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b159208e-a7dd-471e-84d8-8fb3308df705 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] Returning 404 to user: Volume 1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b159208e-a7dd-471e-84d8-8fb3308df705 tempest-VolumesSnapshotsTestJSON-2034448652 tempest-VolumesSnapshotsTestJSON-2034448652-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1f44a7d7-0763-4c7b-85f1-b9b92d7b1980" status: 404 len: 109 microversion: 2.1 time: 0.067874 Jul 28 10:35:17.397505 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 406/771] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:35:17 2022] GET /compute/v2.1/os-volumes/1f44a7d7-0763-4c7b-85f1-b9b92d7b1980 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:18.232538 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-4cf9b3b1-4df6-4f2b-82e3-758eb56f8f1e tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "PUT /compute/v2.1/os-security-groups/23e64be5-a207-4978-b832-fb4ecdc06d20" status: 200 len: 216 microversion: 2.1 time: 1.058401 Jul 28 10:35:18.233188 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 366/772] 10.222.0.46 () {60 vars in 1290 bytes} [Thu Jul 28 10:35:17 2022] PUT /compute/v2.1/os-security-groups/23e64be5-a207-4978-b832-fb4ecdc06d20 => generated 216 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:35:18.249735 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-21ba64be-c67a-4289-a0c6-7b342982d966 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '.version_select at 0x7fa94bb2b0d0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:19.404508 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-21ba64be-c67a-4289-a0c6-7b342982d966 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/23e64be5-a207-4978-b832-fb4ecdc06d20" status: 200 len: 216 microversion: 2.1 time: 1.159346 Jul 28 10:35:19.405191 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 407/773] 10.222.0.46 () {58 vars in 1269 bytes} [Thu Jul 28 10:35:18 2022] GET /compute/v2.1/os-security-groups/23e64be5-a207-4978-b832-fb4ecdc06d20 => generated 216 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:19.422904 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-cdc6f5b5-ad07-4a6a-a98e-05df21224ccd tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '.version_select at 0x7fa94ba07e50>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:20.451350 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-cdc6f5b5-ad07-4a6a-a98e-05df21224ccd tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/23e64be5-a207-4978-b832-fb4ecdc06d20" status: 202 len: 0 microversion: 2.1 time: 1.033229 Jul 28 10:35:20.460677 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 367/774] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:35:19 2022] DELETE /compute/v2.1/os-security-groups/23e64be5-a207-4978-b832-fb4ecdc06d20 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:35:20.467286 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9dcf89f8-c600-4abb-8cdd-76ac1156f0c9 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '.version_select at 0x7fa94b9e7310>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:22.411383 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:22.446545 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=14 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:23.607295 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:23.608455 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=7 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:23.728245 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9dcf89f8-c600-4abb-8cdd-76ac1156f0c9 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/c6338dab-3f46-4fba-ab7b-6d25893bae77" status: 202 len: 0 microversion: 2.1 time: 3.269155 Jul 28 10:35:23.731345 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 408/775] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:35:20 2022] DELETE /compute/v2.1/os-security-groups/c6338dab-3f46-4fba-ab7b-6d25893bae77 => generated 0 bytes in 3275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:35:23.747638 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7531c695-edd9-46d3-ac45-d56480097b0a tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '.version_select at 0x7fa94b9e7160>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:23.847249 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1873057083", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "f914f368-72d2-4a97-a2ea-c56989154bea"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:35:23.947151 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] validate_networks() for [('f914f368-72d2-4a97-a2ea-c56989154bea', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:35:24.828245 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:UPDATE=3,nova_cell0:DELETE=2,nova_cell0:SELECT=10 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:24.959963 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:35:24.960654 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:35:24.962595 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:35:24.963273 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:35:24.964218 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:35:24.978705 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:24.979731 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:24.981006 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:24.981659 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:25.016119 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Getting quotas for project 6ec3ffdc362b4d61b65d798f9b3c193a. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:35:25.026180 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Getting quotas for user a9df268b1a6e410384274d5579d308ba and project 6ec3ffdc362b4d61b65d798f9b3c193a. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:35:25.047684 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:35:25.051058 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: c0a47e91-3e30-449e-84ef-904cdd1d2989] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:35:25.133931 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ce5682fe-8ea3-4c9c-b790-7e617c36377f tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.532781 Jul 28 10:35:25.135729 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 368/776] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:35:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:35:25.149112 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a1a1a7d0-0265-47ed-9d7f-42fb7e797016 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:25.152302 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-a1a1a7d0-0265-47ed-9d7f-42fb7e797016 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: c0a47e91-3e30-449e-84ef-904cdd1d2989] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:25.284170 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-a1a1a7d0-0265-47ed-9d7f-42fb7e797016 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9df268b1a6e410384274d5579d308ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec3ffdc362b4d61b65d798f9b3c193a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:25.294187 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a1a1a7d0-0265-47ed-9d7f-42fb7e797016 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "GET /compute/v2.1/servers/c0a47e91-3e30-449e-84ef-904cdd1d2989" status: 200 len: 1193 microversion: 2.1 time: 0.150674 Jul 28 10:35:25.298669 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 369/777] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:25 2022] GET /compute/v2.1/servers/c0a47e91-3e30-449e-84ef-904cdd1d2989 => generated 1193 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:35:25.762521 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=9,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:25.824290 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=11,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:26.033641 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7531c695-edd9-46d3-ac45-d56480097b0a tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/b94953e7-0673-4529-be5a-a12364c43757" status: 202 len: 0 microversion: 2.1 time: 2.292182 Jul 28 10:35:26.039870 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 409/778] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:35:23 2022] DELETE /compute/v2.1/os-security-groups/b94953e7-0673-4529-be5a-a12364c43757 => generated 0 bytes in 2304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:35:26.044897 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-eb1a0da7-667b-464f-8517-18f13f21c50a tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '.version_select at 0x7fa94bbf3820>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:26.208294 n-d-850468-6 devstack@n-api.service[119463]: DEBUG neutronclient.v2_0.client [None req-eb1a0da7-667b-464f-8517-18f13f21c50a tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 46b77589-584d-43f7-a576-9947358ae992 does not exist", "detail": ""}} {{(pid=119463) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 10:35:26.208910 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.security_group_api [None req-eb1a0da7-667b-464f-8517-18f13f21c50a tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Neutron security group 46b77589-584d-43f7-a576-9947358ae992 not found {{(pid=119463) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 10:35:26.209473 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-eb1a0da7-667b-464f-8517-18f13f21c50a tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] HTTP exception thrown: Security group 46b77589-584d-43f7-a576-9947358ae992 does not exist Jul 28 10:35:26.209473 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-62317036-c351-409a-b169-8cdbdfd0a178'] Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-eb1a0da7-667b-464f-8517-18f13f21c50a tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Request method failure captured: Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: request: DELETE /compute/v2.1/os-security-groups/46b77589-584d-43f7-a576-9947358ae992 HTTP/1.1 Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mY_UmWvwobDpxuDusXuiN2X3phLX9PelsodhuWjeKwRX40vPDz77DGyfctYfO-WofaMuk0eodlXgeEoanzuSgoqD0L1e6dbbmhuN4lfHCBWTqD67dSSkuZfve2sLpg4DOdYZlERCclCFU8tmW6N6gpf-xnNEJ8JDLng7SySEVk-QqM Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: c3c8659bbba84bbfb32e446ba294d81e Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c3c8659bbba84bbfb32e446ba294d81e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: c3c8659bbba84bbfb32e446ba294d81e Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-SecurityGroupsTestJSON-1760984738-project Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: b654c9ee44d245a586f01fcdc20f3deb Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-SecurityGroupsTestJSON-1760984738-project Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: exception: Security group 46b77589-584d-43f7-a576-9947358ae992 does not exist Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-62317036-c351-409a-b169-8cdbdfd0a178'] Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '46b77589-584d-43f7-a576-9947358ae992'} Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 10:35:26.212268 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 46b77589-584d-43f7-a576-9947358ae992 does not exist Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62317036-c351-409a-b169-8cdbdfd0a178'] Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 46b77589-584d-43f7-a576-9947358ae992 does not exist Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62317036-c351-409a-b169-8cdbdfd0a178'] Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 46b77589-584d-43f7-a576-9947358ae992 does not exist Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62317036-c351-409a-b169-8cdbdfd0a178'] Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 46b77589-584d-43f7-a576-9947358ae992 does not exist Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62317036-c351-409a-b169-8cdbdfd0a178'] Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-eb1a0da7-667b-464f-8517-18f13f21c50a tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Returning 404 to user: Security group 46b77589-584d-43f7-a576-9947358ae992 does not exist Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-62317036-c351-409a-b169-8cdbdfd0a178'] {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-eb1a0da7-667b-464f-8517-18f13f21c50a tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/46b77589-584d-43f7-a576-9947358ae992" status: 404 len: 194 microversion: 2.1 time: 0.174757 Jul 28 10:35:26.219625 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 370/779] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:35:26 2022] DELETE /compute/v2.1/os-security-groups/46b77589-584d-43f7-a576-9947358ae992 => generated 194 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:35:26.231655 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8bc5e5f7-d955-4fba-9b8e-0952beaa6699 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '.version_select at 0x7fa94ba3bd30>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:26.266762 n-d-850468-6 devstack@n-api.service[119463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:35:26.266959 n-d-850468-6 devstack@n-api.service[119463]: Thu Jul 28 10:35:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 10:35:26.326418 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-cc28482f-8d43-4306-a904-e1e7c92c15f0 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:26.327522 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-cc28482f-8d43-4306-a904-e1e7c92c15f0 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: c0a47e91-3e30-449e-84ef-904cdd1d2989] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:26.347427 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cc28482f-8d43-4306-a904-e1e7c92c15f0 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:26.348375 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cc28482f-8d43-4306-a904-e1e7c92c15f0 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:26.349423 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cc28482f-8d43-4306-a904-e1e7c92c15f0 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:26.354338 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cc28482f-8d43-4306-a904-e1e7c92c15f0 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:26.464182 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cc28482f-8d43-4306-a904-e1e7c92c15f0 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:26.465434 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cc28482f-8d43-4306-a904-e1e7c92c15f0 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:26.466169 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-cc28482f-8d43-4306-a904-e1e7c92c15f0 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lazy-loading 'fault' on Instance uuid c0a47e91-3e30-449e-84ef-904cdd1d2989 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:35:26.557145 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-cc28482f-8d43-4306-a904-e1e7c92c15f0 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9df268b1a6e410384274d5579d308ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec3ffdc362b4d61b65d798f9b3c193a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:26.575932 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-cc28482f-8d43-4306-a904-e1e7c92c15f0 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "GET /compute/v2.1/servers/c0a47e91-3e30-449e-84ef-904cdd1d2989" status: 200 len: 1266 microversion: 2.1 time: 0.256501 Jul 28 10:35:26.576562 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 371/780] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:26 2022] GET /compute/v2.1/servers/c0a47e91-3e30-449e-84ef-904cdd1d2989 => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:35:26.599656 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c664cd06-a7dc-41d0-97dd-d00853495c1e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:26.600319 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c664cd06-a7dc-41d0-97dd-d00853495c1e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: c0a47e91-3e30-449e-84ef-904cdd1d2989] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:26.618088 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c664cd06-a7dc-41d0-97dd-d00853495c1e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:26.619179 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c664cd06-a7dc-41d0-97dd-d00853495c1e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:26.622573 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c664cd06-a7dc-41d0-97dd-d00853495c1e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:26.623333 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c664cd06-a7dc-41d0-97dd-d00853495c1e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:26.660986 n-d-850468-6 devstack@n-api.service[119464]: DEBUG neutronclient.v2_0.client [None req-8bc5e5f7-d955-4fba-9b8e-0952beaa6699 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fce40580-34ea-4436-8547-018672deea3f does not exist", "detail": ""}} {{(pid=119464) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 10:35:26.663767 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.security_group_api [None req-8bc5e5f7-d955-4fba-9b8e-0952beaa6699 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Neutron security group fce40580-34ea-4436-8547-018672deea3f not found {{(pid=119464) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 10:35:26.669933 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-8bc5e5f7-d955-4fba-9b8e-0952beaa6699 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] HTTP exception thrown: Security group fce40580-34ea-4436-8547-018672deea3f does not exist Jul 28 10:35:26.669933 n-d-850468-6 devstack@n-api.service[119464]: Neutron server returns request_ids: ['req-02ab9ee2-9fc3-499b-bdf0-631c1334855f'] Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8bc5e5f7-d955-4fba-9b8e-0952beaa6699 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Request method failure captured: Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: request: DELETE /compute/v2.1/os-security-groups/fce40580-34ea-4436-8547-018672deea3f HTTP/1.1 Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mY_UmWvwobDpxuDusXuiN2X3phLX9PelsodhuWjeKwRX40vPDz77DGyfctYfO-WofaMuk0eodlXgeEoanzuSgoqD0L1e6dbbmhuN4lfHCBWTqD67dSSkuZfve2sLpg4DOdYZlERCclCFU8tmW6N6gpf-xnNEJ8JDLng7SySEVk-QqM Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: c3c8659bbba84bbfb32e446ba294d81e Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c3c8659bbba84bbfb32e446ba294d81e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: c3c8659bbba84bbfb32e446ba294d81e Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-SecurityGroupsTestJSON-1760984738-project Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: b654c9ee44d245a586f01fcdc20f3deb Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-SecurityGroupsTestJSON-1760984738-project Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: exception: Security group fce40580-34ea-4436-8547-018672deea3f does not exist Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: Neutron server returns request_ids: ['req-02ab9ee2-9fc3-499b-bdf0-631c1334855f'] Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'fce40580-34ea-4436-8547-018672deea3f'} Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 10:35:26.673604 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fce40580-34ea-4436-8547-018672deea3f does not exist Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02ab9ee2-9fc3-499b-bdf0-631c1334855f'] Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fce40580-34ea-4436-8547-018672deea3f does not exist Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02ab9ee2-9fc3-499b-bdf0-631c1334855f'] Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fce40580-34ea-4436-8547-018672deea3f does not exist Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02ab9ee2-9fc3-499b-bdf0-631c1334855f'] Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fce40580-34ea-4436-8547-018672deea3f does not exist Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02ab9ee2-9fc3-499b-bdf0-631c1334855f'] Jul 28 10:35:26.677696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:26.686036 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8bc5e5f7-d955-4fba-9b8e-0952beaa6699 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Returning 404 to user: Security group fce40580-34ea-4436-8547-018672deea3f does not exist Jul 28 10:35:26.686036 n-d-850468-6 devstack@n-api.service[119464]: Neutron server returns request_ids: ['req-02ab9ee2-9fc3-499b-bdf0-631c1334855f'] {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:26.687094 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-8bc5e5f7-d955-4fba-9b8e-0952beaa6699 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/fce40580-34ea-4436-8547-018672deea3f" status: 404 len: 194 microversion: 2.1 time: 0.461481 Jul 28 10:35:26.692409 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 410/781] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:35:26 2022] DELETE /compute/v2.1/os-security-groups/fce40580-34ea-4436-8547-018672deea3f => generated 194 bytes in 467 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:26.698945 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c664cd06-a7dc-41d0-97dd-d00853495c1e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: c0a47e91-3e30-449e-84ef-904cdd1d2989] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:35:26.707582 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8fb9a523-6447-4f49-a646-d256ff308260 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '.version_select at 0x7fa94b99f940>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:26.836522 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c664cd06-a7dc-41d0-97dd-d00853495c1e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: c0a47e91-3e30-449e-84ef-904cdd1d2989] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:35:26.837785 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c664cd06-a7dc-41d0-97dd-d00853495c1e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:26.838592 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c664cd06-a7dc-41d0-97dd-d00853495c1e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:26.840488 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-c664cd06-a7dc-41d0-97dd-d00853495c1e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: c0a47e91-3e30-449e-84ef-904cdd1d2989] instance's host None is down, deleting from database Jul 28 10:35:26.849006 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-c664cd06-a7dc-41d0-97dd-d00853495c1e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: c0a47e91-3e30-449e-84ef-904cdd1d2989] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:35:26.904872 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-c664cd06-a7dc-41d0-97dd-d00853495c1e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: c0a47e91-3e30-449e-84ef-904cdd1d2989] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:35:26.912302 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-c664cd06-a7dc-41d0-97dd-d00853495c1e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: c0a47e91-3e30-449e-84ef-904cdd1d2989] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:35:27.707039 n-d-850468-6 devstack@n-api.service[119464]: DEBUG neutronclient.v2_0.client [None req-8fb9a523-6447-4f49-a646-d256ff308260 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1d6114e0-446f-4e1d-9490-8b6a70b175ec does not exist", "detail": ""}} {{(pid=119464) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 10:35:27.707973 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.security_group_api [None req-8fb9a523-6447-4f49-a646-d256ff308260 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Neutron security group 1d6114e0-446f-4e1d-9490-8b6a70b175ec not found {{(pid=119464) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 10:35:27.708618 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-8fb9a523-6447-4f49-a646-d256ff308260 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] HTTP exception thrown: Security group 1d6114e0-446f-4e1d-9490-8b6a70b175ec does not exist Jul 28 10:35:27.708618 n-d-850468-6 devstack@n-api.service[119464]: Neutron server returns request_ids: ['req-713bfa76-30e3-4cb4-ae09-89d29f6abbe9'] Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8fb9a523-6447-4f49-a646-d256ff308260 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Request method failure captured: Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: request: DELETE /compute/v2.1/os-security-groups/1d6114e0-446f-4e1d-9490-8b6a70b175ec HTTP/1.1 Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mY_UmWvwobDpxuDusXuiN2X3phLX9PelsodhuWjeKwRX40vPDz77DGyfctYfO-WofaMuk0eodlXgeEoanzuSgoqD0L1e6dbbmhuN4lfHCBWTqD67dSSkuZfve2sLpg4DOdYZlERCclCFU8tmW6N6gpf-xnNEJ8JDLng7SySEVk-QqM Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: c3c8659bbba84bbfb32e446ba294d81e Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c3c8659bbba84bbfb32e446ba294d81e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: c3c8659bbba84bbfb32e446ba294d81e Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-SecurityGroupsTestJSON-1760984738-project Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: b654c9ee44d245a586f01fcdc20f3deb Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-SecurityGroupsTestJSON-1760984738-project Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: exception: Security group 1d6114e0-446f-4e1d-9490-8b6a70b175ec does not exist Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: Neutron server returns request_ids: ['req-713bfa76-30e3-4cb4-ae09-89d29f6abbe9'] Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '1d6114e0-446f-4e1d-9490-8b6a70b175ec'} Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 10:35:27.711939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1d6114e0-446f-4e1d-9490-8b6a70b175ec does not exist Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-713bfa76-30e3-4cb4-ae09-89d29f6abbe9'] Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1d6114e0-446f-4e1d-9490-8b6a70b175ec does not exist Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-713bfa76-30e3-4cb4-ae09-89d29f6abbe9'] Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1d6114e0-446f-4e1d-9490-8b6a70b175ec does not exist Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-713bfa76-30e3-4cb4-ae09-89d29f6abbe9'] Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1d6114e0-446f-4e1d-9490-8b6a70b175ec does not exist Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-713bfa76-30e3-4cb4-ae09-89d29f6abbe9'] Jul 28 10:35:27.715799 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:27.720149 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8fb9a523-6447-4f49-a646-d256ff308260 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Returning 404 to user: Security group 1d6114e0-446f-4e1d-9490-8b6a70b175ec does not exist Jul 28 10:35:27.720149 n-d-850468-6 devstack@n-api.service[119464]: Neutron server returns request_ids: ['req-713bfa76-30e3-4cb4-ae09-89d29f6abbe9'] {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:27.721658 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-8fb9a523-6447-4f49-a646-d256ff308260 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/1d6114e0-446f-4e1d-9490-8b6a70b175ec" status: 404 len: 194 microversion: 2.1 time: 1.027923 Jul 28 10:35:27.723123 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 411/782] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:35:26 2022] DELETE /compute/v2.1/os-security-groups/1d6114e0-446f-4e1d-9490-8b6a70b175ec => generated 194 bytes in 1030 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:27.734883 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7b0672a0-9e2c-4462-8404-d47060314706 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '.version_select at 0x7fa94ba3bca0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:27.779854 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c664cd06-a7dc-41d0-97dd-d00853495c1e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c0a47e91-3e30-449e-84ef-904cdd1d2989" status: 204 len: 0 microversion: 2.1 time: 1.184945 Jul 28 10:35:27.782824 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 372/783] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:35:26 2022] DELETE /compute/v2.1/servers/c0a47e91-3e30-449e-84ef-904cdd1d2989 => generated 0 bytes in 1190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 10:35:27.798250 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-11cadf35-8182-4545-9a59-e477ac2d3577 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:27.799169 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-11cadf35-8182-4545-9a59-e477ac2d3577 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: c0a47e91-3e30-449e-84ef-904cdd1d2989] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:27.809380 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-11cadf35-8182-4545-9a59-e477ac2d3577 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:27.810183 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-11cadf35-8182-4545-9a59-e477ac2d3577 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:27.811140 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-11cadf35-8182-4545-9a59-e477ac2d3577 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:27.811926 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-11cadf35-8182-4545-9a59-e477ac2d3577 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:27.847666 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-11cadf35-8182-4545-9a59-e477ac2d3577 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] HTTP exception thrown: Instance c0a47e91-3e30-449e-84ef-904cdd1d2989 could not be found. Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-11cadf35-8182-4545-9a59-e477ac2d3577 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Request method failure captured: Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/c0a47e91-3e30-449e-84ef-904cdd1d2989 HTTP/1.1 Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mZrFmv2tqSUvHHnTW6nUkrh4a1Lvl-EAPcffnboG81pceusXzXvguP1TXNMzJ-geIacOU4Vh2mo89ih0CivhAPQF9ZkO--5bCOq-J3szB0ROBtIC_dJAZtqIX15RqdJDTf_dIKPZAowmrkWSA_PpmAtc-dsPxA1jeeiQddLUQoBJqY Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 6ec3ffdc362b4d61b65d798f9b3c193a Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServersTestJSON-1602693956 Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6ec3ffdc362b4d61b65d798f9b3c193a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServersTestJSON-1602693956 Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 6ec3ffdc362b4d61b65d798f9b3c193a Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServersTestJSON-1602693956 Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServersTestJSON-1602693956-project Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: a9df268b1a6e410384274d5579d308ba Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServersTestJSON-1602693956-project Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance c0a47e91-3e30-449e-84ef-904cdd1d2989 could not be found. Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'c0a47e91-3e30-449e-84ef-904cdd1d2989'} Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0a47e91-3e30-449e-84ef-904cdd1d2989 could not be found. Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0a47e91-3e30-449e-84ef-904cdd1d2989 could not be found. Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:27.850631 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:27.856539 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:27.856539 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:27.856539 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:27.856539 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:27.856539 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0a47e91-3e30-449e-84ef-904cdd1d2989 could not be found. Jul 28 10:35:27.856539 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:27.858468 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-11cadf35-8182-4545-9a59-e477ac2d3577 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Returning 404 to user: Instance c0a47e91-3e30-449e-84ef-904cdd1d2989 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:27.859757 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-11cadf35-8182-4545-9a59-e477ac2d3577 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "GET /compute/v2.1/servers/c0a47e91-3e30-449e-84ef-904cdd1d2989" status: 404 len: 111 microversion: 2.1 time: 0.072159 Jul 28 10:35:27.862714 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 373/784] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:27 2022] GET /compute/v2.1/servers/c0a47e91-3e30-449e-84ef-904cdd1d2989 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:27.904164 n-d-850468-6 devstack@n-api.service[119464]: DEBUG neutronclient.v2_0.client [None req-7b0672a0-9e2c-4462-8404-d47060314706 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c3de6c92-8f7c-4f0d-8648-7eca5eee9fad does not exist", "detail": ""}} {{(pid=119464) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 10:35:27.905084 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.security_group_api [None req-7b0672a0-9e2c-4462-8404-d47060314706 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Neutron security group c3de6c92-8f7c-4f0d-8648-7eca5eee9fad not found {{(pid=119464) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 10:35:27.906202 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-7b0672a0-9e2c-4462-8404-d47060314706 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] HTTP exception thrown: Security group c3de6c92-8f7c-4f0d-8648-7eca5eee9fad does not exist Jul 28 10:35:27.906202 n-d-850468-6 devstack@n-api.service[119464]: Neutron server returns request_ids: ['req-a64aee83-3c69-45c3-a470-ac5681ac84c3'] Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7b0672a0-9e2c-4462-8404-d47060314706 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Request method failure captured: Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: request: DELETE /compute/v2.1/os-security-groups/c3de6c92-8f7c-4f0d-8648-7eca5eee9fad HTTP/1.1 Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mY_UmWvwobDpxuDusXuiN2X3phLX9PelsodhuWjeKwRX40vPDz77DGyfctYfO-WofaMuk0eodlXgeEoanzuSgoqD0L1e6dbbmhuN4lfHCBWTqD67dSSkuZfve2sLpg4DOdYZlERCclCFU8tmW6N6gpf-xnNEJ8JDLng7SySEVk-QqM Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: c3c8659bbba84bbfb32e446ba294d81e Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3c8659bbba84bbfb32e446ba294d81e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c3c8659bbba84bbfb32e446ba294d81e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: c3c8659bbba84bbfb32e446ba294d81e Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1760984738 Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-SecurityGroupsTestJSON-1760984738-project Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: b654c9ee44d245a586f01fcdc20f3deb Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-SecurityGroupsTestJSON-1760984738-project Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: exception: Security group c3de6c92-8f7c-4f0d-8648-7eca5eee9fad does not exist Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: Neutron server returns request_ids: ['req-a64aee83-3c69-45c3-a470-ac5681ac84c3'] Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'c3de6c92-8f7c-4f0d-8648-7eca5eee9fad'} Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 10:35:27.908784 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c3de6c92-8f7c-4f0d-8648-7eca5eee9fad does not exist Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a64aee83-3c69-45c3-a470-ac5681ac84c3'] Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c3de6c92-8f7c-4f0d-8648-7eca5eee9fad does not exist Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a64aee83-3c69-45c3-a470-ac5681ac84c3'] Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c3de6c92-8f7c-4f0d-8648-7eca5eee9fad does not exist Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a64aee83-3c69-45c3-a470-ac5681ac84c3'] Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c3de6c92-8f7c-4f0d-8648-7eca5eee9fad does not exist Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a64aee83-3c69-45c3-a470-ac5681ac84c3'] Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7b0672a0-9e2c-4462-8404-d47060314706 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Returning 404 to user: Security group c3de6c92-8f7c-4f0d-8648-7eca5eee9fad does not exist Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: Neutron server returns request_ids: ['req-a64aee83-3c69-45c3-a470-ac5681ac84c3'] {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7b0672a0-9e2c-4462-8404-d47060314706 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/c3de6c92-8f7c-4f0d-8648-7eca5eee9fad" status: 404 len: 194 microversion: 2.1 time: 0.182901 Jul 28 10:35:27.912868 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 412/785] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:35:27 2022] DELETE /compute/v2.1/os-security-groups/c3de6c92-8f7c-4f0d-8648-7eca5eee9fad => generated 194 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:27.924754 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6bf383dd-a415-44bb-a1a5-19e88dbf318d tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '.version_select at 0x7fa94bbf3430>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:28.086876 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-450377482", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:35:28.224041 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] validate_networks() for [('f914f368-72d2-4a97-a2ea-c56989154bea', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:35:28.560421 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6bf383dd-a415-44bb-a1a5-19e88dbf318d tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/4d14d1e3-b00a-4df5-8a4b-a9454a435c4b" status: 202 len: 0 microversion: 2.1 time: 0.640698 Jul 28 10:35:28.561098 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 374/786] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:35:27 2022] DELETE /compute/v2.1/os-security-groups/4d14d1e3-b00a-4df5-8a4b-a9454a435c4b => generated 0 bytes in 642 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:35:28.572161 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-98e73db4-32f4-4266-9fd4-54a9072b8711 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] Calling method '.version_select at 0x7fa94ba07670>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:29.255931 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-98e73db4-32f4-4266-9fd4-54a9072b8711 tempest-SecurityGroupsTestJSON-1760984738 tempest-SecurityGroupsTestJSON-1760984738-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/a362a85d-95c5-4f59-b785-e17d4c9861d6" status: 202 len: 0 microversion: 2.1 time: 0.690490 Jul 28 10:35:29.256911 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 375/787] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:35:28 2022] DELETE /compute/v2.1/os-security-groups/a362a85d-95c5-4f59-b785-e17d4c9861d6 => generated 0 bytes in 692 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:35:31.774587 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:35:31.775176 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:35:31.776063 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:35:31.778204 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:35:31.779346 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:35:31.816244 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:31.817220 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:31.818482 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:31.819126 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:31.863565 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Getting quotas for project 6ec3ffdc362b4d61b65d798f9b3c193a. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:35:31.878923 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Getting quotas for user a9df268b1a6e410384274d5579d308ba and project 6ec3ffdc362b4d61b65d798f9b3c193a. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:35:31.907668 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:35:31.918989 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:35:32.029925 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-72eda685-4d47-4b87-a2e8-319a93fd9843 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.948278 Jul 28 10:35:32.032579 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 413/788] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:35:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 10:35:32.049320 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-20f0ab15-2483-4472-aa5e-ca1d3949b5e4 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:32.049960 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-20f0ab15-2483-4472-aa5e-ca1d3949b5e4 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:32.139006 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-20f0ab15-2483-4472-aa5e-ca1d3949b5e4 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:35:32.212815 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:32.381543 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-20f0ab15-2483-4472-aa5e-ca1d3949b5e4 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0b97959b-8e7d-4e35-8a95-e11eb27b5aa0" status: 204 len: 0 microversion: 2.1 time: 0.340955 Jul 28 10:35:32.383939 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 376/789] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:35:32 2022] DELETE /compute/v2.1/servers/0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:35:32.392621 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7b9fa421-cb7b-4c62-8e12-d869cef4244c tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:32.393410 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-7b9fa421-cb7b-4c62-8e12-d869cef4244c tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:32.441656 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-7b9fa421-cb7b-4c62-8e12-d869cef4244c tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] HTTP exception thrown: Instance 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 could not be found. Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7b9fa421-cb7b-4c62-8e12-d869cef4244c tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Request method failure captured: Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 HTTP/1.1 Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mZrFmv2tqSUvHHnTW6nUkrh4a1Lvl-EAPcffnboG81pceusXzXvguP1TXNMzJ-geIacOU4Vh2mo89ih0CivhAPQF9ZkO--5bCOq-J3szB0ROBtIC_dJAZtqIX15RqdJDTf_dIKPZAowmrkWSA_PpmAtc-dsPxA1jeeiQddLUQoBJqY Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 6ec3ffdc362b4d61b65d798f9b3c193a Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ServersTestJSON-1602693956 Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6ec3ffdc362b4d61b65d798f9b3c193a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ServersTestJSON-1602693956 Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 6ec3ffdc362b4d61b65d798f9b3c193a Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ServersTestJSON-1602693956 Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ServersTestJSON-1602693956-project Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: a9df268b1a6e410384274d5579d308ba Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ServersTestJSON-1602693956-project Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 could not be found. Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '0b97959b-8e7d-4e35-8a95-e11eb27b5aa0'} Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2892, in _get_instance Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 could not be found. Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:32.458456 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:32.465001 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:32.465001 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:32.465001 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:32.465001 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:32.465001 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:35:32.465001 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:35:32.465001 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:35:32.465001 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:35:32.465001 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:35:32.465001 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:35:32.465001 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 could not be found. Jul 28 10:35:32.465001 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:32.465001 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:32.465001 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:32.465001 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:32.465001 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:32.465001 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:32.465001 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:32.465001 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:32.465001 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 could not be found. Jul 28 10:35:32.465001 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:32.465001 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7b9fa421-cb7b-4c62-8e12-d869cef4244c tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Returning 404 to user: Instance 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:32.468327 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7b9fa421-cb7b-4c62-8e12-d869cef4244c tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "GET /compute/v2.1/servers/0b97959b-8e7d-4e35-8a95-e11eb27b5aa0" status: 404 len: 111 microversion: 2.1 time: 0.078691 Jul 28 10:35:32.482923 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 414/790] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:32 2022] GET /compute/v2.1/servers/0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:32.721410 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1412062931", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "f914f368-72d2-4a97-a2ea-c56989154bea"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:35:32.906741 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] validate_networks() for [('f914f368-72d2-4a97-a2ea-c56989154bea', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:35:34.855824 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:35:34.857634 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:35:34.858976 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:35:34.862162 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:35:34.863087 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:35:34.892264 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:34.893274 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:34.894521 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:34.897164 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:34.963528 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Getting quotas for project 6ec3ffdc362b4d61b65d798f9b3c193a. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:35:34.985261 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Getting quotas for user a9df268b1a6e410384274d5579d308ba and project 6ec3ffdc362b4d61b65d798f9b3c193a. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:35:35.035335 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:35:35.059639 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:35:35.244322 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3b66ad5e-98e7-4452-b69e-b4e669983821 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.527725 Jul 28 10:35:35.255678 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 377/791] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:35:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:35:35.259044 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-13c3cc4e-06d3-45c6-9a50-486d2a363650 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:35.259850 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-13c3cc4e-06d3-45c6-9a50-486d2a363650 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:35.655158 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-13c3cc4e-06d3-45c6-9a50-486d2a363650 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9df268b1a6e410384274d5579d308ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec3ffdc362b4d61b65d798f9b3c193a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:35.687795 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-13c3cc4e-06d3-45c6-9a50-486d2a363650 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "GET /compute/v2.1/servers/05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9" status: 200 len: 1221 microversion: 2.1 time: 0.425132 Jul 28 10:35:35.691528 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 415/792] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:35 2022] GET /compute/v2.1/servers/05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9 => generated 1221 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:35:36.717444 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4f851ff6-63d1-45fe-8e00-d4d7a87e82cc tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:36.718506 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-4f851ff6-63d1-45fe-8e00-d4d7a87e82cc tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:36.739375 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4f851ff6-63d1-45fe-8e00-d4d7a87e82cc tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:36.739836 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4f851ff6-63d1-45fe-8e00-d4d7a87e82cc tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:36.740637 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4f851ff6-63d1-45fe-8e00-d4d7a87e82cc tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:36.741072 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4f851ff6-63d1-45fe-8e00-d4d7a87e82cc tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:36.844817 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4f851ff6-63d1-45fe-8e00-d4d7a87e82cc tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:36.845333 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4f851ff6-63d1-45fe-8e00-d4d7a87e82cc tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:36.845835 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-4f851ff6-63d1-45fe-8e00-d4d7a87e82cc tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lazy-loading 'fault' on Instance uuid 05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:35:37.339302 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-4f851ff6-63d1-45fe-8e00-d4d7a87e82cc tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9df268b1a6e410384274d5579d308ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec3ffdc362b4d61b65d798f9b3c193a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:37.354641 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-4f851ff6-63d1-45fe-8e00-d4d7a87e82cc tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "GET /compute/v2.1/servers/05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9" status: 200 len: 1294 microversion: 2.1 time: 0.642137 Jul 28 10:35:37.359622 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 378/793] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:36 2022] GET /compute/v2.1/servers/05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9 => generated 1294 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:35:37.388586 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e9f90c57-aead-48ce-bb74-37b5177e50c7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:37.395062 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-e9f90c57-aead-48ce-bb74-37b5177e50c7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:37.411199 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e9f90c57-aead-48ce-bb74-37b5177e50c7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:37.412850 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e9f90c57-aead-48ce-bb74-37b5177e50c7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:37.415982 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e9f90c57-aead-48ce-bb74-37b5177e50c7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:37.417456 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e9f90c57-aead-48ce-bb74-37b5177e50c7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:37.485953 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-e9f90c57-aead-48ce-bb74-37b5177e50c7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:35:37.598393 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-e9f90c57-aead-48ce-bb74-37b5177e50c7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:35:37.599680 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e9f90c57-aead-48ce-bb74-37b5177e50c7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:37.600351 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e9f90c57-aead-48ce-bb74-37b5177e50c7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:37.601887 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-e9f90c57-aead-48ce-bb74-37b5177e50c7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9] instance's host None is down, deleting from database Jul 28 10:35:37.609625 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-e9f90c57-aead-48ce-bb74-37b5177e50c7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:35:37.882260 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-e9f90c57-aead-48ce-bb74-37b5177e50c7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:35:37.891924 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-e9f90c57-aead-48ce-bb74-37b5177e50c7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:35:38.584209 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e9f90c57-aead-48ce-bb74-37b5177e50c7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "DELETE /compute/v2.1/servers/05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9" status: 204 len: 0 microversion: 2.1 time: 1.204608 Jul 28 10:35:38.592487 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 416/794] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:35:37 2022] DELETE /compute/v2.1/servers/05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9 => generated 0 bytes in 1210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:35:38.597176 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-eae9b021-81aa-4462-8003-76ca28add80d tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:38.597786 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-eae9b021-81aa-4462-8003-76ca28add80d tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:38.609463 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-eae9b021-81aa-4462-8003-76ca28add80d tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:38.610202 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-eae9b021-81aa-4462-8003-76ca28add80d tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:38.611182 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-eae9b021-81aa-4462-8003-76ca28add80d tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:38.614789 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-eae9b021-81aa-4462-8003-76ca28add80d tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:38.647218 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-eae9b021-81aa-4462-8003-76ca28add80d tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] HTTP exception thrown: Instance 05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9 could not be found. Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-eae9b021-81aa-4462-8003-76ca28add80d tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Request method failure captured: Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9 HTTP/1.1 Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mZrFmv2tqSUvHHnTW6nUkrh4a1Lvl-EAPcffnboG81pceusXzXvguP1TXNMzJ-geIacOU4Vh2mo89ih0CivhAPQF9ZkO--5bCOq-J3szB0ROBtIC_dJAZtqIX15RqdJDTf_dIKPZAowmrkWSA_PpmAtc-dsPxA1jeeiQddLUQoBJqY Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 6ec3ffdc362b4d61b65d798f9b3c193a Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServersTestJSON-1602693956 Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6ec3ffdc362b4d61b65d798f9b3c193a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServersTestJSON-1602693956 Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 6ec3ffdc362b4d61b65d798f9b3c193a Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServersTestJSON-1602693956 Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServersTestJSON-1602693956-project Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: a9df268b1a6e410384274d5579d308ba Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServersTestJSON-1602693956-project Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9 could not be found. Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9'} Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9 could not be found. Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9 could not be found. Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:38.649423 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:38.654239 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:38.654239 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:38.654239 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:38.654239 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:38.654239 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9 could not be found. Jul 28 10:35:38.654239 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:38.656738 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-eae9b021-81aa-4462-8003-76ca28add80d tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Returning 404 to user: Instance 05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:38.658294 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-eae9b021-81aa-4462-8003-76ca28add80d tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "GET /compute/v2.1/servers/05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9" status: 404 len: 111 microversion: 2.1 time: 0.065270 Jul 28 10:35:38.658854 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 379/795] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:38 2022] GET /compute/v2.1/servers/05e8ec5a-cc1d-4a74-b2dd-b6b2e17568d9 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:35:38.696313 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ef5f3228-6fb6-48e7-bcab-7ea4ee2cad20 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Action: 'create', calling method: .version_select at 0x7fa94b9e7d30>, body: {"keypair": {"name": "tempest-key-159467649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEKRoqsTtmqZsluSJHE3tKE3+k9M8BaQGQXPfUgbGCT5hjDn1EuQ7ejoy5gWFhjcFkyeQv0DFQH3B2601dLt8D/sb1cyMfaTkpH5ZQzl99olXhdyqBptIxjndVwlH2pxA=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:35:38.783837 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-ef5f3228-6fb6-48e7-bcab-7ea4ee2cad20 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Getting quotas for project 6ec3ffdc362b4d61b65d798f9b3c193a. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:35:38.798213 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-ef5f3228-6fb6-48e7-bcab-7ea4ee2cad20 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Getting quotas for user a9df268b1a6e410384274d5579d308ba and project 6ec3ffdc362b4d61b65d798f9b3c193a. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:35:38.893800 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ef5f3228-6fb6-48e7-bcab-7ea4ee2cad20 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.203162 Jul 28 10:35:38.895284 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 417/796] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:35:38 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:38.915488 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-9c0583c0-410a-4092-b3d9-1861448b71b2 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '.version_select at 0x7fa94b9fb550>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:38.923419 n-d-850468-6 devstack@n-api.service[119463]: WARNING oslo_db.sqlalchemy.utils [None req-9c0583c0-410a-4092-b3d9-1861448b71b2 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 28 10:35:38.933263 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-9c0583c0-410a-4092-b3d9-1861448b71b2 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.024531 Jul 28 10:35:38.953567 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 380/797] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 10:35:38 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:39.281617 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1737993553", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "key_name": "tempest-key-159467649", "networks": [{"uuid": "f914f368-72d2-4a97-a2ea-c56989154bea"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:35:39.424905 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] validate_networks() for [('f914f368-72d2-4a97-a2ea-c56989154bea', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:35:40.615533 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:35:40.616266 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:35:40.617256 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:35:40.618050 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:35:40.618606 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:35:40.644646 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:40.646083 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:40.650311 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:40.650826 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:40.738776 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Getting quotas for project 6ec3ffdc362b4d61b65d798f9b3c193a. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:35:40.749812 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Getting quotas for user a9df268b1a6e410384274d5579d308ba and project 6ec3ffdc362b4d61b65d798f9b3c193a. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:35:40.801006 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:35:40.803654 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: a7945129-8063-4ead-826a-22ed18ecf00f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:35:40.947428 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-183e6007-c48c-4878-bcc1-473fdf14cbc8 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.669794 Jul 28 10:35:40.951095 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 418/798] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:35:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:35:40.961432 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c022dd01-b346-43d2-9127-9052659b04fa tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:40.963362 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c022dd01-b346-43d2-9127-9052659b04fa tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: a7945129-8063-4ead-826a-22ed18ecf00f] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:41.231017 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-c022dd01-b346-43d2-9127-9052659b04fa tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9df268b1a6e410384274d5579d308ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec3ffdc362b4d61b65d798f9b3c193a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:41.264420 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c022dd01-b346-43d2-9127-9052659b04fa tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "GET /compute/v2.1/servers/a7945129-8063-4ead-826a-22ed18ecf00f" status: 200 len: 1228 microversion: 2.1 time: 0.309074 Jul 28 10:35:41.267255 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 381/799] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:40 2022] GET /compute/v2.1/servers/a7945129-8063-4ead-826a-22ed18ecf00f => generated 1228 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:35:42.293821 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d862c245-daf4-4bb7-a5c6-724aa65a34ba tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:42.296155 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-d862c245-daf4-4bb7-a5c6-724aa65a34ba tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: a7945129-8063-4ead-826a-22ed18ecf00f] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:42.311090 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d862c245-daf4-4bb7-a5c6-724aa65a34ba tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:42.312196 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d862c245-daf4-4bb7-a5c6-724aa65a34ba tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:42.314396 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d862c245-daf4-4bb7-a5c6-724aa65a34ba tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:42.316607 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d862c245-daf4-4bb7-a5c6-724aa65a34ba tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:42.412393 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d862c245-daf4-4bb7-a5c6-724aa65a34ba tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:42.414463 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d862c245-daf4-4bb7-a5c6-724aa65a34ba tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:42.417262 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-d862c245-daf4-4bb7-a5c6-724aa65a34ba tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lazy-loading 'fault' on Instance uuid a7945129-8063-4ead-826a-22ed18ecf00f {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:35:42.462374 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-738774923", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "b2e7dadb-9093-4432-aff8-2955d503a278"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:35:42.532592 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-d862c245-daf4-4bb7-a5c6-724aa65a34ba tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9df268b1a6e410384274d5579d308ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec3ffdc362b4d61b65d798f9b3c193a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:42.548368 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d862c245-daf4-4bb7-a5c6-724aa65a34ba tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "GET /compute/v2.1/servers/a7945129-8063-4ead-826a-22ed18ecf00f" status: 200 len: 1301 microversion: 2.1 time: 0.258413 Jul 28 10:35:42.551102 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 382/800] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:42 2022] GET /compute/v2.1/servers/a7945129-8063-4ead-826a-22ed18ecf00f => generated 1301 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:35:42.587995 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-26ef1246-8120-42bb-b9ac-b78eb5fabd59 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:42.588603 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-26ef1246-8120-42bb-b9ac-b78eb5fabd59 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: a7945129-8063-4ead-826a-22ed18ecf00f] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:42.606697 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-26ef1246-8120-42bb-b9ac-b78eb5fabd59 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:42.607240 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-26ef1246-8120-42bb-b9ac-b78eb5fabd59 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:42.608120 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-26ef1246-8120-42bb-b9ac-b78eb5fabd59 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:42.608626 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-26ef1246-8120-42bb-b9ac-b78eb5fabd59 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:42.610085 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] validate_networks() for [('b2e7dadb-9093-4432-aff8-2955d503a278', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:35:42.664748 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-26ef1246-8120-42bb-b9ac-b78eb5fabd59 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: a7945129-8063-4ead-826a-22ed18ecf00f] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:35:42.781782 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-26ef1246-8120-42bb-b9ac-b78eb5fabd59 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: a7945129-8063-4ead-826a-22ed18ecf00f] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:35:42.783118 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-26ef1246-8120-42bb-b9ac-b78eb5fabd59 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:42.789150 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-26ef1246-8120-42bb-b9ac-b78eb5fabd59 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:42.790468 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-26ef1246-8120-42bb-b9ac-b78eb5fabd59 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: a7945129-8063-4ead-826a-22ed18ecf00f] instance's host None is down, deleting from database Jul 28 10:35:42.798457 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-26ef1246-8120-42bb-b9ac-b78eb5fabd59 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: a7945129-8063-4ead-826a-22ed18ecf00f] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:35:42.963260 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-26ef1246-8120-42bb-b9ac-b78eb5fabd59 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: a7945129-8063-4ead-826a-22ed18ecf00f] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:35:42.974477 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-26ef1246-8120-42bb-b9ac-b78eb5fabd59 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: a7945129-8063-4ead-826a-22ed18ecf00f] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:35:43.109535 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=75,nova_cell0:UPDATE=19,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:43.290967 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-26ef1246-8120-42bb-b9ac-b78eb5fabd59 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a7945129-8063-4ead-826a-22ed18ecf00f" status: 204 len: 0 microversion: 2.1 time: 0.708141 Jul 28 10:35:43.296339 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 383/801] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:35:42 2022] DELETE /compute/v2.1/servers/a7945129-8063-4ead-826a-22ed18ecf00f => generated 0 bytes in 714 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:35:43.307014 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5fa9f767-1a2a-4b5a-a6dc-a321a84b99e7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:43.314243 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-5fa9f767-1a2a-4b5a-a6dc-a321a84b99e7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: a7945129-8063-4ead-826a-22ed18ecf00f] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:43.340005 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5fa9f767-1a2a-4b5a-a6dc-a321a84b99e7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:43.341671 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5fa9f767-1a2a-4b5a-a6dc-a321a84b99e7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:43.343786 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5fa9f767-1a2a-4b5a-a6dc-a321a84b99e7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:43.344664 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5fa9f767-1a2a-4b5a-a6dc-a321a84b99e7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:43.391540 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-5fa9f767-1a2a-4b5a-a6dc-a321a84b99e7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] HTTP exception thrown: Instance a7945129-8063-4ead-826a-22ed18ecf00f could not be found. Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5fa9f767-1a2a-4b5a-a6dc-a321a84b99e7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Request method failure captured: Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/a7945129-8063-4ead-826a-22ed18ecf00f HTTP/1.1 Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mZrFmv2tqSUvHHnTW6nUkrh4a1Lvl-EAPcffnboG81pceusXzXvguP1TXNMzJ-geIacOU4Vh2mo89ih0CivhAPQF9ZkO--5bCOq-J3szB0ROBtIC_dJAZtqIX15RqdJDTf_dIKPZAowmrkWSA_PpmAtc-dsPxA1jeeiQddLUQoBJqY Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 6ec3ffdc362b4d61b65d798f9b3c193a Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServersTestJSON-1602693956 Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6ec3ffdc362b4d61b65d798f9b3c193a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServersTestJSON-1602693956 Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 6ec3ffdc362b4d61b65d798f9b3c193a Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServersTestJSON-1602693956 Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServersTestJSON-1602693956-project Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: a9df268b1a6e410384274d5579d308ba Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServersTestJSON-1602693956-project Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance a7945129-8063-4ead-826a-22ed18ecf00f could not be found. Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'a7945129-8063-4ead-826a-22ed18ecf00f'} Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7945129-8063-4ead-826a-22ed18ecf00f could not be found. Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7945129-8063-4ead-826a-22ed18ecf00f could not be found. Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:43.393741 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:43.399192 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:43.399192 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:43.399192 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:43.399192 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:43.399192 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7945129-8063-4ead-826a-22ed18ecf00f could not be found. Jul 28 10:35:43.399192 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:43.400551 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5fa9f767-1a2a-4b5a-a6dc-a321a84b99e7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Returning 404 to user: Instance a7945129-8063-4ead-826a-22ed18ecf00f could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:43.401619 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-5fa9f767-1a2a-4b5a-a6dc-a321a84b99e7 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "GET /compute/v2.1/servers/a7945129-8063-4ead-826a-22ed18ecf00f" status: 404 len: 111 microversion: 2.1 time: 0.100886 Jul 28 10:35:43.402721 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 384/802] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:43 2022] GET /compute/v2.1/servers/a7945129-8063-4ead-826a-22ed18ecf00f => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:43.418310 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5427b458-a834-4e24-a02d-44307317bd3c tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '.version_select at 0x7fa94bce8ee0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:43.468560 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-5427b458-a834-4e24-a02d-44307317bd3c tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-key-159467649" status: 202 len: 0 microversion: 2.1 time: 0.058466 Jul 28 10:35:43.471713 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 385/803] 10.222.0.46 () {58 vars in 1206 bytes} [Thu Jul 28 10:35:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-159467649 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:35:43.685084 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1766333338", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "f914f368-72d2-4a97-a2ea-c56989154bea"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:35:43.809575 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] validate_networks() for [('f914f368-72d2-4a97-a2ea-c56989154bea', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:35:44.758713 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:35:44.760133 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:35:44.760939 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:35:44.761616 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:35:44.762153 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:35:44.802724 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:44.805513 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:44.808155 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:44.810531 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:44.880433 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Getting quotas for project 75323914850d4d3d8563a3bb2df9a5ca. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:35:44.893639 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Getting quotas for user 03d023d256904440b60858635acf7f26 and project 75323914850d4d3d8563a3bb2df9a5ca. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:35:44.936768 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:44.950453 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:35:44.952741 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] [instance: 00a2f170-607a-4c94-91f3-427273c2843a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:35:45.055034 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-854e752a-e2cb-418b-a39c-f5f60860af2c tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.864363 Jul 28 10:35:45.059292 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 419/804] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:35:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:35:45.073608 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8702aba1-9467-4d4d-a8cc-e9317c814fdf tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:45.074592 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-8702aba1-9467-4d4d-a8cc-e9317c814fdf tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] [instance: 00a2f170-607a-4c94-91f3-427273c2843a] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:45.209025 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-8702aba1-9467-4d4d-a8cc-e9317c814fdf tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d023d256904440b60858635acf7f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75323914850d4d3d8563a3bb2df9a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:45.220088 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-8702aba1-9467-4d4d-a8cc-e9317c814fdf tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] 10.222.0.46 "GET /compute/v2.1/servers/00a2f170-607a-4c94-91f3-427273c2843a" status: 200 len: 1224 microversion: 2.1 time: 0.153448 Jul 28 10:35:45.228249 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 420/805] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:45 2022] GET /compute/v2.1/servers/00a2f170-607a-4c94-91f3-427273c2843a => generated 1224 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:35:46.079275 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:35:46.079275 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:35:46.079275 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:35:46.079275 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:35:46.079275 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:35:46.114780 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:46.117497 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:46.119104 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:46.122454 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:46.193270 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Getting quotas for project 6ec3ffdc362b4d61b65d798f9b3c193a. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:35:46.215236 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Getting quotas for user a9df268b1a6e410384274d5579d308ba and project 6ec3ffdc362b4d61b65d798f9b3c193a. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:35:46.251676 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c026ebf2-8780-46b7-9e0d-f578c93aef3e tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:46.252303 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c026ebf2-8780-46b7-9e0d-f578c93aef3e tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] [instance: 00a2f170-607a-4c94-91f3-427273c2843a] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:46.260701 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:35:46.263626 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 32f5a515-7b6d-4e9c-a53c-70d2051d2e7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:35:46.271243 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c026ebf2-8780-46b7-9e0d-f578c93aef3e tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:46.271628 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c026ebf2-8780-46b7-9e0d-f578c93aef3e tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:46.273980 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c026ebf2-8780-46b7-9e0d-f578c93aef3e tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:46.276361 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c026ebf2-8780-46b7-9e0d-f578c93aef3e tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:46.412633 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c026ebf2-8780-46b7-9e0d-f578c93aef3e tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:46.414895 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c026ebf2-8780-46b7-9e0d-f578c93aef3e tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:46.417971 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-c026ebf2-8780-46b7-9e0d-f578c93aef3e tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lazy-loading 'fault' on Instance uuid 00a2f170-607a-4c94-91f3-427273c2843a {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:35:46.451874 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-8945a375-daae-4108-bc84-6d2c81698946 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.771699 Jul 28 10:35:46.455141 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 386/806] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:35:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:35:46.468017 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3d86efdd-a2d0-466a-a821-59c55d65f5c3 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:46.472324 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3d86efdd-a2d0-466a-a821-59c55d65f5c3 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 32f5a515-7b6d-4e9c-a53c-70d2051d2e7f] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:46.665695 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-c026ebf2-8780-46b7-9e0d-f578c93aef3e tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d023d256904440b60858635acf7f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75323914850d4d3d8563a3bb2df9a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:46.680756 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c026ebf2-8780-46b7-9e0d-f578c93aef3e tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] 10.222.0.46 "GET /compute/v2.1/servers/00a2f170-607a-4c94-91f3-427273c2843a" status: 200 len: 1297 microversion: 2.1 time: 0.433097 Jul 28 10:35:46.683920 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 421/807] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:46 2022] GET /compute/v2.1/servers/00a2f170-607a-4c94-91f3-427273c2843a => generated 1297 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:35:46.710240 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6dc24de9-0e0a-4336-a5f6-6f24908ae736 tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:46.711105 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-6dc24de9-0e0a-4336-a5f6-6f24908ae736 tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] [instance: 00a2f170-607a-4c94-91f3-427273c2843a] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:46.722982 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6dc24de9-0e0a-4336-a5f6-6f24908ae736 tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:46.725343 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6dc24de9-0e0a-4336-a5f6-6f24908ae736 tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:46.728632 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6dc24de9-0e0a-4336-a5f6-6f24908ae736 tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:46.730607 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6dc24de9-0e0a-4336-a5f6-6f24908ae736 tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:46.881627 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-6dc24de9-0e0a-4336-a5f6-6f24908ae736 tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] [instance: 00a2f170-607a-4c94-91f3-427273c2843a] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:35:46.884508 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-3d86efdd-a2d0-466a-a821-59c55d65f5c3 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9df268b1a6e410384274d5579d308ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec3ffdc362b4d61b65d798f9b3c193a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:46.893544 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3d86efdd-a2d0-466a-a821-59c55d65f5c3 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "GET /compute/v2.1/servers/32f5a515-7b6d-4e9c-a53c-70d2051d2e7f" status: 200 len: 1209 microversion: 2.1 time: 0.430455 Jul 28 10:35:46.895276 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 387/808] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:46 2022] GET /compute/v2.1/servers/32f5a515-7b6d-4e9c-a53c-70d2051d2e7f => generated 1209 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:35:47.056746 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-6dc24de9-0e0a-4336-a5f6-6f24908ae736 tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] [instance: 00a2f170-607a-4c94-91f3-427273c2843a] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:35:47.064151 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6dc24de9-0e0a-4336-a5f6-6f24908ae736 tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:47.064151 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6dc24de9-0e0a-4336-a5f6-6f24908ae736 tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:47.066272 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-6dc24de9-0e0a-4336-a5f6-6f24908ae736 tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] [instance: 00a2f170-607a-4c94-91f3-427273c2843a] instance's host None is down, deleting from database Jul 28 10:35:47.077171 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-6dc24de9-0e0a-4336-a5f6-6f24908ae736 tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] [instance: 00a2f170-607a-4c94-91f3-427273c2843a] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:35:47.260397 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-6dc24de9-0e0a-4336-a5f6-6f24908ae736 tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] [instance: 00a2f170-607a-4c94-91f3-427273c2843a] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:35:47.270636 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-6dc24de9-0e0a-4336-a5f6-6f24908ae736 tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] [instance: 00a2f170-607a-4c94-91f3-427273c2843a] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:35:47.510734 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=10,nova_api:UPDATE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:47.692144 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=62,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:47.715073 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-6dc24de9-0e0a-4336-a5f6-6f24908ae736 tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] 10.222.0.46 "DELETE /compute/v2.1/servers/00a2f170-607a-4c94-91f3-427273c2843a" status: 204 len: 0 microversion: 2.1 time: 1.006786 Jul 28 10:35:47.717255 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 422/809] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:35:46 2022] DELETE /compute/v2.1/servers/00a2f170-607a-4c94-91f3-427273c2843a => generated 0 bytes in 1012 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 10:35:47.727086 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5ebfd36e-739a-4c3a-9edb-ca992ab8158a tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:47.727086 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-5ebfd36e-739a-4c3a-9edb-ca992ab8158a tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] [instance: 00a2f170-607a-4c94-91f3-427273c2843a] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:47.734289 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5ebfd36e-739a-4c3a-9edb-ca992ab8158a tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:47.734905 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5ebfd36e-739a-4c3a-9edb-ca992ab8158a tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:47.735788 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5ebfd36e-739a-4c3a-9edb-ca992ab8158a tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:47.736325 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5ebfd36e-739a-4c3a-9edb-ca992ab8158a tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:47.767030 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-5ebfd36e-739a-4c3a-9edb-ca992ab8158a tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] HTTP exception thrown: Instance 00a2f170-607a-4c94-91f3-427273c2843a could not be found. Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5ebfd36e-739a-4c3a-9edb-ca992ab8158a tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Request method failure captured: Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/00a2f170-607a-4c94-91f3-427273c2843a HTTP/1.1 Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mZ9xzuGG84BSYTK9crymBnH4cwZNTKsiV6E9WBu_nJ7JiAOD3j5Qmb72PusMLM6Np3NbbUP4khzQmgo4Q6DQ5kNQCyPvnv1m2vAvZEIfnvExCz-nUslCvX0zWtqNF73sIEMEVgq00a6IiTgLs2J5oRXjQPbuS6kWMLo_VhGsiiQufs Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 75323914850d4d3d8563a3bb2df9a5ca Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-457524815 Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/75323914850d4d3d8563a3bb2df9a5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/75323914850d4d3d8563a3bb2df9a5ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/75323914850d4d3d8563a3bb2df9a5ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_75323914850d4d3d8563a3bb2df9a5ca", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-457524815 Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 75323914850d4d3d8563a3bb2df9a5ca Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-457524815 Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServerAddressesNegativeTestJSON-457524815-project Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 03d023d256904440b60858635acf7f26 Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-457524815-project Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 00a2f170-607a-4c94-91f3-427273c2843a could not be found. Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '00a2f170-607a-4c94-91f3-427273c2843a'} Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00a2f170-607a-4c94-91f3-427273c2843a could not be found. Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00a2f170-607a-4c94-91f3-427273c2843a could not be found. Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:47.769616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:47.777669 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:47.777669 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:47.777669 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:47.777669 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:47.777669 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:47.777669 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:47.777669 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00a2f170-607a-4c94-91f3-427273c2843a could not be found. Jul 28 10:35:47.777669 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:47.781708 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5ebfd36e-739a-4c3a-9edb-ca992ab8158a tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] Returning 404 to user: Instance 00a2f170-607a-4c94-91f3-427273c2843a could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:47.783114 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-5ebfd36e-739a-4c3a-9edb-ca992ab8158a tempest-ServerAddressesNegativeTestJSON-457524815 tempest-ServerAddressesNegativeTestJSON-457524815-project] 10.222.0.46 "GET /compute/v2.1/servers/00a2f170-607a-4c94-91f3-427273c2843a" status: 404 len: 111 microversion: 2.1 time: 0.061980 Jul 28 10:35:47.784721 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 388/810] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:47 2022] GET /compute/v2.1/servers/00a2f170-607a-4c94-91f3-427273c2843a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:47.922081 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7e7b2be7-6f7f-4b25-b8ba-6faaf0a622fc tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:47.922869 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-7e7b2be7-6f7f-4b25-b8ba-6faaf0a622fc tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 32f5a515-7b6d-4e9c-a53c-70d2051d2e7f] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:47.957374 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7e7b2be7-6f7f-4b25-b8ba-6faaf0a622fc tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:47.960409 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7e7b2be7-6f7f-4b25-b8ba-6faaf0a622fc tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:47.961517 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7e7b2be7-6f7f-4b25-b8ba-6faaf0a622fc tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:47.966049 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7e7b2be7-6f7f-4b25-b8ba-6faaf0a622fc tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:48.116012 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7e7b2be7-6f7f-4b25-b8ba-6faaf0a622fc tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:48.116538 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7e7b2be7-6f7f-4b25-b8ba-6faaf0a622fc tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:48.128727 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-7e7b2be7-6f7f-4b25-b8ba-6faaf0a622fc tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lazy-loading 'fault' on Instance uuid 32f5a515-7b6d-4e9c-a53c-70d2051d2e7f {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:35:48.868878 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-7e7b2be7-6f7f-4b25-b8ba-6faaf0a622fc tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9df268b1a6e410384274d5579d308ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec3ffdc362b4d61b65d798f9b3c193a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:48.892984 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7e7b2be7-6f7f-4b25-b8ba-6faaf0a622fc tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "GET /compute/v2.1/servers/32f5a515-7b6d-4e9c-a53c-70d2051d2e7f" status: 200 len: 1282 microversion: 2.1 time: 0.975989 Jul 28 10:35:48.915627 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 423/811] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:47 2022] GET /compute/v2.1/servers/32f5a515-7b6d-4e9c-a53c-70d2051d2e7f => generated 1282 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:35:48.920709 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ec1955b8-2819-4e05-9886-20ce69d9c416 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:48.921468 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ec1955b8-2819-4e05-9886-20ce69d9c416 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 32f5a515-7b6d-4e9c-a53c-70d2051d2e7f] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:48.941488 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ec1955b8-2819-4e05-9886-20ce69d9c416 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:48.945169 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ec1955b8-2819-4e05-9886-20ce69d9c416 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:48.951458 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ec1955b8-2819-4e05-9886-20ce69d9c416 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:48.954251 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ec1955b8-2819-4e05-9886-20ce69d9c416 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:49.066018 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ec1955b8-2819-4e05-9886-20ce69d9c416 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 32f5a515-7b6d-4e9c-a53c-70d2051d2e7f] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:35:49.200187 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ec1955b8-2819-4e05-9886-20ce69d9c416 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 32f5a515-7b6d-4e9c-a53c-70d2051d2e7f] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:35:49.201182 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ec1955b8-2819-4e05-9886-20ce69d9c416 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:49.205736 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ec1955b8-2819-4e05-9886-20ce69d9c416 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:49.206582 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-ec1955b8-2819-4e05-9886-20ce69d9c416 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 32f5a515-7b6d-4e9c-a53c-70d2051d2e7f] instance's host None is down, deleting from database Jul 28 10:35:49.211536 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-ec1955b8-2819-4e05-9886-20ce69d9c416 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 32f5a515-7b6d-4e9c-a53c-70d2051d2e7f] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:35:49.516515 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-ec1955b8-2819-4e05-9886-20ce69d9c416 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 32f5a515-7b6d-4e9c-a53c-70d2051d2e7f] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:35:49.523790 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-ec1955b8-2819-4e05-9886-20ce69d9c416 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 32f5a515-7b6d-4e9c-a53c-70d2051d2e7f] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:35:49.714616 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9a936c8b-b0f5-4f35-be41-3016036fb420 tempest-AZV2TestJSON-725795667 tempest-AZV2TestJSON-725795667-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:49.716876 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9a936c8b-b0f5-4f35-be41-3016036fb420 tempest-AZV2TestJSON-725795667 tempest-AZV2TestJSON-725795667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:49.717576 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9a936c8b-b0f5-4f35-be41-3016036fb420 tempest-AZV2TestJSON-725795667 tempest-AZV2TestJSON-725795667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:49.718767 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9a936c8b-b0f5-4f35-be41-3016036fb420 tempest-AZV2TestJSON-725795667 tempest-AZV2TestJSON-725795667-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:49.720569 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9a936c8b-b0f5-4f35-be41-3016036fb420 tempest-AZV2TestJSON-725795667 tempest-AZV2TestJSON-725795667-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:49.873122 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9a936c8b-b0f5-4f35-be41-3016036fb420 tempest-AZV2TestJSON-725795667 tempest-AZV2TestJSON-725795667-project] 10.222.0.46 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.956195 Jul 28 10:35:49.887170 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ec1955b8-2819-4e05-9886-20ce69d9c416 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "DELETE /compute/v2.1/servers/32f5a515-7b6d-4e9c-a53c-70d2051d2e7f" status: 204 len: 0 microversion: 2.1 time: 0.970384 Jul 28 10:35:49.891180 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 389/812] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:35:48 2022] DELETE /compute/v2.1/servers/32f5a515-7b6d-4e9c-a53c-70d2051d2e7f => generated 0 bytes in 973 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:35:49.894288 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 424/813] 10.222.0.46 () {58 vars in 1164 bytes} [Thu Jul 28 10:35:48 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:35:49.948928 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f6f27eae-672f-42c0-aa2f-e984b501c2df tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:49.962719 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f6f27eae-672f-42c0-aa2f-e984b501c2df tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 32f5a515-7b6d-4e9c-a53c-70d2051d2e7f] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:50.017878 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f6f27eae-672f-42c0-aa2f-e984b501c2df tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:50.021638 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f6f27eae-672f-42c0-aa2f-e984b501c2df tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:50.028520 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f6f27eae-672f-42c0-aa2f-e984b501c2df tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:50.041768 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f6f27eae-672f-42c0-aa2f-e984b501c2df tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:50.103855 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-f6f27eae-672f-42c0-aa2f-e984b501c2df tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] HTTP exception thrown: Instance 32f5a515-7b6d-4e9c-a53c-70d2051d2e7f could not be found. Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f6f27eae-672f-42c0-aa2f-e984b501c2df tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Request method failure captured: Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/32f5a515-7b6d-4e9c-a53c-70d2051d2e7f HTTP/1.1 Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mZrFmv2tqSUvHHnTW6nUkrh4a1Lvl-EAPcffnboG81pceusXzXvguP1TXNMzJ-geIacOU4Vh2mo89ih0CivhAPQF9ZkO--5bCOq-J3szB0ROBtIC_dJAZtqIX15RqdJDTf_dIKPZAowmrkWSA_PpmAtc-dsPxA1jeeiQddLUQoBJqY Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 6ec3ffdc362b4d61b65d798f9b3c193a Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServersTestJSON-1602693956 Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6ec3ffdc362b4d61b65d798f9b3c193a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServersTestJSON-1602693956 Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 6ec3ffdc362b4d61b65d798f9b3c193a Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServersTestJSON-1602693956 Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServersTestJSON-1602693956-project Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: a9df268b1a6e410384274d5579d308ba Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServersTestJSON-1602693956-project Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 32f5a515-7b6d-4e9c-a53c-70d2051d2e7f could not be found. Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '32f5a515-7b6d-4e9c-a53c-70d2051d2e7f'} Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32f5a515-7b6d-4e9c-a53c-70d2051d2e7f could not be found. Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32f5a515-7b6d-4e9c-a53c-70d2051d2e7f could not be found. Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:50.110656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:50.116794 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:50.116794 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:50.116794 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:50.116794 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:50.116794 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32f5a515-7b6d-4e9c-a53c-70d2051d2e7f could not be found. Jul 28 10:35:50.116794 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:50.136027 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f6f27eae-672f-42c0-aa2f-e984b501c2df tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Returning 404 to user: Instance 32f5a515-7b6d-4e9c-a53c-70d2051d2e7f could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:50.137884 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f6f27eae-672f-42c0-aa2f-e984b501c2df tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "GET /compute/v2.1/servers/32f5a515-7b6d-4e9c-a53c-70d2051d2e7f" status: 404 len: 111 microversion: 2.1 time: 0.223595 Jul 28 10:35:50.144628 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 390/814] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:49 2022] GET /compute/v2.1/servers/32f5a515-7b6d-4e9c-a53c-70d2051d2e7f => generated 111 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:50.487312 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1848124123", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "f914f368-72d2-4a97-a2ea-c56989154bea"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:35:50.646627 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] validate_networks() for [('f914f368-72d2-4a97-a2ea-c56989154bea', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:35:53.039135 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-645853902", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "fc480ddc-689b-4a08-ab44-677bf4b84cd1"}], "block_device_mapping_v2": [{"uuid": "69f5f13e-d5d2-489c-a478-6c6db9329e33", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:35:53.188063 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] validate_networks() for [('fc480ddc-689b-4a08-ab44-677bf4b84cd1', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:35:54.341901 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:35:54.344117 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:35:54.344925 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:35:54.346310 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:35:54.347517 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:35:54.374708 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=27 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:54.379082 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:54.379583 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:54.380403 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:54.380842 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:54.420181 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Getting quotas for project 70ceba76ab9744e7a0ae4f2438709f7d. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:35:54.429151 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Getting quotas for user e28dd90a9b204ee78200f89abd27052a and project 70ceba76ab9744e7a0ae4f2438709f7d. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:35:54.441990 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:54.570711 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:35:54.572731 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: a2ae71bd-fef7-499b-b37d-2862ac1e7cbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='69f5f13e-d5d2-489c-a478-6c6db9329e33',volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:35:54.613965 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:35:54.614981 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:35:54.623058 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:35:54.633351 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:35:54.634373 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:35:54.659039 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=27 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:54.671960 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:54.672868 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:54.674046 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:54.674719 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:54.697674 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=9 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:54.718106 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Getting quotas for project 6ec3ffdc362b4d61b65d798f9b3c193a. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:35:54.726009 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Getting quotas for user a9df268b1a6e410384274d5579d308ba and project 6ec3ffdc362b4d61b65d798f9b3c193a. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:35:54.742557 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:35:54.744733 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 963e36aa-e613-4d4e-ad89-f5da3fc09c6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:35:54.806999 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-8173d038-b7b2-4a5d-a0c7-c0dba6551e36 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.333088 Jul 28 10:35:54.809580 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 425/815] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:35:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 4337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:35:54.826085 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a9add03e-7215-44af-aa6a-5ace0a7501dd tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:54.830301 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a9add03e-7215-44af-aa6a-5ace0a7501dd tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 963e36aa-e613-4d4e-ad89-f5da3fc09c6f] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:54.833654 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-7dd5ab15-50c5-48b1-873b-4bed8fc8d5bc tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.799615 Jul 28 10:35:54.835518 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 391/816] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:35:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:35:54.855644 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-11270104-dfa9-4e9d-b486-10d98c53a6ce tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:54.874540 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-11270104-dfa9-4e9d-b486-10d98c53a6ce tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: a2ae71bd-fef7-499b-b37d-2862ac1e7cbc] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:54.994089 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-11270104-dfa9-4e9d-b486-10d98c53a6ce tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28dd90a9b204ee78200f89abd27052a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ceba76ab9744e7a0ae4f2438709f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:55.025985 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-11270104-dfa9-4e9d-b486-10d98c53a6ce tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] 10.222.0.46 "GET /compute/v2.1/servers/a2ae71bd-fef7-499b-b37d-2862ac1e7cbc" status: 200 len: 1052 microversion: 2.1 time: 0.182143 Jul 28 10:35:55.050928 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 392/817] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:54 2022] GET /compute/v2.1/servers/a2ae71bd-fef7-499b-b37d-2862ac1e7cbc => generated 1052 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:35:55.529749 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-a9add03e-7215-44af-aa6a-5ace0a7501dd tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9df268b1a6e410384274d5579d308ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec3ffdc362b4d61b65d798f9b3c193a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:55.538950 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a9add03e-7215-44af-aa6a-5ace0a7501dd tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "GET /compute/v2.1/servers/963e36aa-e613-4d4e-ad89-f5da3fc09c6f" status: 200 len: 1209 microversion: 2.1 time: 0.721503 Jul 28 10:35:55.552748 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 426/818] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:54 2022] GET /compute/v2.1/servers/963e36aa-e613-4d4e-ad89-f5da3fc09c6f => generated 1209 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:35:56.056839 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-56d925ae-4063-4528-ac18-80def49afdd5 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:56.058545 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-56d925ae-4063-4528-ac18-80def49afdd5 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: a2ae71bd-fef7-499b-b37d-2862ac1e7cbc] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:56.066143 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-56d925ae-4063-4528-ac18-80def49afdd5 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:56.066987 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-56d925ae-4063-4528-ac18-80def49afdd5 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:56.068185 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-56d925ae-4063-4528-ac18-80def49afdd5 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:56.068895 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-56d925ae-4063-4528-ac18-80def49afdd5 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:56.113324 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-56d925ae-4063-4528-ac18-80def49afdd5 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:56.114277 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-56d925ae-4063-4528-ac18-80def49afdd5 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:56.115552 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-56d925ae-4063-4528-ac18-80def49afdd5 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lazy-loading 'fault' on Instance uuid a2ae71bd-fef7-499b-b37d-2862ac1e7cbc {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:35:56.224718 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-56d925ae-4063-4528-ac18-80def49afdd5 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28dd90a9b204ee78200f89abd27052a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ceba76ab9744e7a0ae4f2438709f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:56.239701 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-56d925ae-4063-4528-ac18-80def49afdd5 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] 10.222.0.46 "GET /compute/v2.1/servers/a2ae71bd-fef7-499b-b37d-2862ac1e7cbc" status: 200 len: 1171 microversion: 2.1 time: 0.187104 Jul 28 10:35:56.240315 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 393/819] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:56 2022] GET /compute/v2.1/servers/a2ae71bd-fef7-499b-b37d-2862ac1e7cbc => generated 1171 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:35:56.266498 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6c9c66a8-ed83-44f5-a485-b7734ae75266 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:56.267784 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-6c9c66a8-ed83-44f5-a485-b7734ae75266 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: a2ae71bd-fef7-499b-b37d-2862ac1e7cbc] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:56.285974 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6c9c66a8-ed83-44f5-a485-b7734ae75266 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:56.287383 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6c9c66a8-ed83-44f5-a485-b7734ae75266 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:56.289133 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6c9c66a8-ed83-44f5-a485-b7734ae75266 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:56.290060 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6c9c66a8-ed83-44f5-a485-b7734ae75266 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:56.334195 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-6c9c66a8-ed83-44f5-a485-b7734ae75266 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: a2ae71bd-fef7-499b-b37d-2862ac1e7cbc] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:35:56.427859 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-6c9c66a8-ed83-44f5-a485-b7734ae75266 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: a2ae71bd-fef7-499b-b37d-2862ac1e7cbc] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:35:56.433402 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6c9c66a8-ed83-44f5-a485-b7734ae75266 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:56.434399 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6c9c66a8-ed83-44f5-a485-b7734ae75266 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:56.435875 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-6c9c66a8-ed83-44f5-a485-b7734ae75266 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: a2ae71bd-fef7-499b-b37d-2862ac1e7cbc] instance's host None is down, deleting from database Jul 28 10:35:56.444526 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-6c9c66a8-ed83-44f5-a485-b7734ae75266 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: a2ae71bd-fef7-499b-b37d-2862ac1e7cbc] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:35:56.569528 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ac24a6e3-72f0-4094-b211-9070141bff83 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:56.570728 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ac24a6e3-72f0-4094-b211-9070141bff83 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 963e36aa-e613-4d4e-ad89-f5da3fc09c6f] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:56.585559 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ac24a6e3-72f0-4094-b211-9070141bff83 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:56.586098 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ac24a6e3-72f0-4094-b211-9070141bff83 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:56.587052 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ac24a6e3-72f0-4094-b211-9070141bff83 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:56.587504 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ac24a6e3-72f0-4094-b211-9070141bff83 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:56.670451 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ac24a6e3-72f0-4094-b211-9070141bff83 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:56.670826 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ac24a6e3-72f0-4094-b211-9070141bff83 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:56.671424 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-ac24a6e3-72f0-4094-b211-9070141bff83 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lazy-loading 'fault' on Instance uuid 963e36aa-e613-4d4e-ad89-f5da3fc09c6f {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:35:56.753196 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-6c9c66a8-ed83-44f5-a485-b7734ae75266 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: a2ae71bd-fef7-499b-b37d-2862ac1e7cbc] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:35:56.754260 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-ac24a6e3-72f0-4094-b211-9070141bff83 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9df268b1a6e410384274d5579d308ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec3ffdc362b4d61b65d798f9b3c193a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:35:56.761829 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-6c9c66a8-ed83-44f5-a485-b7734ae75266 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: a2ae71bd-fef7-499b-b37d-2862ac1e7cbc] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:35:56.769529 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ac24a6e3-72f0-4094-b211-9070141bff83 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "GET /compute/v2.1/servers/963e36aa-e613-4d4e-ad89-f5da3fc09c6f" status: 200 len: 1282 microversion: 2.1 time: 0.204494 Jul 28 10:35:56.773725 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 394/820] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:56 2022] GET /compute/v2.1/servers/963e36aa-e613-4d4e-ad89-f5da3fc09c6f => generated 1282 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:35:56.797543 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8fabd1a4-7d3d-49bd-8163-4842b53738b2 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:56.798494 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-8fabd1a4-7d3d-49bd-8163-4842b53738b2 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 963e36aa-e613-4d4e-ad89-f5da3fc09c6f] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:56.824379 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8fabd1a4-7d3d-49bd-8163-4842b53738b2 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:56.825478 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8fabd1a4-7d3d-49bd-8163-4842b53738b2 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:56.827236 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8fabd1a4-7d3d-49bd-8163-4842b53738b2 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:56.828381 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8fabd1a4-7d3d-49bd-8163-4842b53738b2 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:56.911974 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-8fabd1a4-7d3d-49bd-8163-4842b53738b2 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 963e36aa-e613-4d4e-ad89-f5da3fc09c6f] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:35:57.052674 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-8fabd1a4-7d3d-49bd-8163-4842b53738b2 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 963e36aa-e613-4d4e-ad89-f5da3fc09c6f] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:35:57.056473 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8fabd1a4-7d3d-49bd-8163-4842b53738b2 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:57.057447 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8fabd1a4-7d3d-49bd-8163-4842b53738b2 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:57.058004 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-8fabd1a4-7d3d-49bd-8163-4842b53738b2 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 963e36aa-e613-4d4e-ad89-f5da3fc09c6f] instance's host None is down, deleting from database Jul 28 10:35:57.064929 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-8fabd1a4-7d3d-49bd-8163-4842b53738b2 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 963e36aa-e613-4d4e-ad89-f5da3fc09c6f] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:35:57.159002 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-8fabd1a4-7d3d-49bd-8163-4842b53738b2 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 963e36aa-e613-4d4e-ad89-f5da3fc09c6f] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:35:57.162397 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=67,nova_cell0:UPDATE=27,nova_cell0:DELETE=4,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:35:57.176496 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-8fabd1a4-7d3d-49bd-8163-4842b53738b2 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 963e36aa-e613-4d4e-ad89-f5da3fc09c6f] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:35:57.502855 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-6c9c66a8-ed83-44f5-a485-b7734ae75266 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a2ae71bd-fef7-499b-b37d-2862ac1e7cbc" status: 204 len: 0 microversion: 2.1 time: 1.238692 Jul 28 10:35:57.504424 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 427/821] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:35:56 2022] DELETE /compute/v2.1/servers/a2ae71bd-fef7-499b-b37d-2862ac1e7cbc => generated 0 bytes in 1244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:35:57.530658 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-44eab08e-be78-4f1a-98d2-87013a895702 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:57.532991 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-44eab08e-be78-4f1a-98d2-87013a895702 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] [instance: a2ae71bd-fef7-499b-b37d-2862ac1e7cbc] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:57.560355 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-44eab08e-be78-4f1a-98d2-87013a895702 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:57.564369 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-44eab08e-be78-4f1a-98d2-87013a895702 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:57.566779 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-44eab08e-be78-4f1a-98d2-87013a895702 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:57.572649 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-44eab08e-be78-4f1a-98d2-87013a895702 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:57.615994 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-44eab08e-be78-4f1a-98d2-87013a895702 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] HTTP exception thrown: Instance a2ae71bd-fef7-499b-b37d-2862ac1e7cbc could not be found. Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-44eab08e-be78-4f1a-98d2-87013a895702 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Request method failure captured: Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/a2ae71bd-fef7-499b-b37d-2862ac1e7cbc HTTP/1.1 Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mYptj_LZLwBL_87lWbKq6S8B7QLX8Lu1BoYegV2iknGz0pD7-au3YafcbfNWI5UjO6dSiBg9cg0UFSSRvaeGx_jRBevxKEt6gVvP5sWy0cU0yIKFXMUPoabtlPb2RRum07gTYLoxC94gQDIX_TkzArEedBfsTl_fKv7TMPVm82tJ9U Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 70ceba76ab9744e7a0ae4f2438709f7d Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-LiveMigrationTest-1443832547 Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/70ceba76ab9744e7a0ae4f2438709f7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/70ceba76ab9744e7a0ae4f2438709f7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/70ceba76ab9744e7a0ae4f2438709f7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_70ceba76ab9744e7a0ae4f2438709f7d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-LiveMigrationTest-1443832547 Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 70ceba76ab9744e7a0ae4f2438709f7d Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-LiveMigrationTest-1443832547 Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-LiveMigrationTest-1443832547-project Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: e28dd90a9b204ee78200f89abd27052a Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-LiveMigrationTest-1443832547-project Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance a2ae71bd-fef7-499b-b37d-2862ac1e7cbc could not be found. Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'a2ae71bd-fef7-499b-b37d-2862ac1e7cbc'} Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2ae71bd-fef7-499b-b37d-2862ac1e7cbc could not be found. Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2ae71bd-fef7-499b-b37d-2862ac1e7cbc could not be found. Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:57.621126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:57.626204 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:57.626204 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:57.626204 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:57.626204 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:57.626204 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:57.626204 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2ae71bd-fef7-499b-b37d-2862ac1e7cbc could not be found. Jul 28 10:35:57.626204 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:35:57.628239 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-44eab08e-be78-4f1a-98d2-87013a895702 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Returning 404 to user: Instance a2ae71bd-fef7-499b-b37d-2862ac1e7cbc could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:57.629571 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-44eab08e-be78-4f1a-98d2-87013a895702 tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] 10.222.0.46 "GET /compute/v2.1/servers/a2ae71bd-fef7-499b-b37d-2862ac1e7cbc" status: 404 len: 111 microversion: 2.1 time: 0.119558 Jul 28 10:35:57.636980 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 428/822] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:57 2022] GET /compute/v2.1/servers/a2ae71bd-fef7-499b-b37d-2862ac1e7cbc => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:57.656703 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-8fabd1a4-7d3d-49bd-8163-4842b53738b2 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "DELETE /compute/v2.1/servers/963e36aa-e613-4d4e-ad89-f5da3fc09c6f" status: 204 len: 0 microversion: 2.1 time: 0.864331 Jul 28 10:35:57.658812 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 395/823] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:35:56 2022] DELETE /compute/v2.1/servers/963e36aa-e613-4d4e-ad89-f5da3fc09c6f => generated 0 bytes in 868 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:35:57.668975 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-3454e284-2cac-4b11-9b83-c6210de6fd0e tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] Calling method '.version_select at 0x7fa94b9e7af0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:57.679013 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3316152c-805b-4a72-8d28-2e0cf6af109b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:57.679885 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3316152c-805b-4a72-8d28-2e0cf6af109b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 963e36aa-e613-4d4e-ad89-f5da3fc09c6f] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:35:57.703527 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3316152c-805b-4a72-8d28-2e0cf6af109b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:57.705011 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3316152c-805b-4a72-8d28-2e0cf6af109b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:57.708908 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3316152c-805b-4a72-8d28-2e0cf6af109b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:35:57.710325 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3316152c-805b-4a72-8d28-2e0cf6af109b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:35:57.729204 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-3454e284-2cac-4b11-9b83-c6210de6fd0e tempest-LiveMigrationTest-1443832547 tempest-LiveMigrationTest-1443832547-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-42878079" status: 202 len: 0 microversion: 2.1 time: 0.066688 Jul 28 10:35:57.729795 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 429/824] 10.222.0.46 () {58 vars in 1215 bytes} [Thu Jul 28 10:35:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-42878079 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:35:57.737711 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-3316152c-805b-4a72-8d28-2e0cf6af109b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] HTTP exception thrown: Instance 963e36aa-e613-4d4e-ad89-f5da3fc09c6f could not be found. Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3316152c-805b-4a72-8d28-2e0cf6af109b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Request method failure captured: Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/963e36aa-e613-4d4e-ad89-f5da3fc09c6f HTTP/1.1 Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mZrFmv2tqSUvHHnTW6nUkrh4a1Lvl-EAPcffnboG81pceusXzXvguP1TXNMzJ-geIacOU4Vh2mo89ih0CivhAPQF9ZkO--5bCOq-J3szB0ROBtIC_dJAZtqIX15RqdJDTf_dIKPZAowmrkWSA_PpmAtc-dsPxA1jeeiQddLUQoBJqY Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 6ec3ffdc362b4d61b65d798f9b3c193a Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServersTestJSON-1602693956 Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6ec3ffdc362b4d61b65d798f9b3c193a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServersTestJSON-1602693956 Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 6ec3ffdc362b4d61b65d798f9b3c193a Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServersTestJSON-1602693956 Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServersTestJSON-1602693956-project Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: a9df268b1a6e410384274d5579d308ba Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServersTestJSON-1602693956-project Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 963e36aa-e613-4d4e-ad89-f5da3fc09c6f could not be found. Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '963e36aa-e613-4d4e-ad89-f5da3fc09c6f'} Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 963e36aa-e613-4d4e-ad89-f5da3fc09c6f could not be found. Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 963e36aa-e613-4d4e-ad89-f5da3fc09c6f could not be found. Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:57.739915 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:35:57.746504 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:35:57.746504 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:35:57.746504 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:35:57.746504 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:35:57.746504 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 963e36aa-e613-4d4e-ad89-f5da3fc09c6f could not be found. Jul 28 10:35:57.746504 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:35:57.748359 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3316152c-805b-4a72-8d28-2e0cf6af109b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Returning 404 to user: Instance 963e36aa-e613-4d4e-ad89-f5da3fc09c6f could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:35:57.750381 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3316152c-805b-4a72-8d28-2e0cf6af109b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "GET /compute/v2.1/servers/963e36aa-e613-4d4e-ad89-f5da3fc09c6f" status: 404 len: 111 microversion: 2.1 time: 0.085027 Jul 28 10:35:57.751427 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 396/825] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:35:57 2022] GET /compute/v2.1/servers/963e36aa-e613-4d4e-ad89-f5da3fc09c6f => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:35:57.925112 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1471836246", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "f914f368-72d2-4a97-a2ea-c56989154bea"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:35:58.103055 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] validate_networks() for [('f914f368-72d2-4a97-a2ea-c56989154bea', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:36:01.691697 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:36:01.692295 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:36:01.692585 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:36:01.694184 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:36:01.694184 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:36:01.738277 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:01.738743 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:01.739568 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:01.740013 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:01.826083 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Getting quotas for project 6ec3ffdc362b4d61b65d798f9b3c193a. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:36:01.844180 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Getting quotas for user a9df268b1a6e410384274d5579d308ba and project 6ec3ffdc362b4d61b65d798f9b3c193a. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:36:01.877414 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:36:01.880285 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 031562b2-3cba-4579-b357-318660a6161b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:36:01.999844 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-96ac88b4-70a7-4646-90de-e4b25601065b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.078637 Jul 28 10:36:02.004342 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 430/826] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:35:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 4084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:36:02.015505 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-78d0eb8e-dde4-4e19-a8d1-9423689179b0 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:02.016100 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-78d0eb8e-dde4-4e19-a8d1-9423689179b0 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 031562b2-3cba-4579-b357-318660a6161b] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:02.241632 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-78d0eb8e-dde4-4e19-a8d1-9423689179b0 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9df268b1a6e410384274d5579d308ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec3ffdc362b4d61b65d798f9b3c193a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:36:02.255886 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-78d0eb8e-dde4-4e19-a8d1-9423689179b0 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "GET /compute/v2.1/servers/031562b2-3cba-4579-b357-318660a6161b" status: 200 len: 1209 microversion: 2.1 time: 0.243947 Jul 28 10:36:02.258988 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 397/827] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:36:02 2022] GET /compute/v2.1/servers/031562b2-3cba-4579-b357-318660a6161b => generated 1209 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:36:03.284032 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-68a84e4f-0607-484c-bbf3-e3d444eb6f14 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:03.285290 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-68a84e4f-0607-484c-bbf3-e3d444eb6f14 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 031562b2-3cba-4579-b357-318660a6161b] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:03.310406 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-68a84e4f-0607-484c-bbf3-e3d444eb6f14 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:03.312553 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-68a84e4f-0607-484c-bbf3-e3d444eb6f14 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:03.313449 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-68a84e4f-0607-484c-bbf3-e3d444eb6f14 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:03.317648 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-68a84e4f-0607-484c-bbf3-e3d444eb6f14 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:03.374127 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-68a84e4f-0607-484c-bbf3-e3d444eb6f14 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:03.374588 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-68a84e4f-0607-484c-bbf3-e3d444eb6f14 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:03.375047 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-68a84e4f-0607-484c-bbf3-e3d444eb6f14 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lazy-loading 'fault' on Instance uuid 031562b2-3cba-4579-b357-318660a6161b {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:36:03.526407 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-68a84e4f-0607-484c-bbf3-e3d444eb6f14 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9df268b1a6e410384274d5579d308ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec3ffdc362b4d61b65d798f9b3c193a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:36:03.542357 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-68a84e4f-0607-484c-bbf3-e3d444eb6f14 tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "GET /compute/v2.1/servers/031562b2-3cba-4579-b357-318660a6161b" status: 200 len: 1282 microversion: 2.1 time: 0.262167 Jul 28 10:36:03.545642 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 431/828] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:36:03 2022] GET /compute/v2.1/servers/031562b2-3cba-4579-b357-318660a6161b => generated 1282 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:36:03.567481 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-26ada712-dba9-4bd8-bf8c-5cfad11ac1ff tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:03.569266 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-26ada712-dba9-4bd8-bf8c-5cfad11ac1ff tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 031562b2-3cba-4579-b357-318660a6161b] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:03.591432 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-26ada712-dba9-4bd8-bf8c-5cfad11ac1ff tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:03.592170 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-26ada712-dba9-4bd8-bf8c-5cfad11ac1ff tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:03.594612 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-26ada712-dba9-4bd8-bf8c-5cfad11ac1ff tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:03.595540 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-26ada712-dba9-4bd8-bf8c-5cfad11ac1ff tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:03.680125 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-26ada712-dba9-4bd8-bf8c-5cfad11ac1ff tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 031562b2-3cba-4579-b357-318660a6161b] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:36:03.833802 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-26ada712-dba9-4bd8-bf8c-5cfad11ac1ff tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 031562b2-3cba-4579-b357-318660a6161b] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:36:03.835870 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-26ada712-dba9-4bd8-bf8c-5cfad11ac1ff tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:03.836640 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-26ada712-dba9-4bd8-bf8c-5cfad11ac1ff tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:03.837330 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-26ada712-dba9-4bd8-bf8c-5cfad11ac1ff tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 031562b2-3cba-4579-b357-318660a6161b] instance's host None is down, deleting from database Jul 28 10:36:03.842345 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-26ada712-dba9-4bd8-bf8c-5cfad11ac1ff tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 031562b2-3cba-4579-b357-318660a6161b] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:36:04.330554 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-26ada712-dba9-4bd8-bf8c-5cfad11ac1ff tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 031562b2-3cba-4579-b357-318660a6161b] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:36:04.340368 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-26ada712-dba9-4bd8-bf8c-5cfad11ac1ff tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 031562b2-3cba-4579-b357-318660a6161b] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:36:04.440320 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:04.652724 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-26ada712-dba9-4bd8-bf8c-5cfad11ac1ff tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "DELETE /compute/v2.1/servers/031562b2-3cba-4579-b357-318660a6161b" status: 204 len: 0 microversion: 2.1 time: 1.090676 Jul 28 10:36:04.654767 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 398/829] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:36:03 2022] DELETE /compute/v2.1/servers/031562b2-3cba-4579-b357-318660a6161b => generated 0 bytes in 1094 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:36:04.663884 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a6b29fc7-9947-4c9a-a6bd-393d580efd7b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:04.666316 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a6b29fc7-9947-4c9a-a6bd-393d580efd7b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 031562b2-3cba-4579-b357-318660a6161b] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:04.679286 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a6b29fc7-9947-4c9a-a6bd-393d580efd7b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:04.683844 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a6b29fc7-9947-4c9a-a6bd-393d580efd7b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:04.684872 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a6b29fc7-9947-4c9a-a6bd-393d580efd7b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:04.687330 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a6b29fc7-9947-4c9a-a6bd-393d580efd7b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:04.732339 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-a6b29fc7-9947-4c9a-a6bd-393d580efd7b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] HTTP exception thrown: Instance 031562b2-3cba-4579-b357-318660a6161b could not be found. Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a6b29fc7-9947-4c9a-a6bd-393d580efd7b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Request method failure captured: Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/031562b2-3cba-4579-b357-318660a6161b HTTP/1.1 Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mZrFmv2tqSUvHHnTW6nUkrh4a1Lvl-EAPcffnboG81pceusXzXvguP1TXNMzJ-geIacOU4Vh2mo89ih0CivhAPQF9ZkO--5bCOq-J3szB0ROBtIC_dJAZtqIX15RqdJDTf_dIKPZAowmrkWSA_PpmAtc-dsPxA1jeeiQddLUQoBJqY Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 6ec3ffdc362b4d61b65d798f9b3c193a Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ServersTestJSON-1602693956 Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6ec3ffdc362b4d61b65d798f9b3c193a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ServersTestJSON-1602693956 Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 6ec3ffdc362b4d61b65d798f9b3c193a Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ServersTestJSON-1602693956 Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ServersTestJSON-1602693956-project Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: a9df268b1a6e410384274d5579d308ba Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ServersTestJSON-1602693956-project Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 031562b2-3cba-4579-b357-318660a6161b could not be found. Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '031562b2-3cba-4579-b357-318660a6161b'} Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 031562b2-3cba-4579-b357-318660a6161b could not be found. Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 031562b2-3cba-4579-b357-318660a6161b could not be found. Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:04.739410 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:04.745418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:36:04.745418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:36:04.745418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:36:04.745418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:36:04.745418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 031562b2-3cba-4579-b357-318660a6161b could not be found. Jul 28 10:36:04.745418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:04.758031 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a6b29fc7-9947-4c9a-a6bd-393d580efd7b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Returning 404 to user: Instance 031562b2-3cba-4579-b357-318660a6161b could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:36:04.759159 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a6b29fc7-9947-4c9a-a6bd-393d580efd7b tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "GET /compute/v2.1/servers/031562b2-3cba-4579-b357-318660a6161b" status: 404 len: 111 microversion: 2.1 time: 0.100332 Jul 28 10:36:04.762044 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 432/830] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:36:04 2022] GET /compute/v2.1/servers/031562b2-3cba-4579-b357-318660a6161b => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:36:04.776760 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e57af07a-482b-44d9-b62e-a5887ae6436e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:04.777463 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-e57af07a-482b-44d9-b62e-a5887ae6436e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:04.804616 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e57af07a-482b-44d9-b62e-a5887ae6436e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:04.806943 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e57af07a-482b-44d9-b62e-a5887ae6436e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:04.813234 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e57af07a-482b-44d9-b62e-a5887ae6436e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:04.813234 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e57af07a-482b-44d9-b62e-a5887ae6436e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:04.853671 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-e57af07a-482b-44d9-b62e-a5887ae6436e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] HTTP exception thrown: Instance 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 could not be found. Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e57af07a-482b-44d9-b62e-a5887ae6436e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Request method failure captured: Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: request: DELETE /compute/v2.1/servers/0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 HTTP/1.1 Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mZrFmv2tqSUvHHnTW6nUkrh4a1Lvl-EAPcffnboG81pceusXzXvguP1TXNMzJ-geIacOU4Vh2mo89ih0CivhAPQF9ZkO--5bCOq-J3szB0ROBtIC_dJAZtqIX15RqdJDTf_dIKPZAowmrkWSA_PpmAtc-dsPxA1jeeiQddLUQoBJqY Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 6ec3ffdc362b4d61b65d798f9b3c193a Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServersTestJSON-1602693956 Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6ec3ffdc362b4d61b65d798f9b3c193a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServersTestJSON-1602693956 Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 6ec3ffdc362b4d61b65d798f9b3c193a Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServersTestJSON-1602693956 Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServersTestJSON-1602693956-project Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: a9df268b1a6e410384274d5579d308ba Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServersTestJSON-1602693956-project Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 could not be found. Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '0b97959b-8e7d-4e35-8a95-e11eb27b5aa0'} Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 could not be found. Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:36:04.856029 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 could not be found. Jul 28 10:36:04.861121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:36:04.861121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:36:04.861121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:36:04.861121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:04.861121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:36:04.861121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:36:04.861121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:36:04.861121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:36:04.861121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 could not be found. Jul 28 10:36:04.861121 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:36:04.861121 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e57af07a-482b-44d9-b62e-a5887ae6436e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Returning 404 to user: Instance 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:36:04.861121 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e57af07a-482b-44d9-b62e-a5887ae6436e tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0b97959b-8e7d-4e35-8a95-e11eb27b5aa0" status: 404 len: 111 microversion: 2.1 time: 0.089337 Jul 28 10:36:04.861121 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 399/831] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:36:04 2022] DELETE /compute/v2.1/servers/0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:36:04.869771 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d35a4818-4b91-42f4-bac4-11ddc080a1aa tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:04.870875 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-d35a4818-4b91-42f4-bac4-11ddc080a1aa tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] [instance: 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:04.880049 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d35a4818-4b91-42f4-bac4-11ddc080a1aa tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:04.880676 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d35a4818-4b91-42f4-bac4-11ddc080a1aa tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:04.881620 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d35a4818-4b91-42f4-bac4-11ddc080a1aa tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:04.882193 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d35a4818-4b91-42f4-bac4-11ddc080a1aa tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:04.899246 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-d35a4818-4b91-42f4-bac4-11ddc080a1aa tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] HTTP exception thrown: Instance 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 could not be found. Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d35a4818-4b91-42f4-bac4-11ddc080a1aa tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Request method failure captured: Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 HTTP/1.1 Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mZrFmv2tqSUvHHnTW6nUkrh4a1Lvl-EAPcffnboG81pceusXzXvguP1TXNMzJ-geIacOU4Vh2mo89ih0CivhAPQF9ZkO--5bCOq-J3szB0ROBtIC_dJAZtqIX15RqdJDTf_dIKPZAowmrkWSA_PpmAtc-dsPxA1jeeiQddLUQoBJqY Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 6ec3ffdc362b4d61b65d798f9b3c193a Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ServersTestJSON-1602693956 Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ec3ffdc362b4d61b65d798f9b3c193a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6ec3ffdc362b4d61b65d798f9b3c193a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ServersTestJSON-1602693956 Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 6ec3ffdc362b4d61b65d798f9b3c193a Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ServersTestJSON-1602693956 Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ServersTestJSON-1602693956-project Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: a9df268b1a6e410384274d5579d308ba Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ServersTestJSON-1602693956-project Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 could not be found. Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '0b97959b-8e7d-4e35-8a95-e11eb27b5aa0'} Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 could not be found. Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 could not be found. Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:04.900815 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:04.906078 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:36:04.906078 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:36:04.906078 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:36:04.906078 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:36:04.906078 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 could not be found. Jul 28 10:36:04.906078 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:04.906078 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d35a4818-4b91-42f4-bac4-11ddc080a1aa tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] Returning 404 to user: Instance 0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:36:04.906078 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-d35a4818-4b91-42f4-bac4-11ddc080a1aa tempest-ServersTestJSON-1602693956 tempest-ServersTestJSON-1602693956-project] 10.222.0.46 "GET /compute/v2.1/servers/0b97959b-8e7d-4e35-8a95-e11eb27b5aa0" status: 404 len: 111 microversion: 2.1 time: 0.038595 Jul 28 10:36:04.908378 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 433/832] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:36:04 2022] GET /compute/v2.1/servers/0b97959b-8e7d-4e35-8a95-e11eb27b5aa0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:36:05.442592 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2010496528", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "2cc8730b-afcb-462e-8a5d-38d29c610a2f"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:36:05.562806 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] validate_networks() for [('2cc8730b-afcb-462e-8a5d-38d29c610a2f', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:36:07.181530 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:36:07.183425 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:36:07.185922 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:36:07.186823 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:36:07.187493 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:36:07.246401 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:07.257402 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:07.268074 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:07.269076 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:07.296034 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Getting quotas for project 0c7f104b4ad045219099081a4e9b6cef. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:36:07.310012 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Getting quotas for user afee1ee9673b4adba7ddd853227d0b29 and project 0c7f104b4ad045219099081a4e9b6cef. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:36:07.351273 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:36:07.395677 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] [instance: 552fee3f-3b45-4afd-95d4-b7f65f9c64ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:36:07.593265 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-67903917-4f7f-4d1e-8743-ba00107ee46e tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.454432 Jul 28 10:36:07.600197 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 400/833] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:36:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:36:07.606318 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-744746ec-5da9-44d0-8295-9f5e22a38504 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:07.606899 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-744746ec-5da9-44d0-8295-9f5e22a38504 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] [instance: 552fee3f-3b45-4afd-95d4-b7f65f9c64ef] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:07.987110 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-744746ec-5da9-44d0-8295-9f5e22a38504 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afee1ee9673b4adba7ddd853227d0b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f104b4ad045219099081a4e9b6cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:36:08.002318 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-744746ec-5da9-44d0-8295-9f5e22a38504 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] 10.222.0.46 "GET /compute/v2.1/servers/552fee3f-3b45-4afd-95d4-b7f65f9c64ef" status: 200 len: 1224 microversion: 2.1 time: 0.395588 Jul 28 10:36:08.021881 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 434/834] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:36:07 2022] GET /compute/v2.1/servers/552fee3f-3b45-4afd-95d4-b7f65f9c64ef => generated 1224 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:36:09.030336 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3d62596e-bc1d-4d1a-bd7e-2c33ca0e118b tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:09.031332 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3d62596e-bc1d-4d1a-bd7e-2c33ca0e118b tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] [instance: 552fee3f-3b45-4afd-95d4-b7f65f9c64ef] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:09.056303 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3d62596e-bc1d-4d1a-bd7e-2c33ca0e118b tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:09.057061 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3d62596e-bc1d-4d1a-bd7e-2c33ca0e118b tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:09.061956 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3d62596e-bc1d-4d1a-bd7e-2c33ca0e118b tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:09.062746 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3d62596e-bc1d-4d1a-bd7e-2c33ca0e118b tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:09.147343 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3d62596e-bc1d-4d1a-bd7e-2c33ca0e118b tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:09.152303 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3d62596e-bc1d-4d1a-bd7e-2c33ca0e118b tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:09.153389 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-3d62596e-bc1d-4d1a-bd7e-2c33ca0e118b tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lazy-loading 'fault' on Instance uuid 552fee3f-3b45-4afd-95d4-b7f65f9c64ef {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:36:09.300450 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-3d62596e-bc1d-4d1a-bd7e-2c33ca0e118b tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afee1ee9673b4adba7ddd853227d0b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f104b4ad045219099081a4e9b6cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:36:09.322238 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3d62596e-bc1d-4d1a-bd7e-2c33ca0e118b tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] 10.222.0.46 "GET /compute/v2.1/servers/552fee3f-3b45-4afd-95d4-b7f65f9c64ef" status: 200 len: 1297 microversion: 2.1 time: 0.296297 Jul 28 10:36:09.350685 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-07d6006e-be74-4900-8784-cc0344580cf3 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:09.352266 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-07d6006e-be74-4900-8784-cc0344580cf3 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] [instance: 552fee3f-3b45-4afd-95d4-b7f65f9c64ef] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:09.352554 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 401/835] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:36:09 2022] GET /compute/v2.1/servers/552fee3f-3b45-4afd-95d4-b7f65f9c64ef => generated 1297 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:36:09.369359 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-07d6006e-be74-4900-8784-cc0344580cf3 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:09.370652 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-07d6006e-be74-4900-8784-cc0344580cf3 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:09.372421 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-07d6006e-be74-4900-8784-cc0344580cf3 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:09.373968 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-07d6006e-be74-4900-8784-cc0344580cf3 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:09.413203 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-07d6006e-be74-4900-8784-cc0344580cf3 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] [instance: 552fee3f-3b45-4afd-95d4-b7f65f9c64ef] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:36:09.504922 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-07d6006e-be74-4900-8784-cc0344580cf3 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] [instance: 552fee3f-3b45-4afd-95d4-b7f65f9c64ef] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:36:09.510054 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-07d6006e-be74-4900-8784-cc0344580cf3 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:09.510534 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-07d6006e-be74-4900-8784-cc0344580cf3 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:09.510994 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-07d6006e-be74-4900-8784-cc0344580cf3 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] [instance: 552fee3f-3b45-4afd-95d4-b7f65f9c64ef] instance's host None is down, deleting from database Jul 28 10:36:09.521899 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-07d6006e-be74-4900-8784-cc0344580cf3 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] [instance: 552fee3f-3b45-4afd-95d4-b7f65f9c64ef] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:36:10.289840 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-07d6006e-be74-4900-8784-cc0344580cf3 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] [instance: 552fee3f-3b45-4afd-95d4-b7f65f9c64ef] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:36:10.299261 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-07d6006e-be74-4900-8784-cc0344580cf3 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] [instance: 552fee3f-3b45-4afd-95d4-b7f65f9c64ef] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:36:10.612181 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=75,nova_cell0:UPDATE=19,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:10.733378 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-07d6006e-be74-4900-8784-cc0344580cf3 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] 10.222.0.46 "DELETE /compute/v2.1/servers/552fee3f-3b45-4afd-95d4-b7f65f9c64ef" status: 204 len: 0 microversion: 2.1 time: 1.390448 Jul 28 10:36:10.734707 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 435/836] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:36:09 2022] DELETE /compute/v2.1/servers/552fee3f-3b45-4afd-95d4-b7f65f9c64ef => generated 0 bytes in 1392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:36:10.743526 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5be3a3be-3138-40cf-8c59-9543eb470418 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:10.744390 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-5be3a3be-3138-40cf-8c59-9543eb470418 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] [instance: 552fee3f-3b45-4afd-95d4-b7f65f9c64ef] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:10.755503 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5be3a3be-3138-40cf-8c59-9543eb470418 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:10.755978 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5be3a3be-3138-40cf-8c59-9543eb470418 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:10.756749 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5be3a3be-3138-40cf-8c59-9543eb470418 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:10.757191 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5be3a3be-3138-40cf-8c59-9543eb470418 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:10.796431 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-5be3a3be-3138-40cf-8c59-9543eb470418 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] HTTP exception thrown: Instance 552fee3f-3b45-4afd-95d4-b7f65f9c64ef could not be found. Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5be3a3be-3138-40cf-8c59-9543eb470418 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Request method failure captured: Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/552fee3f-3b45-4afd-95d4-b7f65f9c64ef HTTP/1.1 Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4maUSU8ugrXT9LWBTYY7PevHAUh46LxKwMp51pIe6B3LqNrqofalfs0Pj7S5b7Jq9u2c_Vdo_8tnOnhjDNb4XZ85pFCMcI5d-RH75oV_NJv5O4jt8lSupDVAt9PbbAJjjnJxTQkdKSUUO2M8QaWexo_9qyhniLqJfx-pFeoeJBZ9zsc Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 0c7f104b4ad045219099081a4e9b6cef Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-261320953 Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c7f104b4ad045219099081a4e9b6cef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c7f104b4ad045219099081a4e9b6cef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c7f104b4ad045219099081a4e9b6cef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c7f104b4ad045219099081a4e9b6cef", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-261320953 Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 0c7f104b4ad045219099081a4e9b6cef Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-261320953 Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServerMetadataNegativeTestJSON-261320953-project Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: afee1ee9673b4adba7ddd853227d0b29 Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-261320953-project Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 552fee3f-3b45-4afd-95d4-b7f65f9c64ef could not be found. Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '552fee3f-3b45-4afd-95d4-b7f65f9c64ef'} Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 552fee3f-3b45-4afd-95d4-b7f65f9c64ef could not be found. Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 552fee3f-3b45-4afd-95d4-b7f65f9c64ef could not be found. Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:36:10.798135 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:36:10.805762 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:36:10.805762 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:10.805762 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:36:10.805762 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:36:10.805762 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:36:10.805762 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:36:10.805762 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 552fee3f-3b45-4afd-95d4-b7f65f9c64ef could not be found. Jul 28 10:36:10.805762 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:36:10.805762 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5be3a3be-3138-40cf-8c59-9543eb470418 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] Returning 404 to user: Instance 552fee3f-3b45-4afd-95d4-b7f65f9c64ef could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:36:10.805762 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-5be3a3be-3138-40cf-8c59-9543eb470418 tempest-ServerMetadataNegativeTestJSON-261320953 tempest-ServerMetadataNegativeTestJSON-261320953-project] 10.222.0.46 "GET /compute/v2.1/servers/552fee3f-3b45-4afd-95d4-b7f65f9c64ef" status: 404 len: 111 microversion: 2.1 time: 0.062517 Jul 28 10:36:10.805762 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 402/837] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:36:10 2022] GET /compute/v2.1/servers/552fee3f-3b45-4afd-95d4-b7f65f9c64ef => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:36:18.499828 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=3 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:18.503034 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=15 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:19.195230 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-77d13164-15e2-48e1-bae4-32a1fc7c0fa7 tempest-FloatingIPDetailsTestJSON-492106165 tempest-FloatingIPDetailsTestJSON-492106165-project] Action: 'create', calling method: .version_select at 0x7fa94bc00550>, body: {"pool": null} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:36:20.581478 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:22.980038 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-630324486", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "137b904a-b2de-46cf-add0-4f5a04d11422"}, {"uuid": "68dfd00e-270e-49d4-b96b-0d6fe6745bc2"}, {"uuid": "137b904a-b2de-46cf-add0-4f5a04d11422"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:36:23.006190 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:23.006899 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=15 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:23.013188 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:23.013939 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:UPDATE=29,nova_cell0:SELECT=52,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:23.158139 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] validate_networks() for [('137b904a-b2de-46cf-add0-4f5a04d11422', None, None, None, None, None), ('68dfd00e-270e-49d4-b96b-0d6fe6745bc2', None, None, None, None, None), ('137b904a-b2de-46cf-add0-4f5a04d11422', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:36:25.330177 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-77d13164-15e2-48e1-bae4-32a1fc7c0fa7 tempest-FloatingIPDetailsTestJSON-492106165 tempest-FloatingIPDetailsTestJSON-492106165-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.848864 Jul 28 10:36:25.330781 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 436/838] 10.222.0.46 () {60 vars in 1170 bytes} [Thu Jul 28 10:36:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:36:25.886274 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-97587995", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:36:26.026524 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] validate_networks() for [('37786d3e-418e-4890-91b8-90ad448274bd', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:36:27.762202 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:36:27.763001 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:36:27.764074 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:36:27.765349 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:36:27.766190 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:36:27.788930 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:27.789512 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:27.790566 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:27.791167 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:27.826026 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Getting quotas for project 21c093e2830d4ffbad67848267be4b71. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:36:27.834627 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Getting quotas for user c8daa0fd3d724e9788985e1b72cf4dee and project 21c093e2830d4ffbad67848267be4b71. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:36:27.853246 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:36:27.856648 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] [instance: 4a77e32c-f712-46e0-81d5-8f271a3ec3ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:36:28.007530 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-249254fa-b2da-4244-bde3-f1d159d9e137 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.672891 Jul 28 10:36:28.010025 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 437/839] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:36:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 2678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:36:28.023276 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a988b10f-c8fe-40f5-afb5-e15dcea0db7a tempest-FloatingIPDetailsTestJSON-492106165 tempest-FloatingIPDetailsTestJSON-492106165-project] Action: 'create', calling method: .version_select at 0x7fa94b99faf0>, body: {"pool": null} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:36:28.505508 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:36:28.506195 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:36:28.506369 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:36:28.506893 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:36:28.507176 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:36:28.524504 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:28.528457 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:28.534328 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:28.534960 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:28.583946 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Getting quotas for project c9985f08d1d548328c197f02f309dfa8. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:36:28.591894 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Getting quotas for user ba4a9bc552b945258ebed85cd96345c7 and project c9985f08d1d548328c197f02f309dfa8. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:36:28.608649 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:36:28.612069 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 2477dc41-9f32-4643-bf36-eeddb82116a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:36:28.693623 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b675a3b5-350a-481f-bf97-f2c45475c157 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.721006 Jul 28 10:36:28.696956 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 403/840] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:36:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 5727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 10:36:29.387387 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-de782ee0-bd9c-4ebb-82e4-a998a302b40a tempest-ExtensionsTest-1262588306 tempest-ExtensionsTest-1262588306-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:29.389588 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-de782ee0-bd9c-4ebb-82e4-a998a302b40a tempest-ExtensionsTest-1262588306 tempest-ExtensionsTest-1262588306-project] 10.222.0.46 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.691004 Jul 28 10:36:29.390653 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 404/841] 10.222.0.46 () {58 vars in 1170 bytes} [Thu Jul 28 10:36:28 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:36:29.408844 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f8ba7933-307c-4f10-9678-f25b25461b3a tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:29.415532 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f8ba7933-307c-4f10-9678-f25b25461b3a tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] [instance: 4a77e32c-f712-46e0-81d5-8f271a3ec3ce] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:29.435827 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f8ba7933-307c-4f10-9678-f25b25461b3a tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:29.441400 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f8ba7933-307c-4f10-9678-f25b25461b3a tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:29.442873 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f8ba7933-307c-4f10-9678-f25b25461b3a tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:29.444149 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f8ba7933-307c-4f10-9678-f25b25461b3a tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:29.556879 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f8ba7933-307c-4f10-9678-f25b25461b3a tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:29.557506 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f8ba7933-307c-4f10-9678-f25b25461b3a tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:29.562876 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-f8ba7933-307c-4f10-9678-f25b25461b3a tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lazy-loading 'fault' on Instance uuid 4a77e32c-f712-46e0-81d5-8f271a3ec3ce {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:36:29.886475 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-f8ba7933-307c-4f10-9678-f25b25461b3a tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8daa0fd3d724e9788985e1b72cf4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c093e2830d4ffbad67848267be4b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:36:29.905528 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f8ba7933-307c-4f10-9678-f25b25461b3a tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] 10.222.0.46 "GET /compute/v2.1/servers/4a77e32c-f712-46e0-81d5-8f271a3ec3ce" status: 200 len: 1285 microversion: 2.1 time: 0.510475 Jul 28 10:36:29.909505 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 405/842] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:36:29 2022] GET /compute/v2.1/servers/4a77e32c-f712-46e0-81d5-8f271a3ec3ce => generated 1285 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:36:29.923689 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5ecb3adb-0391-46e9-b51a-9190bad38cf1 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:29.929272 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-5ecb3adb-0391-46e9-b51a-9190bad38cf1 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 2477dc41-9f32-4643-bf36-eeddb82116a9] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:29.945448 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5ecb3adb-0391-46e9-b51a-9190bad38cf1 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:29.949067 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5ecb3adb-0391-46e9-b51a-9190bad38cf1 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:29.951781 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5ecb3adb-0391-46e9-b51a-9190bad38cf1 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:29.952603 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5ecb3adb-0391-46e9-b51a-9190bad38cf1 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:30.086693 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5ecb3adb-0391-46e9-b51a-9190bad38cf1 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:30.087263 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5ecb3adb-0391-46e9-b51a-9190bad38cf1 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:30.087737 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-5ecb3adb-0391-46e9-b51a-9190bad38cf1 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lazy-loading 'fault' on Instance uuid 2477dc41-9f32-4643-bf36-eeddb82116a9 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:36:30.260843 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-5ecb3adb-0391-46e9-b51a-9190bad38cf1 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4a9bc552b945258ebed85cd96345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9985f08d1d548328c197f02f309dfa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:36:30.268660 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-5ecb3adb-0391-46e9-b51a-9190bad38cf1 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] 10.222.0.46 "GET /compute/v2.1/servers/2477dc41-9f32-4643-bf36-eeddb82116a9" status: 200 len: 1285 microversion: 2.1 time: 0.357870 Jul 28 10:36:30.273495 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 406/843] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:36:29 2022] GET /compute/v2.1/servers/2477dc41-9f32-4643-bf36-eeddb82116a9 => generated 1285 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:36:30.302310 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-fc1d36c3-eba2-4b9a-9666-12336ef188b2 tempest-ExtensionsTest-1262588306 tempest-ExtensionsTest-1262588306-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:30.304835 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-fc1d36c3-eba2-4b9a-9666-12336ef188b2 tempest-ExtensionsTest-1262588306 tempest-ExtensionsTest-1262588306-project] 10.222.0.46 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.030171 Jul 28 10:36:30.306230 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 407/844] 10.222.0.46 () {58 vars in 1134 bytes} [Thu Jul 28 10:36:30 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:36:30.927050 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a038daf9-9178-46d9-99c6-fedb997029ff tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:30.928963 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-a038daf9-9178-46d9-99c6-fedb997029ff tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] [instance: 4a77e32c-f712-46e0-81d5-8f271a3ec3ce] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:30.947169 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a038daf9-9178-46d9-99c6-fedb997029ff tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:30.948948 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a038daf9-9178-46d9-99c6-fedb997029ff tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:30.950046 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a038daf9-9178-46d9-99c6-fedb997029ff tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:30.955450 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a038daf9-9178-46d9-99c6-fedb997029ff tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:31.089739 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a038daf9-9178-46d9-99c6-fedb997029ff tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:31.090270 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a038daf9-9178-46d9-99c6-fedb997029ff tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:31.090723 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-a038daf9-9178-46d9-99c6-fedb997029ff tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lazy-loading 'fault' on Instance uuid 4a77e32c-f712-46e0-81d5-8f271a3ec3ce {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:36:31.352532 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-a038daf9-9178-46d9-99c6-fedb997029ff tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8daa0fd3d724e9788985e1b72cf4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c093e2830d4ffbad67848267be4b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:36:31.361020 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a038daf9-9178-46d9-99c6-fedb997029ff tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] 10.222.0.46 "GET /compute/v2.1/servers/4a77e32c-f712-46e0-81d5-8f271a3ec3ce" status: 200 len: 1285 microversion: 2.1 time: 0.438191 Jul 28 10:36:31.361608 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 408/845] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:36:30 2022] GET /compute/v2.1/servers/4a77e32c-f712-46e0-81d5-8f271a3ec3ce => generated 1285 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:36:31.385323 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-54ab1350-f2a8-4d18-8b52-974f08c88add tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:31.388539 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-54ab1350-f2a8-4d18-8b52-974f08c88add tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 2477dc41-9f32-4643-bf36-eeddb82116a9] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:31.408808 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-54ab1350-f2a8-4d18-8b52-974f08c88add tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:31.411466 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-54ab1350-f2a8-4d18-8b52-974f08c88add tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:31.425907 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-54ab1350-f2a8-4d18-8b52-974f08c88add tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:31.427776 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-54ab1350-f2a8-4d18-8b52-974f08c88add tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:31.519789 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-54ab1350-f2a8-4d18-8b52-974f08c88add tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:31.527588 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-54ab1350-f2a8-4d18-8b52-974f08c88add tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:31.528720 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-54ab1350-f2a8-4d18-8b52-974f08c88add tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lazy-loading 'fault' on Instance uuid 2477dc41-9f32-4643-bf36-eeddb82116a9 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:36:31.772765 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-54ab1350-f2a8-4d18-8b52-974f08c88add tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4a9bc552b945258ebed85cd96345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9985f08d1d548328c197f02f309dfa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:36:31.789900 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-54ab1350-f2a8-4d18-8b52-974f08c88add tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] 10.222.0.46 "GET /compute/v2.1/servers/2477dc41-9f32-4643-bf36-eeddb82116a9" status: 200 len: 1285 microversion: 2.1 time: 0.416185 Jul 28 10:36:31.804287 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 409/846] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:36:31 2022] GET /compute/v2.1/servers/2477dc41-9f32-4643-bf36-eeddb82116a9 => generated 1285 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:36:31.821219 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6fd7911a-51a3-4422-9807-7a522dc50b23 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:31.823913 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-6fd7911a-51a3-4422-9807-7a522dc50b23 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] [instance: 4a77e32c-f712-46e0-81d5-8f271a3ec3ce] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:31.841342 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6fd7911a-51a3-4422-9807-7a522dc50b23 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:31.842150 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6fd7911a-51a3-4422-9807-7a522dc50b23 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:31.844861 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6fd7911a-51a3-4422-9807-7a522dc50b23 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:31.847485 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6fd7911a-51a3-4422-9807-7a522dc50b23 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:31.907797 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-6fd7911a-51a3-4422-9807-7a522dc50b23 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] [instance: 4a77e32c-f712-46e0-81d5-8f271a3ec3ce] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:36:32.028297 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-6fd7911a-51a3-4422-9807-7a522dc50b23 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] [instance: 4a77e32c-f712-46e0-81d5-8f271a3ec3ce] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:36:32.030480 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6fd7911a-51a3-4422-9807-7a522dc50b23 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:32.031244 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6fd7911a-51a3-4422-9807-7a522dc50b23 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:32.031849 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-6fd7911a-51a3-4422-9807-7a522dc50b23 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] [instance: 4a77e32c-f712-46e0-81d5-8f271a3ec3ce] instance's host None is down, deleting from database Jul 28 10:36:32.062387 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-6fd7911a-51a3-4422-9807-7a522dc50b23 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] [instance: 4a77e32c-f712-46e0-81d5-8f271a3ec3ce] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:36:32.205021 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-6fd7911a-51a3-4422-9807-7a522dc50b23 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] [instance: 4a77e32c-f712-46e0-81d5-8f271a3ec3ce] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:36:32.230767 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-6fd7911a-51a3-4422-9807-7a522dc50b23 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] [instance: 4a77e32c-f712-46e0-81d5-8f271a3ec3ce] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:36:32.594770 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6fd7911a-51a3-4422-9807-7a522dc50b23 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4a77e32c-f712-46e0-81d5-8f271a3ec3ce" status: 204 len: 0 microversion: 2.1 time: 0.785117 Jul 28 10:36:32.601362 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 410/847] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:36:31 2022] DELETE /compute/v2.1/servers/4a77e32c-f712-46e0-81d5-8f271a3ec3ce => generated 0 bytes in 788 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:36:32.612818 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ebc434eb-844c-4a18-8034-f783cdc5948a tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:32.613334 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ebc434eb-844c-4a18-8034-f783cdc5948a tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 2477dc41-9f32-4643-bf36-eeddb82116a9] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:32.628956 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ebc434eb-844c-4a18-8034-f783cdc5948a tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:32.629946 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ebc434eb-844c-4a18-8034-f783cdc5948a tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:32.635050 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ebc434eb-844c-4a18-8034-f783cdc5948a tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:32.636584 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ebc434eb-844c-4a18-8034-f783cdc5948a tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:32.706159 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ebc434eb-844c-4a18-8034-f783cdc5948a tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 2477dc41-9f32-4643-bf36-eeddb82116a9] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:36:32.786573 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a988b10f-c8fe-40f5-afb5-e15dcea0db7a tempest-FloatingIPDetailsTestJSON-492106165 tempest-FloatingIPDetailsTestJSON-492106165-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.774744 Jul 28 10:36:32.801374 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 438/848] 10.222.0.46 () {60 vars in 1170 bytes} [Thu Jul 28 10:36:28 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:36:32.907430 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ebc434eb-844c-4a18-8034-f783cdc5948a tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 2477dc41-9f32-4643-bf36-eeddb82116a9] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:36:32.908493 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ebc434eb-844c-4a18-8034-f783cdc5948a tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:32.908906 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ebc434eb-844c-4a18-8034-f783cdc5948a tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:32.909361 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-ebc434eb-844c-4a18-8034-f783cdc5948a tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 2477dc41-9f32-4643-bf36-eeddb82116a9] instance's host None is down, deleting from database Jul 28 10:36:32.923824 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-ebc434eb-844c-4a18-8034-f783cdc5948a tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 2477dc41-9f32-4643-bf36-eeddb82116a9] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:36:33.176542 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ffd087b0-daa6-4fae-9012-4cb787a0eb43 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1341072631", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": "none"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:36:33.282269 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ffd087b0-daa6-4fae-9012-4cb787a0eb43 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:36:33.283007 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ffd087b0-daa6-4fae-9012-4cb787a0eb43 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:36:33.283688 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ffd087b0-daa6-4fae-9012-4cb787a0eb43 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:36:33.284289 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ffd087b0-daa6-4fae-9012-4cb787a0eb43 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:36:33.284889 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ffd087b0-daa6-4fae-9012-4cb787a0eb43 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:36:33.302980 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ffd087b0-daa6-4fae-9012-4cb787a0eb43 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:33.306444 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ffd087b0-daa6-4fae-9012-4cb787a0eb43 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:33.307756 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ffd087b0-daa6-4fae-9012-4cb787a0eb43 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:33.309277 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ffd087b0-daa6-4fae-9012-4cb787a0eb43 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:33.315638 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-ebc434eb-844c-4a18-8034-f783cdc5948a tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 2477dc41-9f32-4643-bf36-eeddb82116a9] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:36:33.323664 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-ebc434eb-844c-4a18-8034-f783cdc5948a tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 2477dc41-9f32-4643-bf36-eeddb82116a9] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:36:33.364000 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-ffd087b0-daa6-4fae-9012-4cb787a0eb43 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Getting quotas for project 80f0dd82bb254c0c9d3394de5360fe3d. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:36:33.377478 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-ffd087b0-daa6-4fae-9012-4cb787a0eb43 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Getting quotas for user ee1b28b3b77a4b94800d0459b1461b4c and project 80f0dd82bb254c0c9d3394de5360fe3d. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:36:33.427119 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ffd087b0-daa6-4fae-9012-4cb787a0eb43 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:36:33.433285 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ffd087b0-daa6-4fae-9012-4cb787a0eb43 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] [instance: bde886b4-d0ef-415c-a281-944033f19ff8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:36:33.482218 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=76,nova_cell0:UPDATE=18,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:33.528947 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ffd087b0-daa6-4fae-9012-4cb787a0eb43 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.712849 Jul 28 10:36:33.537767 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 439/849] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Jul 28 10:36:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 10:36:33.544299 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ac680294-8d62-42bb-9066-34d577c50889 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:33.545259 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ac680294-8d62-42bb-9066-34d577c50889 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] [instance: 4a77e32c-f712-46e0-81d5-8f271a3ec3ce] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:33.556613 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ac680294-8d62-42bb-9066-34d577c50889 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:33.557853 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ac680294-8d62-42bb-9066-34d577c50889 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:33.559512 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ac680294-8d62-42bb-9066-34d577c50889 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:33.559718 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ac680294-8d62-42bb-9066-34d577c50889 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:33.627771 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-ac680294-8d62-42bb-9066-34d577c50889 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] HTTP exception thrown: Instance 4a77e32c-f712-46e0-81d5-8f271a3ec3ce could not be found. Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ac680294-8d62-42bb-9066-34d577c50889 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Request method failure captured: Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/4a77e32c-f712-46e0-81d5-8f271a3ec3ce HTTP/1.1 Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4man54miGI5qNjzeoYUZSzVoNIuxeLUf-vmkfw4ZrWHV9wfaUpnJ8Qi-pC1rlGJeezOu9fF7krzq-AOUEs6MyZAO93TlPsjdx2kAYgd4KJmHQJ-vKzObQ5pMwZEjUBGMjQEXk6EyKeSUeCLGbPoEfpgekHJRTCWgSIiUsvv9cXxYg2s Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 21c093e2830d4ffbad67848267be4b71 Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ServerRescueTestJSON-1425904236 Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/21c093e2830d4ffbad67848267be4b71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/21c093e2830d4ffbad67848267be4b71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/21c093e2830d4ffbad67848267be4b71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_21c093e2830d4ffbad67848267be4b71", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ServerRescueTestJSON-1425904236 Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 21c093e2830d4ffbad67848267be4b71 Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ServerRescueTestJSON-1425904236 Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ServerRescueTestJSON-1425904236-project Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: c8daa0fd3d724e9788985e1b72cf4dee Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ServerRescueTestJSON-1425904236-project Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 4a77e32c-f712-46e0-81d5-8f271a3ec3ce could not be found. Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '4a77e32c-f712-46e0-81d5-8f271a3ec3ce'} Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a77e32c-f712-46e0-81d5-8f271a3ec3ce could not be found. Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a77e32c-f712-46e0-81d5-8f271a3ec3ce could not be found. Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:36:33.637069 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:33.653606 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:33.653606 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:36:33.653606 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:36:33.653606 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:36:33.653606 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:36:33.653606 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a77e32c-f712-46e0-81d5-8f271a3ec3ce could not be found. Jul 28 10:36:33.653606 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:33.662895 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ac680294-8d62-42bb-9066-34d577c50889 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] Returning 404 to user: Instance 4a77e32c-f712-46e0-81d5-8f271a3ec3ce could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:36:33.665151 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ac680294-8d62-42bb-9066-34d577c50889 tempest-ServerRescueTestJSON-1425904236 tempest-ServerRescueTestJSON-1425904236-project] 10.222.0.46 "GET /compute/v2.1/servers/4a77e32c-f712-46e0-81d5-8f271a3ec3ce" status: 404 len: 111 microversion: 2.1 time: 0.125998 Jul 28 10:36:33.671118 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 440/850] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:36:33 2022] GET /compute/v2.1/servers/4a77e32c-f712-46e0-81d5-8f271a3ec3ce => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:36:33.680332 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c4de6f3f-90d3-473c-953e-837c45dd1527 tempest-FloatingIPDetailsTestJSON-492106165 tempest-FloatingIPDetailsTestJSON-492106165-project] Action: 'create', calling method: .version_select at 0x7fa94b9e7f70>, body: {"pool": null} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:36:33.874459 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ebc434eb-844c-4a18-8034-f783cdc5948a tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2477dc41-9f32-4643-bf36-eeddb82116a9" status: 204 len: 0 microversion: 2.1 time: 1.271799 Jul 28 10:36:33.876464 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 411/851] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:36:32 2022] DELETE /compute/v2.1/servers/2477dc41-9f32-4643-bf36-eeddb82116a9 => generated 0 bytes in 1275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:36:33.887774 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7d7241bb-a9fb-47e0-8461-851abc9826a6 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:33.888397 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-7d7241bb-a9fb-47e0-8461-851abc9826a6 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] [instance: bde886b4-d0ef-415c-a281-944033f19ff8] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:34.179209 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-7d7241bb-a9fb-47e0-8461-851abc9826a6 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1b28b3b77a4b94800d0459b1461b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f0dd82bb254c0c9d3394de5360fe3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:36:34.196596 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-7d7241bb-a9fb-47e0-8461-851abc9826a6 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1b28b3b77a4b94800d0459b1461b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f0dd82bb254c0c9d3394de5360fe3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:36:34.198160 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-7d7241bb-a9fb-47e0-8461-851abc9826a6 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1b28b3b77a4b94800d0459b1461b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f0dd82bb254c0c9d3394de5360fe3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:36:34.213139 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-7d7241bb-a9fb-47e0-8461-851abc9826a6 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] 10.222.0.46 "GET /compute/v2.1/servers/bde886b4-d0ef-415c-a281-944033f19ff8" status: 200 len: 1278 microversion: 2.57 time: 0.334302 Jul 28 10:36:34.214062 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 412/852] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:36:33 2022] GET /compute/v2.1/servers/bde886b4-d0ef-415c-a281-944033f19ff8 => generated 1278 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:36:34.248300 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-bfc2379b-2581-43ba-a4ca-48d1a5da9750 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:34.248905 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-bfc2379b-2581-43ba-a4ca-48d1a5da9750 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 2477dc41-9f32-4643-bf36-eeddb82116a9] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:34.281703 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bfc2379b-2581-43ba-a4ca-48d1a5da9750 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:34.284722 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bfc2379b-2581-43ba-a4ca-48d1a5da9750 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:34.292911 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bfc2379b-2581-43ba-a4ca-48d1a5da9750 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:34.293383 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bfc2379b-2581-43ba-a4ca-48d1a5da9750 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:34.360054 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-bfc2379b-2581-43ba-a4ca-48d1a5da9750 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] HTTP exception thrown: Instance 2477dc41-9f32-4643-bf36-eeddb82116a9 could not be found. Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-bfc2379b-2581-43ba-a4ca-48d1a5da9750 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Request method failure captured: Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/2477dc41-9f32-4643-bf36-eeddb82116a9 HTTP/1.1 Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4maakfGgYI5zvChHKrFKa3wMAlQkG9MINyYpsnZZ8enTnps6qIyEpMVmWa9dFThPBS55jcHRLbgVgAbjlmkAqQjEApqznY85fSdeRgQ93ZW4mjATz04CBieLWLQGbwLoW4vdhq-dKLg2elRb7ahRNquJiaCrh7n5MbuhRIQQF6Ik884 Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: c9985f08d1d548328c197f02f309dfa8 Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServersTestMultiNic-1072918470 Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c9985f08d1d548328c197f02f309dfa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c9985f08d1d548328c197f02f309dfa8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c9985f08d1d548328c197f02f309dfa8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c9985f08d1d548328c197f02f309dfa8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServersTestMultiNic-1072918470 Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: c9985f08d1d548328c197f02f309dfa8 Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServersTestMultiNic-1072918470 Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServersTestMultiNic-1072918470-project Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: ba4a9bc552b945258ebed85cd96345c7 Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServersTestMultiNic-1072918470-project Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 2477dc41-9f32-4643-bf36-eeddb82116a9 could not be found. Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '2477dc41-9f32-4643-bf36-eeddb82116a9'} Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2477dc41-9f32-4643-bf36-eeddb82116a9 could not be found. Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2477dc41-9f32-4643-bf36-eeddb82116a9 could not be found. Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:36:34.361649 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:36:34.368987 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:34.368987 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:36:34.368987 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:36:34.368987 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:36:34.368987 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:36:34.368987 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2477dc41-9f32-4643-bf36-eeddb82116a9 could not be found. Jul 28 10:36:34.368987 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:36:34.368987 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-bfc2379b-2581-43ba-a4ca-48d1a5da9750 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Returning 404 to user: Instance 2477dc41-9f32-4643-bf36-eeddb82116a9 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:36:34.368987 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-bfc2379b-2581-43ba-a4ca-48d1a5da9750 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] 10.222.0.46 "GET /compute/v2.1/servers/2477dc41-9f32-4643-bf36-eeddb82116a9" status: 404 len: 111 microversion: 2.1 time: 0.132185 Jul 28 10:36:34.373949 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 413/853] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:36:34 2022] GET /compute/v2.1/servers/2477dc41-9f32-4643-bf36-eeddb82116a9 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:36:35.242461 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-cadc1243-b795-46b5-afc9-ffb423489cbf tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:35.244976 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-cadc1243-b795-46b5-afc9-ffb423489cbf tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] [instance: bde886b4-d0ef-415c-a281-944033f19ff8] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:35.269269 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cadc1243-b795-46b5-afc9-ffb423489cbf tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:35.270455 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cadc1243-b795-46b5-afc9-ffb423489cbf tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:35.273997 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cadc1243-b795-46b5-afc9-ffb423489cbf tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:35.278400 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cadc1243-b795-46b5-afc9-ffb423489cbf tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:35.418889 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cadc1243-b795-46b5-afc9-ffb423489cbf tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:35.419581 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cadc1243-b795-46b5-afc9-ffb423489cbf tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:35.419804 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-cadc1243-b795-46b5-afc9-ffb423489cbf tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lazy-loading 'fault' on Instance uuid bde886b4-d0ef-415c-a281-944033f19ff8 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:36:35.722135 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-cadc1243-b795-46b5-afc9-ffb423489cbf tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1b28b3b77a4b94800d0459b1461b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f0dd82bb254c0c9d3394de5360fe3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:36:35.732743 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-cadc1243-b795-46b5-afc9-ffb423489cbf tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1b28b3b77a4b94800d0459b1461b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f0dd82bb254c0c9d3394de5360fe3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:36:35.743290 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-cadc1243-b795-46b5-afc9-ffb423489cbf tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1b28b3b77a4b94800d0459b1461b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f0dd82bb254c0c9d3394de5360fe3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:36:35.747456 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-cadc1243-b795-46b5-afc9-ffb423489cbf tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] 10.222.0.46 "GET /compute/v2.1/servers/bde886b4-d0ef-415c-a281-944033f19ff8" status: 200 len: 1351 microversion: 2.57 time: 0.511786 Jul 28 10:36:35.772178 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 414/854] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:36:35 2022] GET /compute/v2.1/servers/bde886b4-d0ef-415c-a281-944033f19ff8 => generated 1351 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:36:35.803629 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b826c5eb-11a5-4a75-b21f-29d68bec7cb7 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:35.804516 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b826c5eb-11a5-4a75-b21f-29d68bec7cb7 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] [instance: bde886b4-d0ef-415c-a281-944033f19ff8] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:35.822054 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b826c5eb-11a5-4a75-b21f-29d68bec7cb7 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:35.823300 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b826c5eb-11a5-4a75-b21f-29d68bec7cb7 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:35.824389 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b826c5eb-11a5-4a75-b21f-29d68bec7cb7 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:35.825124 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b826c5eb-11a5-4a75-b21f-29d68bec7cb7 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:35.916235 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b826c5eb-11a5-4a75-b21f-29d68bec7cb7 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] [instance: bde886b4-d0ef-415c-a281-944033f19ff8] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:36:36.372789 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b826c5eb-11a5-4a75-b21f-29d68bec7cb7 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] [instance: bde886b4-d0ef-415c-a281-944033f19ff8] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:36:36.373937 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b826c5eb-11a5-4a75-b21f-29d68bec7cb7 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:36.374584 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b826c5eb-11a5-4a75-b21f-29d68bec7cb7 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:36.375214 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-b826c5eb-11a5-4a75-b21f-29d68bec7cb7 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] [instance: bde886b4-d0ef-415c-a281-944033f19ff8] instance's host None is down, deleting from database Jul 28 10:36:36.380657 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-b826c5eb-11a5-4a75-b21f-29d68bec7cb7 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] [instance: bde886b4-d0ef-415c-a281-944033f19ff8] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:36:36.600163 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-b826c5eb-11a5-4a75-b21f-29d68bec7cb7 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] [instance: bde886b4-d0ef-415c-a281-944033f19ff8] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:36:36.608021 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-b826c5eb-11a5-4a75-b21f-29d68bec7cb7 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] [instance: bde886b4-d0ef-415c-a281-944033f19ff8] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:36:36.968890 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b826c5eb-11a5-4a75-b21f-29d68bec7cb7 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bde886b4-d0ef-415c-a281-944033f19ff8" status: 204 len: 0 microversion: 2.57 time: 1.172447 Jul 28 10:36:36.978983 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 415/855] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:36:35 2022] DELETE /compute/v2.1/servers/bde886b4-d0ef-415c-a281-944033f19ff8 => generated 0 bytes in 1179 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:36:36.999104 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a56b17a8-db38-4211-acfa-206057a29172 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:36.999732 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-a56b17a8-db38-4211-acfa-206057a29172 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] [instance: bde886b4-d0ef-415c-a281-944033f19ff8] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:37.014797 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a56b17a8-db38-4211-acfa-206057a29172 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:37.015248 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a56b17a8-db38-4211-acfa-206057a29172 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:37.016035 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a56b17a8-db38-4211-acfa-206057a29172 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:37.016477 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a56b17a8-db38-4211-acfa-206057a29172 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:37.065168 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-a56b17a8-db38-4211-acfa-206057a29172 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] HTTP exception thrown: Instance bde886b4-d0ef-415c-a281-944033f19ff8 could not be found. Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a56b17a8-db38-4211-acfa-206057a29172 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Request method failure captured: Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/bde886b4-d0ef-415c-a281-944033f19ff8 HTTP/1.1 Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mawpz2CaI_Ww6maoGMNVauoxUj5Z3Gui3R2h6EQkdXZdO6bBv4WjCGbt1lbeGTda7b7HKCIn9_IJqXFT6U3IJXaqeaFnUDsWLRWkRa5T9PfOdTnJJHaR8F_vPFn9-20UUfqNYqCAsqmgAfdCa7wfarizeot3R9IJSQiNlizLLKY_RY Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: X-Openstack-Nova-Api-Version: 2.57 Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 80f0dd82bb254c0c9d3394de5360fe3d Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServerShowV257Test-322055231 Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/80f0dd82bb254c0c9d3394de5360fe3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/80f0dd82bb254c0c9d3394de5360fe3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/80f0dd82bb254c0c9d3394de5360fe3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_80f0dd82bb254c0c9d3394de5360fe3d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServerShowV257Test-322055231 Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 80f0dd82bb254c0c9d3394de5360fe3d Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServerShowV257Test-322055231 Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServerShowV257Test-322055231-project Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: ee1b28b3b77a4b94800d0459b1461b4c Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServerShowV257Test-322055231-project Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance bde886b4-d0ef-415c-a281-944033f19ff8 could not be found. Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'bde886b4-d0ef-415c-a281-944033f19ff8'} Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bde886b4-d0ef-415c-a281-944033f19ff8 could not be found. Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bde886b4-d0ef-415c-a281-944033f19ff8 could not be found. Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:36:37.077261 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:36:37.081804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:37.081804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:36:37.081804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:36:37.081804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:36:37.081804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:36:37.081804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bde886b4-d0ef-415c-a281-944033f19ff8 could not be found. Jul 28 10:36:37.081804 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:36:37.085803 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a56b17a8-db38-4211-acfa-206057a29172 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] Returning 404 to user: Instance bde886b4-d0ef-415c-a281-944033f19ff8 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:36:37.086943 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a56b17a8-db38-4211-acfa-206057a29172 tempest-ServerShowV257Test-322055231 tempest-ServerShowV257Test-322055231-project] 10.222.0.46 "GET /compute/v2.1/servers/bde886b4-d0ef-415c-a281-944033f19ff8" status: 404 len: 111 microversion: 2.57 time: 0.106572 Jul 28 10:36:37.089790 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 416/856] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:36:36 2022] GET /compute/v2.1/servers/bde886b4-d0ef-415c-a281-944033f19ff8 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:36:39.780471 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c4de6f3f-90d3-473c-953e-837c45dd1527 tempest-FloatingIPDetailsTestJSON-492106165 tempest-FloatingIPDetailsTestJSON-492106165-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.107461 Jul 28 10:36:39.781521 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 441/857] 10.222.0.46 () {60 vars in 1170 bytes} [Thu Jul 28 10:36:33 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:36:39.800461 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-83c78ae6-3c3b-444b-8e62-6a86c8865dd0 tempest-FloatingIPDetailsTestJSON-492106165 tempest-FloatingIPDetailsTestJSON-492106165-project] Action: 'create', calling method: .version_select at 0x7fa94ba61f70>, body: {"pool": null} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:36:39.812653 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:44.190064 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=8 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:44.289618 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-83c78ae6-3c3b-444b-8e62-6a86c8865dd0 tempest-FloatingIPDetailsTestJSON-492106165 tempest-FloatingIPDetailsTestJSON-492106165-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.491686 Jul 28 10:36:44.292084 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 417/858] 10.222.0.46 () {60 vars in 1170 bytes} [Thu Jul 28 10:36:39 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:36:44.304656 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-83315144-118d-49d2-bbd8-88654d96c806 tempest-FloatingIPDetailsTestJSON-492106165 tempest-FloatingIPDetailsTestJSON-492106165-project] Calling method '.version_select at 0x7fa94b99fdc0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:44.315257 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:44.316813 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=12 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:44.320090 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=6 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:44.321023 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=7,nova_cell0:UPDATE=11,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:44.762488 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-83315144-118d-49d2-bbd8-88654d96c806 tempest-FloatingIPDetailsTestJSON-492106165 tempest-FloatingIPDetailsTestJSON-492106165-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips/748b23a3-a200-41d6-841a-89265b839cb9" status: 200 len: 142 microversion: 2.1 time: 0.462844 Jul 28 10:36:44.763282 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 442/859] 10.222.0.46 () {58 vars in 1260 bytes} [Thu Jul 28 10:36:44 2022] GET /compute/v2.1/os-floating-ips/748b23a3-a200-41d6-841a-89265b839cb9 => generated 142 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:36:44.778073 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-88de6c57-2d7c-49ce-a3e1-b947d3b243d4 tempest-FloatingIPDetailsTestJSON-492106165 tempest-FloatingIPDetailsTestJSON-492106165-project] Calling method '.version_select at 0x7fa94bba8550>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:46.880151 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-88de6c57-2d7c-49ce-a3e1-b947d3b243d4 tempest-FloatingIPDetailsTestJSON-492106165 tempest-FloatingIPDetailsTestJSON-492106165-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/748b23a3-a200-41d6-841a-89265b839cb9" status: 202 len: 0 microversion: 2.1 time: 2.108271 Jul 28 10:36:46.880767 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 418/860] 10.222.0.46 () {58 vars in 1263 bytes} [Thu Jul 28 10:36:44 2022] DELETE /compute/v2.1/os-floating-ips/748b23a3-a200-41d6-841a-89265b839cb9 => generated 0 bytes in 2110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:36:46.899193 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5099ad42-711c-48ef-aa4e-df8fcec31dac tempest-FloatingIPDetailsTestJSON-492106165 tempest-FloatingIPDetailsTestJSON-492106165-project] Calling method '.version_select at 0x7fa94b99faf0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:47.577771 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-5099ad42-711c-48ef-aa4e-df8fcec31dac tempest-FloatingIPDetailsTestJSON-492106165 tempest-FloatingIPDetailsTestJSON-492106165-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.687571 Jul 28 10:36:47.595124 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 443/861] 10.222.0.46 () {58 vars in 1164 bytes} [Thu Jul 28 10:36:46 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:36:47.598064 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:47.599154 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=42,nova_cell0:UPDATE=27,nova_cell0:DELETE=4,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:47.606738 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-424fb985-bdc0-4685-8d2f-8c9c0f8b4697 tempest-FloatingIPDetailsTestJSON-492106165 tempest-FloatingIPDetailsTestJSON-492106165-project] Calling method '.version_select at 0x7fa94ba61430>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:48.102892 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-540097383", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "e7f3227b-967f-4e74-ac8d-d345a1b27455"}, {"uuid": "faa10bb4-72ac-4c68-9b60-865ab062cfa6"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:36:48.287092 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] validate_networks() for [('e7f3227b-967f-4e74-ac8d-d345a1b27455', None, None, None, None, None), ('faa10bb4-72ac-4c68-9b60-865ab062cfa6', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:36:49.184345 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-424fb985-bdc0-4685-8d2f-8c9c0f8b4697 tempest-FloatingIPDetailsTestJSON-492106165 tempest-FloatingIPDetailsTestJSON-492106165-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 1.587810 Jul 28 10:36:49.185665 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 419/862] 10.222.0.46 () {58 vars in 1149 bytes} [Thu Jul 28 10:36:47 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:36:49.201906 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0f57b3e2-9493-49e6-a513-9e2492822757 tempest-FloatingIPDetailsTestJSON-492106165 tempest-FloatingIPDetailsTestJSON-492106165-project] Calling method '.version_select at 0x7fa94ba225e0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:49.830739 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:36:49.832604 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:36:49.833358 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:36:49.834136 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:36:49.835075 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:36:49.850331 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:49.850331 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:49.851338 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:49.852135 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:49.897399 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Getting quotas for project c9985f08d1d548328c197f02f309dfa8. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:36:49.903712 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Getting quotas for user ba4a9bc552b945258ebed85cd96345c7 and project c9985f08d1d548328c197f02f309dfa8. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:36:49.934705 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:36:49.938372 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 5d23c48f-5396-4283-9712-83d562171f80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:36:50.062799 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-890a862d-499b-47ae-9b4f-714547396265 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.963175 Jul 28 10:36:50.074614 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 444/863] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:36:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:36:50.086521 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9d2c4eba-5787-4d2a-a9ee-7a5163385273 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:50.089141 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-9d2c4eba-5787-4d2a-a9ee-7a5163385273 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 5d23c48f-5396-4283-9712-83d562171f80] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:50.212942 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-9d2c4eba-5787-4d2a-a9ee-7a5163385273 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4a9bc552b945258ebed85cd96345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9985f08d1d548328c197f02f309dfa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:36:50.223521 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9d2c4eba-5787-4d2a-a9ee-7a5163385273 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] 10.222.0.46 "GET /compute/v2.1/servers/5d23c48f-5396-4283-9712-83d562171f80" status: 200 len: 1212 microversion: 2.1 time: 0.147016 Jul 28 10:36:50.226698 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 445/864] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:36:50 2022] GET /compute/v2.1/servers/5d23c48f-5396-4283-9712-83d562171f80 => generated 1212 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:36:50.721123 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1501388642", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:36:50.870173 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] validate_networks() for None {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:36:51.353376 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-0f57b3e2-9493-49e6-a513-9e2492822757 tempest-FloatingIPDetailsTestJSON-492106165 tempest-FloatingIPDetailsTestJSON-492106165-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/494819b1-28b0-4f1e-ae94-4834660a6f39" status: 202 len: 0 microversion: 2.1 time: 2.156155 Jul 28 10:36:51.355136 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 420/865] 10.222.0.46 () {58 vars in 1263 bytes} [Thu Jul 28 10:36:49 2022] DELETE /compute/v2.1/os-floating-ips/494819b1-28b0-4f1e-ae94-4834660a6f39 => generated 0 bytes in 2159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:36:51.363345 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c15b1a7e-6a74-4392-9143-d2c9cec4467b tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:51.364772 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c15b1a7e-6a74-4392-9143-d2c9cec4467b tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 5d23c48f-5396-4283-9712-83d562171f80] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:51.370336 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:36:51.370907 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:36:51.371391 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:36:51.371853 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:36:51.372273 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:36:51.381649 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c15b1a7e-6a74-4392-9143-d2c9cec4467b tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:51.382417 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c15b1a7e-6a74-4392-9143-d2c9cec4467b tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:51.384251 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:51.385167 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:51.385645 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c15b1a7e-6a74-4392-9143-d2c9cec4467b tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:51.386492 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c15b1a7e-6a74-4392-9143-d2c9cec4467b tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:51.387002 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:51.388059 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:51.414239 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Getting quotas for project 832408baddcc4ba18faa84061845f116. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:36:51.422538 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Getting quotas for user b078a28f57ae467b855d240424e7fa64 and project 832408baddcc4ba18faa84061845f116. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:36:51.443076 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:36:51.446211 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 1b02cc93-229d-42cc-9b34-6ab1cfe19826] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:36:51.469531 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c15b1a7e-6a74-4392-9143-d2c9cec4467b tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:51.470459 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c15b1a7e-6a74-4392-9143-d2c9cec4467b tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:51.473186 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-c15b1a7e-6a74-4392-9143-d2c9cec4467b tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lazy-loading 'fault' on Instance uuid 5d23c48f-5396-4283-9712-83d562171f80 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:36:51.555705 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7cf7f748-2b35-4d1c-889d-063f55d24a4f tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.327393 Jul 28 10:36:51.556419 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 446/866] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:36:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:36:51.566586 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f6621cb8-6ec2-4427-917b-eadceed92580 tempest-FloatingIPDetailsTestJSON-492106165 tempest-FloatingIPDetailsTestJSON-492106165-project] Calling method '.version_select at 0x7fa94b9d80d0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:51.593454 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-c15b1a7e-6a74-4392-9143-d2c9cec4467b tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4a9bc552b945258ebed85cd96345c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9985f08d1d548328c197f02f309dfa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:36:51.603212 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c15b1a7e-6a74-4392-9143-d2c9cec4467b tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] 10.222.0.46 "GET /compute/v2.1/servers/5d23c48f-5396-4283-9712-83d562171f80" status: 200 len: 1285 microversion: 2.1 time: 0.246506 Jul 28 10:36:51.625397 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 421/867] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:36:51 2022] GET /compute/v2.1/servers/5d23c48f-5396-4283-9712-83d562171f80 => generated 1285 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:36:51.649503 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d8af8104-7493-4de0-9127-11447029f377 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:51.650597 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-d8af8104-7493-4de0-9127-11447029f377 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 5d23c48f-5396-4283-9712-83d562171f80] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:51.663744 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d8af8104-7493-4de0-9127-11447029f377 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:51.666308 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d8af8104-7493-4de0-9127-11447029f377 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:51.669333 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d8af8104-7493-4de0-9127-11447029f377 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:51.671557 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d8af8104-7493-4de0-9127-11447029f377 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:51.768689 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-d8af8104-7493-4de0-9127-11447029f377 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 5d23c48f-5396-4283-9712-83d562171f80] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:36:51.934820 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-d8af8104-7493-4de0-9127-11447029f377 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 5d23c48f-5396-4283-9712-83d562171f80] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:36:51.935831 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d8af8104-7493-4de0-9127-11447029f377 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:51.936349 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d8af8104-7493-4de0-9127-11447029f377 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:51.937175 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-d8af8104-7493-4de0-9127-11447029f377 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 5d23c48f-5396-4283-9712-83d562171f80] instance's host None is down, deleting from database Jul 28 10:36:51.954765 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-d8af8104-7493-4de0-9127-11447029f377 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 5d23c48f-5396-4283-9712-83d562171f80] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:36:52.250975 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-d8af8104-7493-4de0-9127-11447029f377 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 5d23c48f-5396-4283-9712-83d562171f80] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:36:52.260111 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-d8af8104-7493-4de0-9127-11447029f377 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 5d23c48f-5396-4283-9712-83d562171f80] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:36:52.603621 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d8af8104-7493-4de0-9127-11447029f377 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5d23c48f-5396-4283-9712-83d562171f80" status: 204 len: 0 microversion: 2.1 time: 0.960991 Jul 28 10:36:52.607081 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 422/868] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:36:51 2022] DELETE /compute/v2.1/servers/5d23c48f-5396-4283-9712-83d562171f80 => generated 0 bytes in 965 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 10:36:52.624352 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1921172804", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:36:52.806068 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] validate_networks() for None {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:36:53.268832 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f6621cb8-6ec2-4427-917b-eadceed92580 tempest-FloatingIPDetailsTestJSON-492106165 tempest-FloatingIPDetailsTestJSON-492106165-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/9c32e696-adbb-47e7-9d71-e62717218826" status: 202 len: 0 microversion: 2.1 time: 1.711224 Jul 28 10:36:53.269417 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 447/869] 10.222.0.46 () {58 vars in 1263 bytes} [Thu Jul 28 10:36:51 2022] DELETE /compute/v2.1/os-floating-ips/9c32e696-adbb-47e7-9d71-e62717218826 => generated 0 bytes in 1712 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:36:53.274560 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-accc9782-8e63-4666-adc4-09369d3f4d30 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:53.277726 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-accc9782-8e63-4666-adc4-09369d3f4d30 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] [instance: 5d23c48f-5396-4283-9712-83d562171f80] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:53.293742 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-accc9782-8e63-4666-adc4-09369d3f4d30 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:53.294908 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-accc9782-8e63-4666-adc4-09369d3f4d30 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:53.295901 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-accc9782-8e63-4666-adc4-09369d3f4d30 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:53.300678 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-accc9782-8e63-4666-adc4-09369d3f4d30 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:53.345931 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-accc9782-8e63-4666-adc4-09369d3f4d30 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] HTTP exception thrown: Instance 5d23c48f-5396-4283-9712-83d562171f80 could not be found. Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-accc9782-8e63-4666-adc4-09369d3f4d30 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Request method failure captured: Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/5d23c48f-5396-4283-9712-83d562171f80 HTTP/1.1 Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4maakfGgYI5zvChHKrFKa3wMAlQkG9MINyYpsnZZ8enTnps6qIyEpMVmWa9dFThPBS55jcHRLbgVgAbjlmkAqQjEApqznY85fSdeRgQ93ZW4mjATz04CBieLWLQGbwLoW4vdhq-dKLg2elRb7ahRNquJiaCrh7n5MbuhRIQQF6Ik884 Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: c9985f08d1d548328c197f02f309dfa8 Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ServersTestMultiNic-1072918470 Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c9985f08d1d548328c197f02f309dfa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c9985f08d1d548328c197f02f309dfa8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c9985f08d1d548328c197f02f309dfa8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c9985f08d1d548328c197f02f309dfa8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ServersTestMultiNic-1072918470 Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: c9985f08d1d548328c197f02f309dfa8 Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ServersTestMultiNic-1072918470 Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ServersTestMultiNic-1072918470-project Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: ba4a9bc552b945258ebed85cd96345c7 Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ServersTestMultiNic-1072918470-project Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 5d23c48f-5396-4283-9712-83d562171f80 could not be found. Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '5d23c48f-5396-4283-9712-83d562171f80'} Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d23c48f-5396-4283-9712-83d562171f80 could not be found. Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d23c48f-5396-4283-9712-83d562171f80 could not be found. Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:36:53.353914 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:53.359764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:53.359764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:36:53.359764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:36:53.359764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:36:53.359764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:36:53.359764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d23c48f-5396-4283-9712-83d562171f80 could not be found. Jul 28 10:36:53.359764 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:53.359764 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-accc9782-8e63-4666-adc4-09369d3f4d30 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] Returning 404 to user: Instance 5d23c48f-5396-4283-9712-83d562171f80 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:36:53.359764 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-accc9782-8e63-4666-adc4-09369d3f4d30 tempest-ServersTestMultiNic-1072918470 tempest-ServersTestMultiNic-1072918470-project] 10.222.0.46 "GET /compute/v2.1/servers/5d23c48f-5396-4283-9712-83d562171f80" status: 404 len: 111 microversion: 2.1 time: 0.084687 Jul 28 10:36:53.371115 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 448/870] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:36:53 2022] GET /compute/v2.1/servers/5d23c48f-5396-4283-9712-83d562171f80 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:36:53.390731 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-dea9e16d-67d7-4c87-8be3-fa41cd0e37f2 tempest-FloatingIPDetailsTestJSON-492106165 tempest-FloatingIPDetailsTestJSON-492106165-project] Calling method '.version_select at 0x7fa94b99fd30>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:54.140701 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:36:54.141246 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:36:54.141622 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:36:54.142068 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:36:54.143358 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:36:54.192862 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:54.201846 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:54.203188 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:54.203833 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:54.257992 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Getting quotas for project 832408baddcc4ba18faa84061845f116. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:36:54.280266 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Getting quotas for user b078a28f57ae467b855d240424e7fa64 and project 832408baddcc4ba18faa84061845f116. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:36:54.306557 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:36:54.313236 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 291f03bc-0986-475c-8c01-193f52c40627] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:36:54.453788 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-5cc2f4e4-8a4a-4902-9206-36f70fd43fa4 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.845394 Jul 28 10:36:54.454476 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 423/871] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:36:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:36:54.483089 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6895e35b-4699-479f-8cc6-12a01dc5de5b tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:54.483729 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-6895e35b-4699-479f-8cc6-12a01dc5de5b tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 291f03bc-0986-475c-8c01-193f52c40627] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:54.912706 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-6895e35b-4699-479f-8cc6-12a01dc5de5b tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078a28f57ae467b855d240424e7fa64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832408baddcc4ba18faa84061845f116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:36:54.934540 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6895e35b-4699-479f-8cc6-12a01dc5de5b tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] 10.222.0.46 "GET /compute/v2.1/servers/291f03bc-0986-475c-8c01-193f52c40627" status: 200 len: 1214 microversion: 2.1 time: 0.465130 Jul 28 10:36:54.939916 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 424/872] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:36:54 2022] GET /compute/v2.1/servers/291f03bc-0986-475c-8c01-193f52c40627 => generated 1214 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:36:55.962312 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-64f25651-641f-462a-9147-63d818d7d31d tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:55.968937 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-64f25651-641f-462a-9147-63d818d7d31d tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 291f03bc-0986-475c-8c01-193f52c40627] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:55.994894 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-64f25651-641f-462a-9147-63d818d7d31d tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:55.997108 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-64f25651-641f-462a-9147-63d818d7d31d tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:56.012327 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-64f25651-641f-462a-9147-63d818d7d31d tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:56.013197 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-64f25651-641f-462a-9147-63d818d7d31d tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:56.122742 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-64f25651-641f-462a-9147-63d818d7d31d tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:56.123763 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-64f25651-641f-462a-9147-63d818d7d31d tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:56.125584 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-64f25651-641f-462a-9147-63d818d7d31d tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lazy-loading 'fault' on Instance uuid 291f03bc-0986-475c-8c01-193f52c40627 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:36:56.566908 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-64f25651-641f-462a-9147-63d818d7d31d tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b078a28f57ae467b855d240424e7fa64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832408baddcc4ba18faa84061845f116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:36:56.580075 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-64f25651-641f-462a-9147-63d818d7d31d tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] 10.222.0.46 "GET /compute/v2.1/servers/291f03bc-0986-475c-8c01-193f52c40627" status: 200 len: 1287 microversion: 2.1 time: 0.627154 Jul 28 10:36:56.610246 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 425/873] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:36:55 2022] GET /compute/v2.1/servers/291f03bc-0986-475c-8c01-193f52c40627 => generated 1287 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:36:56.618472 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0e556310-6ff5-466d-9cff-50e806f24f05 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:56.621620 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-0e556310-6ff5-466d-9cff-50e806f24f05 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 291f03bc-0986-475c-8c01-193f52c40627] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:56.657999 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0e556310-6ff5-466d-9cff-50e806f24f05 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:56.660919 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0e556310-6ff5-466d-9cff-50e806f24f05 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:56.666448 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0e556310-6ff5-466d-9cff-50e806f24f05 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:56.668517 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0e556310-6ff5-466d-9cff-50e806f24f05 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:56.759993 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-0e556310-6ff5-466d-9cff-50e806f24f05 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 291f03bc-0986-475c-8c01-193f52c40627] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:36:56.790644 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-dea9e16d-67d7-4c87-8be3-fa41cd0e37f2 tempest-FloatingIPDetailsTestJSON-492106165 tempest-FloatingIPDetailsTestJSON-492106165-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/731a7adb-5878-4937-88de-26b074526cb2" status: 202 len: 0 microversion: 2.1 time: 3.416036 Jul 28 10:36:56.792119 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 449/874] 10.222.0.46 () {58 vars in 1263 bytes} [Thu Jul 28 10:36:53 2022] DELETE /compute/v2.1/os-floating-ips/731a7adb-5878-4937-88de-26b074526cb2 => generated 0 bytes in 3420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:36:56.891168 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-0e556310-6ff5-466d-9cff-50e806f24f05 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 291f03bc-0986-475c-8c01-193f52c40627] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:36:56.893733 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0e556310-6ff5-466d-9cff-50e806f24f05 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:56.894427 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0e556310-6ff5-466d-9cff-50e806f24f05 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:56.895188 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-0e556310-6ff5-466d-9cff-50e806f24f05 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 291f03bc-0986-475c-8c01-193f52c40627] instance's host None is down, deleting from database Jul 28 10:36:56.901909 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-0e556310-6ff5-466d-9cff-50e806f24f05 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 291f03bc-0986-475c-8c01-193f52c40627] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:36:57.185408 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-0e556310-6ff5-466d-9cff-50e806f24f05 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 291f03bc-0986-475c-8c01-193f52c40627] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:36:57.192793 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-0e556310-6ff5-466d-9cff-50e806f24f05 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 291f03bc-0986-475c-8c01-193f52c40627] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:36:57.522988 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=66,nova_cell0:UPDATE=28,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:36:57.541080 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-0e556310-6ff5-466d-9cff-50e806f24f05 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] 10.222.0.46 "DELETE /compute/v2.1/servers/291f03bc-0986-475c-8c01-193f52c40627" status: 204 len: 0 microversion: 2.1 time: 0.929216 Jul 28 10:36:57.543169 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 426/875] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:36:56 2022] DELETE /compute/v2.1/servers/291f03bc-0986-475c-8c01-193f52c40627 => generated 0 bytes in 932 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:36:57.553442 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f851271f-1cdc-4d14-86c8-066d5ea6e37d tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:57.554601 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-f851271f-1cdc-4d14-86c8-066d5ea6e37d tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 291f03bc-0986-475c-8c01-193f52c40627] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:57.570211 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f851271f-1cdc-4d14-86c8-066d5ea6e37d tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:57.570793 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f851271f-1cdc-4d14-86c8-066d5ea6e37d tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:57.571627 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f851271f-1cdc-4d14-86c8-066d5ea6e37d tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:57.572064 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f851271f-1cdc-4d14-86c8-066d5ea6e37d tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:57.644916 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-f851271f-1cdc-4d14-86c8-066d5ea6e37d tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] HTTP exception thrown: Instance 291f03bc-0986-475c-8c01-193f52c40627 could not be found. Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f851271f-1cdc-4d14-86c8-066d5ea6e37d tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Request method failure captured: Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/291f03bc-0986-475c-8c01-193f52c40627 HTTP/1.1 Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4ma-7aXh5GRsf_WSTh4-cJW98UDYvycwRj5FSlU5HmoF48KMBFIGqF-CHpbS9Mt8j4MZlkIfE139h7ZdzD4ICIA2Lj-N-L0MIrF9V73cC8CjpS7ppI78R6JT1LHTh8jdIZWRpIjmfXApWOrdcFhSP0aJGE14PzcT0tgc7n33WlaNWu8 Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 832408baddcc4ba18faa84061845f116 Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ServersAdminTestJSON-1469497306 Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/832408baddcc4ba18faa84061845f116"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/832408baddcc4ba18faa84061845f116"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/832408baddcc4ba18faa84061845f116"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_832408baddcc4ba18faa84061845f116", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ServersAdminTestJSON-1469497306 Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 832408baddcc4ba18faa84061845f116 Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ServersAdminTestJSON-1469497306 Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ServersAdminTestJSON-1469497306-project Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: b078a28f57ae467b855d240424e7fa64 Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ServersAdminTestJSON-1469497306-project Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 291f03bc-0986-475c-8c01-193f52c40627 could not be found. Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '291f03bc-0986-475c-8c01-193f52c40627'} Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 291f03bc-0986-475c-8c01-193f52c40627 could not be found. Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 291f03bc-0986-475c-8c01-193f52c40627 could not be found. Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:36:57.654046 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:57.660666 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:57.660666 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:36:57.660666 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:36:57.660666 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:36:57.660666 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:36:57.660666 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 291f03bc-0986-475c-8c01-193f52c40627 could not be found. Jul 28 10:36:57.660666 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:57.665313 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f851271f-1cdc-4d14-86c8-066d5ea6e37d tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Returning 404 to user: Instance 291f03bc-0986-475c-8c01-193f52c40627 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:36:57.674559 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f851271f-1cdc-4d14-86c8-066d5ea6e37d tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] 10.222.0.46 "GET /compute/v2.1/servers/291f03bc-0986-475c-8c01-193f52c40627" status: 404 len: 111 microversion: 2.1 time: 0.125699 Jul 28 10:36:57.681569 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 450/876] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:36:57 2022] GET /compute/v2.1/servers/291f03bc-0986-475c-8c01-193f52c40627 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:36:57.686539 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b6ca76f6-3911-4581-ab88-d807a06dc0ff tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:57.689720 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b6ca76f6-3911-4581-ab88-d807a06dc0ff tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 1b02cc93-229d-42cc-9b34-6ab1cfe19826] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:57.718803 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b6ca76f6-3911-4581-ab88-d807a06dc0ff tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:57.719266 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b6ca76f6-3911-4581-ab88-d807a06dc0ff tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:57.725413 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b6ca76f6-3911-4581-ab88-d807a06dc0ff tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:57.739379 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b6ca76f6-3911-4581-ab88-d807a06dc0ff tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:57.874862 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b6ca76f6-3911-4581-ab88-d807a06dc0ff tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 1b02cc93-229d-42cc-9b34-6ab1cfe19826] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:36:58.049287 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b6ca76f6-3911-4581-ab88-d807a06dc0ff tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 1b02cc93-229d-42cc-9b34-6ab1cfe19826] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:36:58.058978 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b6ca76f6-3911-4581-ab88-d807a06dc0ff tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:58.064243 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b6ca76f6-3911-4581-ab88-d807a06dc0ff tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:58.066855 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-b6ca76f6-3911-4581-ab88-d807a06dc0ff tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 1b02cc93-229d-42cc-9b34-6ab1cfe19826] instance's host None is down, deleting from database Jul 28 10:36:58.082642 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-b6ca76f6-3911-4581-ab88-d807a06dc0ff tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 1b02cc93-229d-42cc-9b34-6ab1cfe19826] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:36:58.837280 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-b6ca76f6-3911-4581-ab88-d807a06dc0ff tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 1b02cc93-229d-42cc-9b34-6ab1cfe19826] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:36:58.847289 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-b6ca76f6-3911-4581-ab88-d807a06dc0ff tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 1b02cc93-229d-42cc-9b34-6ab1cfe19826] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:36:59.341923 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b6ca76f6-3911-4581-ab88-d807a06dc0ff tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1b02cc93-229d-42cc-9b34-6ab1cfe19826" status: 204 len: 0 microversion: 2.1 time: 1.659349 Jul 28 10:36:59.343437 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 427/877] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:36:57 2022] DELETE /compute/v2.1/servers/1b02cc93-229d-42cc-9b34-6ab1cfe19826 => generated 0 bytes in 1662 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 10:36:59.358172 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-41fb5a8e-c05e-4175-a2e2-debd343754f2 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:36:59.358822 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-41fb5a8e-c05e-4175-a2e2-debd343754f2 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] [instance: 1b02cc93-229d-42cc-9b34-6ab1cfe19826] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:36:59.367847 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-41fb5a8e-c05e-4175-a2e2-debd343754f2 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:59.368355 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-41fb5a8e-c05e-4175-a2e2-debd343754f2 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:59.369149 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-41fb5a8e-c05e-4175-a2e2-debd343754f2 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:36:59.369589 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-41fb5a8e-c05e-4175-a2e2-debd343754f2 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:36:59.413652 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-41fb5a8e-c05e-4175-a2e2-debd343754f2 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] HTTP exception thrown: Instance 1b02cc93-229d-42cc-9b34-6ab1cfe19826 could not be found. Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-41fb5a8e-c05e-4175-a2e2-debd343754f2 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Request method failure captured: Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/1b02cc93-229d-42cc-9b34-6ab1cfe19826 HTTP/1.1 Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4ma-7aXh5GRsf_WSTh4-cJW98UDYvycwRj5FSlU5HmoF48KMBFIGqF-CHpbS9Mt8j4MZlkIfE139h7ZdzD4ICIA2Lj-N-L0MIrF9V73cC8CjpS7ppI78R6JT1LHTh8jdIZWRpIjmfXApWOrdcFhSP0aJGE14PzcT0tgc7n33WlaNWu8 Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 832408baddcc4ba18faa84061845f116 Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ServersAdminTestJSON-1469497306 Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/832408baddcc4ba18faa84061845f116"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/832408baddcc4ba18faa84061845f116"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/832408baddcc4ba18faa84061845f116"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_832408baddcc4ba18faa84061845f116", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ServersAdminTestJSON-1469497306 Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 832408baddcc4ba18faa84061845f116 Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ServersAdminTestJSON-1469497306 Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ServersAdminTestJSON-1469497306-project Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: b078a28f57ae467b855d240424e7fa64 Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ServersAdminTestJSON-1469497306-project Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 1b02cc93-229d-42cc-9b34-6ab1cfe19826 could not be found. Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '1b02cc93-229d-42cc-9b34-6ab1cfe19826'} Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b02cc93-229d-42cc-9b34-6ab1cfe19826 could not be found. Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b02cc93-229d-42cc-9b34-6ab1cfe19826 could not be found. Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:36:59.418172 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:59.426685 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:36:59.426685 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:36:59.426685 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:36:59.426685 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:36:59.426685 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:36:59.426685 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b02cc93-229d-42cc-9b34-6ab1cfe19826 could not be found. Jul 28 10:36:59.426685 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:36:59.426685 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-41fb5a8e-c05e-4175-a2e2-debd343754f2 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] Returning 404 to user: Instance 1b02cc93-229d-42cc-9b34-6ab1cfe19826 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:36:59.426685 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-41fb5a8e-c05e-4175-a2e2-debd343754f2 tempest-ServersAdminTestJSON-1469497306 tempest-ServersAdminTestJSON-1469497306-project] 10.222.0.46 "GET /compute/v2.1/servers/1b02cc93-229d-42cc-9b34-6ab1cfe19826" status: 404 len: 111 microversion: 2.1 time: 0.071947 Jul 28 10:36:59.436318 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 451/878] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:36:59 2022] GET /compute/v2.1/servers/1b02cc93-229d-42cc-9b34-6ab1cfe19826 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:37:11.772201 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:11.773172 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=8 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:11.774153 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:11.775394 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:UPDATE=17,nova_cell0:DELETE=4,nova_cell0:SELECT=24,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:11.780413 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d8b6d456-551f-44e7-bec2-19b898c7d4d3 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Calling method '.version_select at 0x7fa94ba22ca0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:11.895044 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d8b6d456-551f-44e7-bec2-19b898c7d4d3 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] 10.222.0.46 "GET /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e" status: 200 len: 637 microversion: 2.1 time: 0.115306 Jul 28 10:37:11.912783 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 428/879] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Jul 28 10:37:11 2022] GET /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e => generated 637 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:11.913426 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-19afb629-5b75-47a5-aea7-a302a6938dc3 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Action: 'update_all', calling method: .version_select at 0x7fa94b9e7280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:11.924286 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:11.925385 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=14 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:11.926103 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=6 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:11.927323 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=10 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:12.005916 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-19afb629-5b75-47a5-aea7-a302a6938dc3 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Getting quotas for project 74db4e96e6eb4ae2a0029170242deb76. Resources: dict_keys(['metadata_items']) {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:12.023204 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-19afb629-5b75-47a5-aea7-a302a6938dc3 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Getting quotas for user ec1331f97a744cc58cd6d62dc4513221 and project 74db4e96e6eb4ae2a0029170242deb76. Resources: dict_keys(['metadata_items']) {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:12.540373 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-19afb629-5b75-47a5-aea7-a302a6938dc3 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] 10.222.0.46 "PUT /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.631800 Jul 28 10:37:12.540491 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 452/880] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:37:11 2022] PUT /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata => generated 61 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 10:37:12.558180 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-19ec68c1-cad0-43c3-8d53-0599bdc279a3 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Calling method '.version_select at 0x7fa94ba619d0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:13.223050 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-19ec68c1-cad0-43c3-8d53-0599bdc279a3 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] 10.222.0.46 "DELETE /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.674392 Jul 28 10:37:13.225688 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 429/881] 10.222.0.46 () {58 vars in 1296 bytes} [Thu Jul 28 10:37:12 2022] DELETE /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata/os_version => generated 0 bytes in 680 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:37:13.234312 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c4198667-aa3b-4ba9-8864-b4cd24d3aa58 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Calling method '.version_select at 0x7fa94b99fd30>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:13.308203 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c4198667-aa3b-4ba9-8864-b4cd24d3aa58 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] 10.222.0.46 "GET /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata" status: 200 len: 37 microversion: 2.1 time: 0.078317 Jul 28 10:37:13.308778 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 453/882] 10.222.0.46 () {58 vars in 1260 bytes} [Thu Jul 28 10:37:13 2022] GET /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata => generated 37 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:37:13.320431 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-fcdf375f-c1b9-43a0-8373-17c5bc3a59c2 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Action: 'update_all', calling method: .version_select at 0x7fa94bbe03a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:13.416095 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-fcdf375f-c1b9-43a0-8373-17c5bc3a59c2 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Getting quotas for project 74db4e96e6eb4ae2a0029170242deb76. Resources: dict_keys(['metadata_items']) {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:13.449155 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-fcdf375f-c1b9-43a0-8373-17c5bc3a59c2 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Getting quotas for user ec1331f97a744cc58cd6d62dc4513221 and project 74db4e96e6eb4ae2a0029170242deb76. Resources: dict_keys(['metadata_items']) {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:13.937480 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-fcdf375f-c1b9-43a0-8373-17c5bc3a59c2 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] 10.222.0.46 "PUT /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.620998 Jul 28 10:37:13.938514 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 430/883] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:37:13 2022] PUT /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata => generated 61 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:37:13.950933 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e730b8b0-ab7d-4d35-8184-d80d81569a79 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Calling method '.version_select at 0x7fa94b90d1f0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:14.026819 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e730b8b0-ab7d-4d35-8184-d80d81569a79 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] 10.222.0.46 "GET /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.081923 Jul 28 10:37:14.028292 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 454/884] 10.222.0.46 () {58 vars in 1290 bytes} [Thu Jul 28 10:37:13 2022] GET /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata/os_distro => generated 33 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:37:14.038941 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-bd08efe2-6cb6-40cb-988a-cdedba299d44 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Action: 'update_all', calling method: .version_select at 0x7fa94ba220d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:14.132671 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-bd08efe2-6cb6-40cb-988a-cdedba299d44 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Getting quotas for project 74db4e96e6eb4ae2a0029170242deb76. Resources: dict_keys(['metadata_items']) {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:14.153691 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-bd08efe2-6cb6-40cb-988a-cdedba299d44 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Getting quotas for user ec1331f97a744cc58cd6d62dc4513221 and project 74db4e96e6eb4ae2a0029170242deb76. Resources: dict_keys(['metadata_items']) {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:14.515382 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-bd08efe2-6cb6-40cb-988a-cdedba299d44 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] 10.222.0.46 "PUT /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.480588 Jul 28 10:37:14.516313 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 431/885] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:37:14 2022] PUT /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata => generated 61 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:37:14.526516 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a6fa2791-8fbc-44a8-929b-04b208c0443e tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Calling method '.version_select at 0x7fa94b99fd30>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:14.588078 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a6fa2791-8fbc-44a8-929b-04b208c0443e tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] 10.222.0.46 "GET /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.064985 Jul 28 10:37:14.588911 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 455/886] 10.222.0.46 () {58 vars in 1260 bytes} [Thu Jul 28 10:37:14 2022] GET /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata => generated 61 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 10:37:14.602307 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-18b9fa00-0136-450a-b30b-a564a926faec tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Action: 'update_all', calling method: .version_select at 0x7fa94bc16790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:14.754955 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-18b9fa00-0136-450a-b30b-a564a926faec tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Getting quotas for project 74db4e96e6eb4ae2a0029170242deb76. Resources: dict_keys(['metadata_items']) {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:14.765306 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-18b9fa00-0136-450a-b30b-a564a926faec tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Getting quotas for user ec1331f97a744cc58cd6d62dc4513221 and project 74db4e96e6eb4ae2a0029170242deb76. Resources: dict_keys(['metadata_items']) {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:15.120297 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-18b9fa00-0136-450a-b30b-a564a926faec tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] 10.222.0.46 "PUT /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.524321 Jul 28 10:37:15.122072 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 432/887] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:37:14 2022] PUT /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata => generated 61 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:37:15.133335 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-654e94e7-f1e6-4fb4-b744-93e0ae12faa1 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Action: 'update_all', calling method: .version_select at 0x7fa94b9e7670>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:15.245224 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-654e94e7-f1e6-4fb4-b744-93e0ae12faa1 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Getting quotas for project 74db4e96e6eb4ae2a0029170242deb76. Resources: dict_keys(['metadata_items']) {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:15.255585 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-654e94e7-f1e6-4fb4-b744-93e0ae12faa1 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Getting quotas for user ec1331f97a744cc58cd6d62dc4513221 and project 74db4e96e6eb4ae2a0029170242deb76. Resources: dict_keys(['metadata_items']) {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:15.895848 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-654e94e7-f1e6-4fb4-b744-93e0ae12faa1 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] 10.222.0.46 "PUT /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata" status: 200 len: 64 microversion: 2.1 time: 0.767254 Jul 28 10:37:15.896736 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 456/888] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:37:15 2022] PUT /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata => generated 64 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:37:15.906686 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f18c782d-655e-4691-8f1d-11f77f5c764f tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Calling method '.version_select at 0x7fa94bc16e50>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:16.028237 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f18c782d-655e-4691-8f1d-11f77f5c764f tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] 10.222.0.46 "GET /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata" status: 200 len: 64 microversion: 2.1 time: 0.124792 Jul 28 10:37:16.035526 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 433/889] 10.222.0.46 () {58 vars in 1260 bytes} [Thu Jul 28 10:37:15 2022] GET /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata => generated 64 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:37:16.041402 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c0cad832-d342-450e-8839-00b1127c9dd7 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Action: 'update_all', calling method: .version_select at 0x7fa94bcdd3a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:16.135861 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-c0cad832-d342-450e-8839-00b1127c9dd7 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Getting quotas for project 74db4e96e6eb4ae2a0029170242deb76. Resources: dict_keys(['metadata_items']) {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:16.148606 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-c0cad832-d342-450e-8839-00b1127c9dd7 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Getting quotas for user ec1331f97a744cc58cd6d62dc4513221 and project 74db4e96e6eb4ae2a0029170242deb76. Resources: dict_keys(['metadata_items']) {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:16.957889 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c0cad832-d342-450e-8839-00b1127c9dd7 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] 10.222.0.46 "PUT /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.921258 Jul 28 10:37:16.958485 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 457/890] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:37:16 2022] PUT /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata => generated 61 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 10:37:16.968319 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ed9263eb-b6a9-4ec8-8228-b4ef99a036fd tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Action: 'update', calling method: .version_select at 0x7fa94ba61280>, body: {"meta": {"os_version": "alt"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:17.039593 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-ed9263eb-b6a9-4ec8-8228-b4ef99a036fd tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Getting quotas for project 74db4e96e6eb4ae2a0029170242deb76. Resources: dict_keys(['metadata_items']) {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:17.055713 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-ed9263eb-b6a9-4ec8-8228-b4ef99a036fd tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Getting quotas for user ec1331f97a744cc58cd6d62dc4513221 and project 74db4e96e6eb4ae2a0029170242deb76. Resources: dict_keys(['metadata_items']) {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:17.480999 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ed9263eb-b6a9-4ec8-8228-b4ef99a036fd tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] 10.222.0.46 "PUT /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.516655 Jul 28 10:37:17.481599 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 434/891] 10.222.0.46 () {60 vars in 1313 bytes} [Thu Jul 28 10:37:16 2022] PUT /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata/os_version => generated 31 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:37:17.491636 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-96c80021-c29e-4689-9830-a0b5b0f23f10 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Calling method '.version_select at 0x7fa94b9e7c10>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:17.550330 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-96c80021-c29e-4689-9830-a0b5b0f23f10 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] 10.222.0.46 "GET /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata" status: 200 len: 58 microversion: 2.1 time: 0.062386 Jul 28 10:37:17.550913 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 458/892] 10.222.0.46 () {58 vars in 1260 bytes} [Thu Jul 28 10:37:17 2022] GET /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata => generated 58 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:37:17.565793 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-962baeaa-acba-48c9-b23f-1afe7de3f8ab tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Action: 'update_all', calling method: .version_select at 0x7fa94ba61670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:17.650919 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-962baeaa-acba-48c9-b23f-1afe7de3f8ab tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Getting quotas for project 74db4e96e6eb4ae2a0029170242deb76. Resources: dict_keys(['metadata_items']) {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:17.670103 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-962baeaa-acba-48c9-b23f-1afe7de3f8ab tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Getting quotas for user ec1331f97a744cc58cd6d62dc4513221 and project 74db4e96e6eb4ae2a0029170242deb76. Resources: dict_keys(['metadata_items']) {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:18.054089 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-962baeaa-acba-48c9-b23f-1afe7de3f8ab tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] 10.222.0.46 "PUT /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.495917 Jul 28 10:37:18.059090 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 435/893] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:37:17 2022] PUT /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata => generated 61 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:37:18.068724 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-24a86bea-54ca-4759-a5c5-3c732f747791 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Action: 'create', calling method: .version_select at 0x7fa94bbe0ee0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:18.147501 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-24a86bea-54ca-4759-a5c5-3c732f747791 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Getting quotas for project 74db4e96e6eb4ae2a0029170242deb76. Resources: dict_keys(['metadata_items']) {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:18.154852 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-24a86bea-54ca-4759-a5c5-3c732f747791 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Getting quotas for user ec1331f97a744cc58cd6d62dc4513221 and project 74db4e96e6eb4ae2a0029170242deb76. Resources: dict_keys(['metadata_items']) {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:18.599092 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-24a86bea-54ca-4759-a5c5-3c732f747791 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] 10.222.0.46 "POST /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata" status: 200 len: 85 microversion: 2.1 time: 0.538249 Jul 28 10:37:18.599731 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 436/894] 10.222.0.46 () {60 vars in 1281 bytes} [Thu Jul 28 10:37:18 2022] POST /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata => generated 85 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:37:18.610739 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-60c0efda-8529-4ec9-b3ab-e1fe04c1f7d2 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] Calling method '.version_select at 0x7fa94bc16160>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:18.686167 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-60c0efda-8529-4ec9-b3ab-e1fe04c1f7d2 tempest-ImagesMetadataTestJSON-2004679782 tempest-ImagesMetadataTestJSON-2004679782-project] 10.222.0.46 "GET /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata" status: 200 len: 85 microversion: 2.1 time: 0.080675 Jul 28 10:37:18.687303 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 437/895] 10.222.0.46 () {58 vars in 1260 bytes} [Thu Jul 28 10:37:18 2022] GET /compute/v2.1/images/27e0c7b5-7929-422d-bd2a-d35c1e5f5a3e/metadata => generated 85 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 10:37:18.951636 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-2001389398", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "83025633-83ab-4ed5-b982-869a3375c4b5"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:19.069541 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] validate_networks() for [('83025633-83ab-4ed5-b982-869a3375c4b5', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:37:20.649600 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:37:20.651295 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:37:20.654222 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:37:20.654760 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:37:20.655304 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:37:20.681752 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:20.683518 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:20.686448 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:20.689548 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:20.744662 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Getting quotas for project 8999d0a0acc04879bb1fa55809a9baa2. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:20.759218 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Getting quotas for user c4f39f79ba9f477a9c14669a4bd645ad and project 8999d0a0acc04879bb1fa55809a9baa2. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:20.792206 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:37:20.799951 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] [instance: 2c9bd76c-a2f0-4516-9ec3-59266df92c8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:37:20.914484 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-062fd17c-772b-41bc-80d1-6069b7cb5101 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.923476 Jul 28 10:37:20.920177 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 459/896] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:37:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 10:37:20.928314 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b2ea5089-e0d9-449e-8e26-41d34a3af8af tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:20.928935 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b2ea5089-e0d9-449e-8e26-41d34a3af8af tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] [instance: 2c9bd76c-a2f0-4516-9ec3-59266df92c8e] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:21.200267 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-b2ea5089-e0d9-449e-8e26-41d34a3af8af tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f39f79ba9f477a9c14669a4bd645ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8999d0a0acc04879bb1fa55809a9baa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:21.214517 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b2ea5089-e0d9-449e-8e26-41d34a3af8af tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] 10.222.0.46 "GET /compute/v2.1/servers/2c9bd76c-a2f0-4516-9ec3-59266df92c8e" status: 200 len: 1228 microversion: 2.1 time: 0.291055 Jul 28 10:37:21.215634 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 438/897] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:37:20 2022] GET /compute/v2.1/servers/2c9bd76c-a2f0-4516-9ec3-59266df92c8e => generated 1228 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:22.245044 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-3f698342-e0cc-4383-a65d-1dcc33cafdf9 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:22.245681 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-3f698342-e0cc-4383-a65d-1dcc33cafdf9 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] [instance: 2c9bd76c-a2f0-4516-9ec3-59266df92c8e] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:22.276668 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3f698342-e0cc-4383-a65d-1dcc33cafdf9 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:22.277389 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3f698342-e0cc-4383-a65d-1dcc33cafdf9 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:22.278244 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3f698342-e0cc-4383-a65d-1dcc33cafdf9 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:22.278680 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3f698342-e0cc-4383-a65d-1dcc33cafdf9 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:22.395463 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3f698342-e0cc-4383-a65d-1dcc33cafdf9 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:22.395956 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3f698342-e0cc-4383-a65d-1dcc33cafdf9 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:22.396447 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-3f698342-e0cc-4383-a65d-1dcc33cafdf9 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lazy-loading 'fault' on Instance uuid 2c9bd76c-a2f0-4516-9ec3-59266df92c8e {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:37:22.513473 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-3f698342-e0cc-4383-a65d-1dcc33cafdf9 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f39f79ba9f477a9c14669a4bd645ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8999d0a0acc04879bb1fa55809a9baa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:22.525657 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-3f698342-e0cc-4383-a65d-1dcc33cafdf9 tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] 10.222.0.46 "GET /compute/v2.1/servers/2c9bd76c-a2f0-4516-9ec3-59266df92c8e" status: 200 len: 1301 microversion: 2.1 time: 0.287043 Jul 28 10:37:22.527119 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 460/898] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:37:22 2022] GET /compute/v2.1/servers/2c9bd76c-a2f0-4516-9ec3-59266df92c8e => generated 1301 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:37:22.552283 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7e2007c4-1e75-48f3-99ce-81d91c643bfe tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:22.553488 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-7e2007c4-1e75-48f3-99ce-81d91c643bfe tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] [instance: 2c9bd76c-a2f0-4516-9ec3-59266df92c8e] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:22.575326 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7e2007c4-1e75-48f3-99ce-81d91c643bfe tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:22.575758 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7e2007c4-1e75-48f3-99ce-81d91c643bfe tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:22.576565 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7e2007c4-1e75-48f3-99ce-81d91c643bfe tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:22.577010 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7e2007c4-1e75-48f3-99ce-81d91c643bfe tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:22.681309 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-7e2007c4-1e75-48f3-99ce-81d91c643bfe tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] [instance: 2c9bd76c-a2f0-4516-9ec3-59266df92c8e] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:37:22.837397 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-7e2007c4-1e75-48f3-99ce-81d91c643bfe tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] [instance: 2c9bd76c-a2f0-4516-9ec3-59266df92c8e] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:37:22.839735 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7e2007c4-1e75-48f3-99ce-81d91c643bfe tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:22.840496 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7e2007c4-1e75-48f3-99ce-81d91c643bfe tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:22.842298 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-7e2007c4-1e75-48f3-99ce-81d91c643bfe tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] [instance: 2c9bd76c-a2f0-4516-9ec3-59266df92c8e] instance's host None is down, deleting from database Jul 28 10:37:22.855307 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-7e2007c4-1e75-48f3-99ce-81d91c643bfe tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] [instance: 2c9bd76c-a2f0-4516-9ec3-59266df92c8e] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:37:22.973991 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-7e2007c4-1e75-48f3-99ce-81d91c643bfe tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] [instance: 2c9bd76c-a2f0-4516-9ec3-59266df92c8e] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:37:22.982650 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-7e2007c4-1e75-48f3-99ce-81d91c643bfe tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] [instance: 2c9bd76c-a2f0-4516-9ec3-59266df92c8e] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:37:23.286364 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-7e2007c4-1e75-48f3-99ce-81d91c643bfe tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2c9bd76c-a2f0-4516-9ec3-59266df92c8e" status: 204 len: 0 microversion: 2.1 time: 0.737822 Jul 28 10:37:23.287175 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 439/899] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:37:22 2022] DELETE /compute/v2.1/servers/2c9bd76c-a2f0-4516-9ec3-59266df92c8e => generated 0 bytes in 740 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:37:23.302742 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-05dd4599-c78f-496e-ba89-a9d46e3751ed tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:23.304690 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-05dd4599-c78f-496e-ba89-a9d46e3751ed tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] [instance: 2c9bd76c-a2f0-4516-9ec3-59266df92c8e] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:23.314615 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-05dd4599-c78f-496e-ba89-a9d46e3751ed tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:23.315377 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-05dd4599-c78f-496e-ba89-a9d46e3751ed tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:23.316365 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-05dd4599-c78f-496e-ba89-a9d46e3751ed tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:23.317014 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-05dd4599-c78f-496e-ba89-a9d46e3751ed tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:23.362458 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-05dd4599-c78f-496e-ba89-a9d46e3751ed tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] HTTP exception thrown: Instance 2c9bd76c-a2f0-4516-9ec3-59266df92c8e could not be found. Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-05dd4599-c78f-496e-ba89-a9d46e3751ed tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Request method failure captured: Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/2c9bd76c-a2f0-4516-9ec3-59266df92c8e HTTP/1.1 Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mbO3xJJdljYbCTEH5kSSZKqiENOGSXBBYNXtYVMVYG6WW-KH6m4n3lpCECTBuDN95E1cDrZ-XDRsp5nNi0aeadJhLcIKTdl_wTLPeJcNNwMSQtsyyZGOJM9dRiTpY1u_uakSSLRIyDs8E7xgmE-SPuPdwlh7-mrgyz_qpR4qy_aZOw Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 8999d0a0acc04879bb1fa55809a9baa2 Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1639699725 Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8999d0a0acc04879bb1fa55809a9baa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8999d0a0acc04879bb1fa55809a9baa2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8999d0a0acc04879bb1fa55809a9baa2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8999d0a0acc04879bb1fa55809a9baa2", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1639699725 Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 8999d0a0acc04879bb1fa55809a9baa2 Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1639699725 Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1639699725-project Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: c4f39f79ba9f477a9c14669a4bd645ad Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1639699725-project Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 2c9bd76c-a2f0-4516-9ec3-59266df92c8e could not be found. Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '2c9bd76c-a2f0-4516-9ec3-59266df92c8e'} Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c9bd76c-a2f0-4516-9ec3-59266df92c8e could not be found. Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c9bd76c-a2f0-4516-9ec3-59266df92c8e could not be found. Jul 28 10:37:23.366718 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:23.372084 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:23.372084 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:23.372084 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:23.372084 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:23.372084 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:23.372084 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:37:23.372084 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:37:23.372084 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c9bd76c-a2f0-4516-9ec3-59266df92c8e could not be found. Jul 28 10:37:23.372084 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:23.372084 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-05dd4599-c78f-496e-ba89-a9d46e3751ed tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] Returning 404 to user: Instance 2c9bd76c-a2f0-4516-9ec3-59266df92c8e could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:37:23.372084 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-05dd4599-c78f-496e-ba89-a9d46e3751ed tempest-ServersNegativeTestMultiTenantJSON-1639699725 tempest-ServersNegativeTestMultiTenantJSON-1639699725-project] 10.222.0.46 "GET /compute/v2.1/servers/2c9bd76c-a2f0-4516-9ec3-59266df92c8e" status: 404 len: 111 microversion: 2.1 time: 0.076715 Jul 28 10:37:23.374837 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 461/900] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:37:23 2022] GET /compute/v2.1/servers/2c9bd76c-a2f0-4516-9ec3-59266df92c8e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:37:26.692964 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0026750b-dc1a-46b1-a7b8-e03cc19bce85 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Action: 'create', calling method: .version_select at 0x7fa94bc2a4c0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOW0Rrgf9JC0EwasD3czKl4JfHWU6V7ZrWw+agtBBGJgbaNGHC80xYuSDPA2AiAAFIaxiMsQ0Ccj7UDI7Wb6rgm8e0RoUSub4Tjz6sVQawOIV5GP9Tg47OLPtOoIbX8S/A=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:26.708405 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-0026750b-dc1a-46b1-a7b8-e03cc19bce85 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0026750b-dc1a-46b1-a7b8-e03cc19bce85 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Request method failure captured: Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 257 Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mblO-S_HE-pgqj1i8okXSCFegE8DSHxOYBlPDLLYCowjgMTISFZj3I0iJm6zErldBArXSyZd0AM0FsQqmLqgM0o0tIx6iSmEBpeC0iST6ceqd8xu0riVyV0Gxhymf9DmFUNCnjarfborAHbf9hYmaEAM7u57Tft76dIJosT_IDqQX8 Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: e1c1386389504313acd3403c69705bfc Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e1c1386389504313acd3403c69705bfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e1c1386389504313acd3403c69705bfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e1c1386389504313acd3403c69705bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e1c1386389504313acd3403c69705bfc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: e1c1386389504313acd3403c69705bfc Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-KeyPairsNegativeTestJSON-1065039367-project Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 32a239f27e5649b6815ce83ec233b87d Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1065039367-project Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOW0Rrgf9JC0EwasD3czKl4JfHWU6V7ZrWw+agtBBGJgbaNGHC80xYuSDPA2AiAAFIaxiMsQ0Ccj7UDI7Wb6rgm8e0RoUSub4Tjz6sVQawOIV5GP9Tg47OLPtOoIbX8S/A=="}} Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOW0Rrgf9JC0EwasD3czKl4JfHWU6V7ZrWw+agtBBGJgbaNGHC80xYuSDPA2AiAAFIaxiMsQ0Ccj7UDI7Wb6rgm8e0RoUSub4Tjz6sVQawOIV5GP9Tg47OLPtOoIbX8S/A=='}}} Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6723, in import_key_pair Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6701, in _validate_new_key_pair Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:37:26.723711 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:37:26.729322 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:37:26.729322 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:37:26.729322 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:37:26.729322 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:37:26.729322 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:37:26.729322 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:37:26.729322 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 28 10:37:26.729322 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 28 10:37:26.729322 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 28 10:37:26.729322 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 28 10:37:26.729322 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 28 10:37:26.729322 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:26.729322 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:26.729322 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:26.729322 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:26.729322 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:26.729322 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:26.729322 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:37:26.729322 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:37:26.729322 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 28 10:37:26.729322 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:26.733494 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0026750b-dc1a-46b1-a7b8-e03cc19bce85 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:37:26.739070 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-0026750b-dc1a-46b1-a7b8-e03cc19bce85 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.676878 Jul 28 10:37:26.741342 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 440/901] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:37:26 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 681 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:37:26.753550 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b8f56c52-93d4-4470-b6a7-deb492d37855 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Action: 'create', calling method: .version_select at 0x7fa94b9feb80>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-51297502", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:26.819229 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-b8f56c52-93d4-4470-b6a7-deb492d37855 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Getting quotas for project e1c1386389504313acd3403c69705bfc. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:26.846050 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-b8f56c52-93d4-4470-b6a7-deb492d37855 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Getting quotas for user 32a239f27e5649b6815ce83ec233b87d and project e1c1386389504313acd3403c69705bfc. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:26.906524 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-b8f56c52-93d4-4470-b6a7-deb492d37855 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b8f56c52-93d4-4470-b6a7-deb492d37855 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Request method failure captured: Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 2165 Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mblO-S_HE-pgqj1i8okXSCFegE8DSHxOYBlPDLLYCowjgMTISFZj3I0iJm6zErldBArXSyZd0AM0FsQqmLqgM0o0tIx6iSmEBpeC0iST6ceqd8xu0riVyV0Gxhymf9DmFUNCnjarfborAHbf9hYmaEAM7u57Tft76dIJosT_IDqQX8 Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: e1c1386389504313acd3403c69705bfc Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e1c1386389504313acd3403c69705bfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e1c1386389504313acd3403c69705bfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e1c1386389504313acd3403c69705bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e1c1386389504313acd3403c69705bfc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: e1c1386389504313acd3403c69705bfc Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-KeyPairsNegativeTestJSON-1065039367-project Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 32a239f27e5649b6815ce83ec233b87d Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1065039367-project Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-51297502", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:37:26.929908 n-d-850468-6 devstack@n-api.service[119464]: exception: Keypair data is invalid: failed to generate fingerprint Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-51297502', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6740, in import_key_pair Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6813, in _generate_fingerprint Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:37:26.932814 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:37:26.936651 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:37:26.936651 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:37:26.936651 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:37:26.936651 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:37:26.936651 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 28 10:37:26.936651 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 28 10:37:26.936651 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 28 10:37:26.936651 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 28 10:37:26.936651 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 28 10:37:26.936651 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:26.936651 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:26.936651 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:26.936651 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:26.936651 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:26.936651 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:26.936651 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:37:26.936651 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:37:26.936651 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 28 10:37:26.936651 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:26.942770 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b8f56c52-93d4-4470-b6a7-deb492d37855 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:37:26.944160 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b8f56c52-93d4-4470-b6a7-deb492d37855 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.197144 Jul 28 10:37:26.946641 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 462/902] 10.222.0.46 () {60 vars in 1160 bytes} [Thu Jul 28 10:37:26 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 10:37:26.960560 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7d698595-8091-4a82-a3c8-91a277ad7943 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Action: 'create', calling method: .version_select at 0x7fa94b8f9e50>, body: {"keypair": {"name": "tempest-keypair-1506229533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfDoHxVCL9VgfktnOHMi7tyonKn/qgc2CGRTUTcw+akZIBe4g2C7L1o44VA+XwGJjb/ZBChq5njg9a6u42dVM2X2Bmb5jD/b3yeUKdDcSiw3pmpxMSKRS8PfQY8YgvEVA=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:27.025553 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-7d698595-8091-4a82-a3c8-91a277ad7943 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Getting quotas for project e1c1386389504313acd3403c69705bfc. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:27.039541 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-7d698595-8091-4a82-a3c8-91a277ad7943 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Getting quotas for user 32a239f27e5649b6815ce83ec233b87d and project e1c1386389504313acd3403c69705bfc. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:27.160410 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-7d698595-8091-4a82-a3c8-91a277ad7943 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.201682 Jul 28 10:37:27.180201 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-72e5036e-3aa9-4b8a-8496-3837200e513f tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Action: 'create', calling method: .version_select at 0x7fa94b90d3a0>, body: {"keypair": {"name": "tempest-keypair-1506229533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxRnB1C2xOFjZKYD8vOiRpi4AtapqYIL9hPXN6cBsmnTmOiPk1TCyeyFo0Fm+qeHqhpFgr3TwrvL7YIOpuAo0sAzpGYcowbcIbEy/BkKBkJ/GASNYXTUMYXy0TJ68SYuw=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:27.188437 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 441/903] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:37:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:27.243912 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-72e5036e-3aa9-4b8a-8496-3837200e513f tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Getting quotas for project e1c1386389504313acd3403c69705bfc. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:27.260644 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-72e5036e-3aa9-4b8a-8496-3837200e513f tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Getting quotas for user 32a239f27e5649b6815ce83ec233b87d and project e1c1386389504313acd3403c69705bfc. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:27.377122 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-72e5036e-3aa9-4b8a-8496-3837200e513f tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] HTTP exception thrown: Key pair 'tempest-keypair-1506229533' already exists. Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-72e5036e-3aa9-4b8a-8496-3837200e513f tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Request method failure captured: Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 273 Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mblO-S_HE-pgqj1i8okXSCFegE8DSHxOYBlPDLLYCowjgMTISFZj3I0iJm6zErldBArXSyZd0AM0FsQqmLqgM0o0tIx6iSmEBpeC0iST6ceqd8xu0riVyV0Gxhymf9DmFUNCnjarfborAHbf9hYmaEAM7u57Tft76dIJosT_IDqQX8 Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: e1c1386389504313acd3403c69705bfc Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e1c1386389504313acd3403c69705bfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e1c1386389504313acd3403c69705bfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e1c1386389504313acd3403c69705bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e1c1386389504313acd3403c69705bfc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: e1c1386389504313acd3403c69705bfc Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-KeyPairsNegativeTestJSON-1065039367-project Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 32a239f27e5649b6815ce83ec233b87d Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1065039367-project Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: {"keypair": {"name": "tempest-keypair-1506229533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxRnB1C2xOFjZKYD8vOiRpi4AtapqYIL9hPXN6cBsmnTmOiPk1TCyeyFo0Fm+qeHqhpFgr3TwrvL7YIOpuAo0sAzpGYcowbcIbEy/BkKBkJ/GASNYXTUMYXy0TJ68SYuw=="}} Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: exception: Key pair 'tempest-keypair-1506229533' already exists. Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1506229533', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxRnB1C2xOFjZKYD8vOiRpi4AtapqYIL9hPXN6cBsmnTmOiPk1TCyeyFo0Fm+qeHqhpFgr3TwrvL7YIOpuAo0sAzpGYcowbcIbEy/BkKBkJ/GASNYXTUMYXy0TJ68SYuw=='}}} Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result.read() Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '32a239f27e5649b6815ce83ec233b87d-tempest-keypair-1506229533' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 28 10:37:27.402364 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi session.flush() Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result.read() Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 28 10:37:27.406875 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '32a239f27e5649b6815ce83ec233b87d-tempest-keypair-1506229533' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 28, 10, 37, 27, 352511), 'updated_at': None, 'name': 'tempest-keypair-1506229533', 'user_id': '32a239f27e5649b6815ce83ec233b87d', 'fingerprint': 'da:1a:31:66:4d:79:79:e9:49:02:ba:8a:32:e9:b8:2b', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxRnB1C2xOFjZKYD8vOiRpi4AtapqYIL9hPXN6cBsmnTmOiPk1TCyeyFo0Fm+qeHqhpFgr3TwrvL7YIOpuAo0sAzpGYcowbcIbEy/BkKBkJ/GASNYXTUMYXy0TJ68SYuw==', 'type': 'ssh'}] Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6743, in import_key_pair Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi keypair.create() Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._create() Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1506229533' already exists. Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 28 10:37:27.414219 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1506229533' already exists. Jul 28 10:37:27.418999 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.418999 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:27.418999 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.418999 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:27.418999 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:27.418999 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:27.418999 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:37:27.418999 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:37:27.418999 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1506229533' already exists. Jul 28 10:37:27.418999 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.418999 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-72e5036e-3aa9-4b8a-8496-3837200e513f tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Returning 409 to user: Key pair 'tempest-keypair-1506229533' already exists. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:37:27.420680 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-72e5036e-3aa9-4b8a-8496-3837200e513f tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.239097 Jul 28 10:37:27.431039 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5efc3d63-8411-4ac1-9974-06149887ce24 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Calling method '.version_select at 0x7fa94bba8af0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:27.438326 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 463/904] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:37:27 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 265 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:37:27.466005 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-5efc3d63-8411-4ac1-9974-06149887ce24 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1506229533" status: 202 len: 0 microversion: 2.1 time: 0.038872 Jul 28 10:37:27.478111 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 442/905] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Jul 28 10:37:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1506229533 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:37:27.480540 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-23dc2be8-dd01-4de3-918a-1afc5a1fbe68 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Action: 'create', calling method: .version_select at 0x7fa94b937550>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFZLv/guNjQECL9oVtjiA7kLLKcIhU2W8q96lVdwP/rEy8m6wi3A/NwYdmlLKgEXi4SKlrwOkq2YDLarNXQyFIXvKf2vyA4kVoAe2MsjuuLdEN0bUGGS1Iiw/aH+fVG0Q=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-23dc2be8-dd01-4de3-918a-1afc5a1fbe68 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Request method failure captured: Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 247 Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mblO-S_HE-pgqj1i8okXSCFegE8DSHxOYBlPDLLYCowjgMTISFZj3I0iJm6zErldBArXSyZd0AM0FsQqmLqgM0o0tIx6iSmEBpeC0iST6ceqd8xu0riVyV0Gxhymf9DmFUNCnjarfborAHbf9hYmaEAM7u57Tft76dIJosT_IDqQX8 Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: e1c1386389504313acd3403c69705bfc Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e1c1386389504313acd3403c69705bfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e1c1386389504313acd3403c69705bfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e1c1386389504313acd3403c69705bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e1c1386389504313acd3403c69705bfc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: e1c1386389504313acd3403c69705bfc Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-KeyPairsNegativeTestJSON-1065039367-project Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 32a239f27e5649b6815ce83ec233b87d Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1065039367-project Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFZLv/guNjQECL9oVtjiA7kLLKcIhU2W8q96lVdwP/rEy8m6wi3A/NwYdmlLKgEXi4SKlrwOkq2YDLarNXQyFIXvKf2vyA4kVoAe2MsjuuLdEN0bUGGS1Iiw/aH+fVG0Q=="}} Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFZLv/guNjQECL9oVtjiA7kLLKcIhU2W8q96lVdwP/rEy8m6wi3A/NwYdmlLKgEXi4SKlrwOkq2YDLarNXQyFIXvKf2vyA4kVoAe2MsjuuLdEN0bUGGS1Iiw/aH+fVG0Q=='}}} Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise error Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi '' Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 10:37:27.505418 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 10:37:27.511760 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 10:37:27.511760 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 10:37:27.511760 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 10:37:27.511760 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 10:37:27.511760 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 28 10:37:27.511760 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.511760 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:27.511760 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.511760 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:27.511760 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:27.511760 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:27.511760 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 10:37:27.511760 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 10:37:27.511760 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 28 10:37:27.511760 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.514878 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-23dc2be8-dd01-4de3-918a-1afc5a1fbe68 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:37:27.524752 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-23dc2be8-dd01-4de3-918a-1afc5a1fbe68 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.039877 Jul 28 10:37:27.528410 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 464/906] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:37:27 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:37:27.538934 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ebf9d0f1-3a99-46e2-abee-52a4e60c390c tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Action: 'create', calling method: .version_select at 0x7fa94bdde820>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1952090843", "public_key": " "}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:27.557466 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-ebf9d0f1-3a99-46e2-abee-52a4e60c390c tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Getting quotas for project e1c1386389504313acd3403c69705bfc. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:27.587583 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-ebf9d0f1-3a99-46e2-abee-52a4e60c390c tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Getting quotas for user 32a239f27e5649b6815ce83ec233b87d and project e1c1386389504313acd3403c69705bfc. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:27.634463 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-ebf9d0f1-3a99-46e2-abee-52a4e60c390c tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ebf9d0f1-3a99-46e2-abee-52a4e60c390c tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Request method failure captured: Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 95 Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mblO-S_HE-pgqj1i8okXSCFegE8DSHxOYBlPDLLYCowjgMTISFZj3I0iJm6zErldBArXSyZd0AM0FsQqmLqgM0o0tIx6iSmEBpeC0iST6ceqd8xu0riVyV0Gxhymf9DmFUNCnjarfborAHbf9hYmaEAM7u57Tft76dIJosT_IDqQX8 Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: e1c1386389504313acd3403c69705bfc Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e1c1386389504313acd3403c69705bfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e1c1386389504313acd3403c69705bfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e1c1386389504313acd3403c69705bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e1c1386389504313acd3403c69705bfc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: e1c1386389504313acd3403c69705bfc Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-KeyPairsNegativeTestJSON-1065039367-project Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 32a239f27e5649b6815ce83ec233b87d Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1065039367-project Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1952090843", "public_key": " "}} Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: exception: Keypair data is invalid: failed to generate fingerprint Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1952090843', 'public_key': ' '}}} Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6740, in import_key_pair Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6813, in _generate_fingerprint Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:27.637337 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 28 10:37:27.643381 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.649775 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ebf9d0f1-3a99-46e2-abee-52a4e60c390c tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:37:27.651327 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ebf9d0f1-3a99-46e2-abee-52a4e60c390c tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.116729 Jul 28 10:37:27.653162 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 443/907] 10.222.0.46 () {60 vars in 1158 bytes} [Thu Jul 28 10:37:27 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 10:37:27.677374 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1d90142b-37b6-4942-a443-9542cdc0f666 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Action: 'create', calling method: .version_select at 0x7fa94b9e7790>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUBFl/u7in+FgfAj8+EPnzyV48+7KSLd1Qe1cO2Fd6tBTE1CtO+2VjJCLmP9S06yOb+1cs/KPwtErJtNqzuPLx/mNLJlGF9poe69iU6y3bkkEiXJnLDNE8TZ558f85HvA=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1d90142b-37b6-4942-a443-9542cdc0f666 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Request method failure captured: Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 507 Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mblO-S_HE-pgqj1i8okXSCFegE8DSHxOYBlPDLLYCowjgMTISFZj3I0iJm6zErldBArXSyZd0AM0FsQqmLqgM0o0tIx6iSmEBpeC0iST6ceqd8xu0riVyV0Gxhymf9DmFUNCnjarfborAHbf9hYmaEAM7u57Tft76dIJosT_IDqQX8 Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: e1c1386389504313acd3403c69705bfc Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e1c1386389504313acd3403c69705bfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e1c1386389504313acd3403c69705bfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e1c1386389504313acd3403c69705bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e1c1386389504313acd3403c69705bfc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: e1c1386389504313acd3403c69705bfc Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-KeyPairsNegativeTestJSON-1065039367-project Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 32a239f27e5649b6815ce83ec233b87d Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1065039367-project Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUBFl/u7in+FgfAj8+EPnzyV48+7KSLd1Qe1cO2Fd6tBTE1CtO+2VjJCLmP9S06yOb+1cs/KPwtErJtNqzuPLx/mNLJlGF9poe69iU6y3bkkEiXJnLDNE8TZ558f85HvA=="}} Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUBFl/u7in+FgfAj8+EPnzyV48+7KSLd1Qe1cO2Fd6tBTE1CtO+2VjJCLmP9S06yOb+1cs/KPwtErJtNqzuPLx/mNLJlGF9poe69iU6y3bkkEiXJnLDNE8TZ558f85HvA=='}}} Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise error Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 28 10:37:27.686616 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 28 10:37:27.692378 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.702246 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1d90142b-37b6-4942-a443-9542cdc0f666 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:37:27.705554 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1d90142b-37b6-4942-a443-9542cdc0f666 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.037157 Jul 28 10:37:27.712480 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 465/908] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:37:27 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:37:27.726700 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6eef46b4-0adb-49f3-8e65-82ee936aa18b tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Action: 'create', calling method: .version_select at 0x7fa94bc73e50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1193629158", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:27.753583 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-6eef46b4-0adb-49f3-8e65-82ee936aa18b tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Getting quotas for project e1c1386389504313acd3403c69705bfc. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:27.761436 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-6eef46b4-0adb-49f3-8e65-82ee936aa18b tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Getting quotas for user 32a239f27e5649b6815ce83ec233b87d and project e1c1386389504313acd3403c69705bfc. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:27.786455 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-6eef46b4-0adb-49f3-8e65-82ee936aa18b tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6eef46b4-0adb-49f3-8e65-82ee936aa18b tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Request method failure captured: Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 118 Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mblO-S_HE-pgqj1i8okXSCFegE8DSHxOYBlPDLLYCowjgMTISFZj3I0iJm6zErldBArXSyZd0AM0FsQqmLqgM0o0tIx6iSmEBpeC0iST6ceqd8xu0riVyV0Gxhymf9DmFUNCnjarfborAHbf9hYmaEAM7u57Tft76dIJosT_IDqQX8 Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: e1c1386389504313acd3403c69705bfc Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e1c1386389504313acd3403c69705bfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e1c1386389504313acd3403c69705bfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e1c1386389504313acd3403c69705bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e1c1386389504313acd3403c69705bfc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: e1c1386389504313acd3403c69705bfc Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-KeyPairsNegativeTestJSON-1065039367-project Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 32a239f27e5649b6815ce83ec233b87d Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1065039367-project Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1193629158", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: exception: Keypair data is invalid: failed to generate fingerprint Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1193629158', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6740, in import_key_pair Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6813, in _generate_fingerprint Jul 28 10:37:27.788436 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 28 10:37:27.793181 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.797157 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6eef46b4-0adb-49f3-8e65-82ee936aa18b tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:37:27.798918 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6eef46b4-0adb-49f3-8e65-82ee936aa18b tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.078777 Jul 28 10:37:27.799927 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 444/909] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:37:27 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 10:37:27.832357 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5febf5d4-cb5d-4df9-ae96-e96297731890 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Calling method '.version_select at 0x7fa94b9feb80>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:27.880196 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-5febf5d4-cb5d-4df9-ae96-e96297731890 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1001644403 not found for user 32a239f27e5649b6815ce83ec233b87d Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5febf5d4-cb5d-4df9-ae96-e96297731890 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Request method failure captured: Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1001644403 HTTP/1.1 Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mblO-S_HE-pgqj1i8okXSCFegE8DSHxOYBlPDLLYCowjgMTISFZj3I0iJm6zErldBArXSyZd0AM0FsQqmLqgM0o0tIx6iSmEBpeC0iST6ceqd8xu0riVyV0Gxhymf9DmFUNCnjarfborAHbf9hYmaEAM7u57Tft76dIJosT_IDqQX8 Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: e1c1386389504313acd3403c69705bfc Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e1c1386389504313acd3403c69705bfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e1c1386389504313acd3403c69705bfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e1c1386389504313acd3403c69705bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e1c1386389504313acd3403c69705bfc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: e1c1386389504313acd3403c69705bfc Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1065039367 Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-KeyPairsNegativeTestJSON-1065039367-project Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 32a239f27e5649b6815ce83ec233b87d Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1065039367-project Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: exception: Keypair tempest-keypair-non-existent-1001644403 not found for user 32a239f27e5649b6815ce83ec233b87d Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'tempest-keypair-non-existent-1001644403'} Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6827, in delete_key_pair Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6848, in get_key_pair Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1001644403 not found for user 32a239f27e5649b6815ce83ec233b87d Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.886588 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1001644403 not found for user 32a239f27e5649b6815ce83ec233b87d Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1001644403 not found for user 32a239f27e5649b6815ce83ec233b87d Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:27.895420 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5febf5d4-cb5d-4df9-ae96-e96297731890 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1001644403 not found for user 32a239f27e5649b6815ce83ec233b87d {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:37:27.898738 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-5febf5d4-cb5d-4df9-ae96-e96297731890 tempest-KeyPairsNegativeTestJSON-1065039367 tempest-KeyPairsNegativeTestJSON-1065039367-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1001644403" status: 404 len: 145 microversion: 2.1 time: 0.083706 Jul 28 10:37:27.900880 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 466/910] 10.222.0.46 () {58 vars in 1260 bytes} [Thu Jul 28 10:37:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1001644403 => generated 145 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:37:29.561287 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f8f84b95-4e57-4658-a799-ea0579f8dff1 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Action: 'create', calling method: .version_select at 0x7fa94bdde8b0>, body: {"keypair": {"name": "tempest-keypair-795338446", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+Sykbm3HJEA1KSsA6pzNX76Q8R2Gkk5IVyL2WVL0Lo0CgO1mIgMxZdDC2+0uc4brkTgQINZq2piGxOQa6XVM7HClilLx28WDK71cnInHKF26BSVFNohTz5KGcZKjf8xw=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:29.587907 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:29.618302 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-f8f84b95-4e57-4658-a799-ea0579f8dff1 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Getting quotas for project de552247daa44b5e8251b69d2c4caf7d. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:29.636791 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-f8f84b95-4e57-4658-a799-ea0579f8dff1 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Getting quotas for user 18b5b68766ca4b43bd10f931984dbbd4 and project de552247daa44b5e8251b69d2c4caf7d. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:29.692022 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f8f84b95-4e57-4658-a799-ea0579f8dff1 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.139313 Jul 28 10:37:29.697357 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 445/911] 10.222.0.46 () {62 vars in 1200 bytes} [Thu Jul 28 10:37:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 146 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 10:37:34.315497 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:34.317503 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=12 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:35.067336 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1148398506", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "d9e608ce-54d3-43b1-b332-dd984ba1da05"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:35.197479 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] validate_networks() for [('d9e608ce-54d3-43b1-b332-dd984ba1da05', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:37:37.296682 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=26 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:37.602297 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1129416617", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "60bf64ea-294b-4824-84f2-446926d7fb4a"}, {"port": "e2f418fe-36bf-4150-ac4f-85fd591324c2", "tag": "port-1"}, {"port": "3f8fc68a-a34a-4f15-bcee-da56a80f0527", "tag": "port-2"}, {"uuid": "5702b19c-6e25-4ab2-ad71-3543f5d7b83e", "tag": "net-1"}, {"uuid": "5702b19c-6e25-4ab2-ad71-3543f5d7b83e"}, {"uuid": "680d0d7c-d0e2-4c96-b801-28183a8a13dd", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "680d0d7c-d0e2-4c96-b801-28183a8a13dd", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "fce9258f-07ae-4eb8-9260-3b2ebc41e5b0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "48069353-764e-4675-9220-39c820e5fec5", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "ca79a4f6-919a-4be5-9ea2-8485710f9a60", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--3627035"}], "key_name": "tempest-keypair-795338446", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:37.609835 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:37:37.611198 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:37:37.612495 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:37:37.613245 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:37:37.613975 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:37:37.646267 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:37.647716 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:37.649023 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:37.649752 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:37.664866 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:37.717505 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Getting quotas for project 58597d8408554881b9e936c5983663d5. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:37.737783 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Getting quotas for user 1abbb9bb4988457abbf4ecf8005d33fb and project 58597d8408554881b9e936c5983663d5. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:37.773206 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:37:37.777969 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 030a8979-96ed-4c85-a352-7a682e3fa390] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:37:37.926424 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a3da0517-96aa-4ce8-9780-7a605ac32e9c tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.614476 Jul 28 10:37:37.934392 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 467/912] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:37:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 3626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:37:37.955542 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c76d744b-0631-4d9d-8714-6687ca93d405 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:37.967264 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c76d744b-0631-4d9d-8714-6687ca93d405 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 030a8979-96ed-4c85-a352-7a682e3fa390] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:38.066583 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] validate_networks() for [('60bf64ea-294b-4824-84f2-446926d7fb4a', None, None, None, None, None), (None, None, 'e2f418fe-36bf-4150-ac4f-85fd591324c2', None, None, None), (None, None, '3f8fc68a-a34a-4f15-bcee-da56a80f0527', None, None, None), ('5702b19c-6e25-4ab2-ad71-3543f5d7b83e', None, None, None, None, None), ('5702b19c-6e25-4ab2-ad71-3543f5d7b83e', None, None, None, None, None), ('680d0d7c-d0e2-4c96-b801-28183a8a13dd', '10.2.2.100', None, None, None, None), ('680d0d7c-d0e2-4c96-b801-28183a8a13dd', '10.2.2.200', None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:37:38.187160 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-c76d744b-0631-4d9d-8714-6687ca93d405 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abbb9bb4988457abbf4ecf8005d33fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58597d8408554881b9e936c5983663d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:38.214362 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c76d744b-0631-4d9d-8714-6687ca93d405 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] 10.222.0.46 "GET /compute/v2.1/servers/030a8979-96ed-4c85-a352-7a682e3fa390" status: 200 len: 1208 microversion: 2.1 time: 0.273149 Jul 28 10:37:38.218699 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 468/913] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:37:37 2022] GET /compute/v2.1/servers/030a8979-96ed-4c85-a352-7a682e3fa390 => generated 1208 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:39.247341 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-58f14844-3108-4346-84d3-a00dc95defa2 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:39.249204 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-58f14844-3108-4346-84d3-a00dc95defa2 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 030a8979-96ed-4c85-a352-7a682e3fa390] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:39.272682 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-58f14844-3108-4346-84d3-a00dc95defa2 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:39.285792 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-58f14844-3108-4346-84d3-a00dc95defa2 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:39.287222 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-58f14844-3108-4346-84d3-a00dc95defa2 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:39.291038 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-58f14844-3108-4346-84d3-a00dc95defa2 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:39.369209 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-58f14844-3108-4346-84d3-a00dc95defa2 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:39.370370 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-58f14844-3108-4346-84d3-a00dc95defa2 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:39.371179 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-58f14844-3108-4346-84d3-a00dc95defa2 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lazy-loading 'fault' on Instance uuid 030a8979-96ed-4c85-a352-7a682e3fa390 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:37:39.625845 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-58f14844-3108-4346-84d3-a00dc95defa2 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abbb9bb4988457abbf4ecf8005d33fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58597d8408554881b9e936c5983663d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:39.655000 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-58f14844-3108-4346-84d3-a00dc95defa2 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] 10.222.0.46 "GET /compute/v2.1/servers/030a8979-96ed-4c85-a352-7a682e3fa390" status: 200 len: 1281 microversion: 2.1 time: 0.415225 Jul 28 10:37:39.663215 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 469/914] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:37:39 2022] GET /compute/v2.1/servers/030a8979-96ed-4c85-a352-7a682e3fa390 => generated 1281 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:39.663834 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=42 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:40.101796 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1945765975", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "180b12f9-cf11-4e3c-b707-f07ef5d66391"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:40.197093 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] validate_networks() for [('180b12f9-cf11-4e3c-b707-f07ef5d66391', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:37:42.673237 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:37:42.673839 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:37:42.674376 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:37:42.674942 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:37:42.675368 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:37:42.677508 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:42.707167 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:42.707754 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:42.708789 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:42.709354 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:42.777392 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Getting quotas for project 243bfecc2f9744e087fe60f72caa3b84. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:42.794930 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Getting quotas for user ec88a8daaeb940d89d7f305fca4f5863 and project 243bfecc2f9744e087fe60f72caa3b84. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:42.831964 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:37:42.834546 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: aa95581c-2e3a-49a5-a208-17a11ed46f20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:37:42.942236 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-5120ef00-5ed8-48ff-ad16-f5a97ecdbd1a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.275409 Jul 28 10:37:42.943875 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 470/915] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:37:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:37:42.951102 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0deaa3b2-a517-45c6-a2ec-4b0b14c8f43a tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:42.952141 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0deaa3b2-a517-45c6-a2ec-4b0b14c8f43a tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 030a8979-96ed-4c85-a352-7a682e3fa390] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:42.987491 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0deaa3b2-a517-45c6-a2ec-4b0b14c8f43a tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:42.996390 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0deaa3b2-a517-45c6-a2ec-4b0b14c8f43a tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:43.000304 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0deaa3b2-a517-45c6-a2ec-4b0b14c8f43a tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:43.003530 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0deaa3b2-a517-45c6-a2ec-4b0b14c8f43a tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:43.038014 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0deaa3b2-a517-45c6-a2ec-4b0b14c8f43a tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 030a8979-96ed-4c85-a352-7a682e3fa390] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:37:43.140459 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0deaa3b2-a517-45c6-a2ec-4b0b14c8f43a tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 030a8979-96ed-4c85-a352-7a682e3fa390] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:37:43.147932 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0deaa3b2-a517-45c6-a2ec-4b0b14c8f43a tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:43.148541 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0deaa3b2-a517-45c6-a2ec-4b0b14c8f43a tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:43.149101 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-0deaa3b2-a517-45c6-a2ec-4b0b14c8f43a tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 030a8979-96ed-4c85-a352-7a682e3fa390] instance's host None is down, deleting from database Jul 28 10:37:43.167733 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0deaa3b2-a517-45c6-a2ec-4b0b14c8f43a tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 030a8979-96ed-4c85-a352-7a682e3fa390] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:37:43.354540 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0deaa3b2-a517-45c6-a2ec-4b0b14c8f43a tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 030a8979-96ed-4c85-a352-7a682e3fa390] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:37:43.366920 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0deaa3b2-a517-45c6-a2ec-4b0b14c8f43a tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 030a8979-96ed-4c85-a352-7a682e3fa390] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:37:43.820476 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0deaa3b2-a517-45c6-a2ec-4b0b14c8f43a tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] 10.222.0.46 "DELETE /compute/v2.1/servers/030a8979-96ed-4c85-a352-7a682e3fa390" status: 204 len: 0 microversion: 2.1 time: 0.874444 Jul 28 10:37:43.824330 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 471/916] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:37:42 2022] DELETE /compute/v2.1/servers/030a8979-96ed-4c85-a352-7a682e3fa390 => generated 0 bytes in 876 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:37:43.836133 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-658f9b1b-0af3-4cf1-9ba4-309a954aeee2 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:43.836810 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-658f9b1b-0af3-4cf1-9ba4-309a954aeee2 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: aa95581c-2e3a-49a5-a208-17a11ed46f20] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:43.851453 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-658f9b1b-0af3-4cf1-9ba4-309a954aeee2 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:43.851908 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-658f9b1b-0af3-4cf1-9ba4-309a954aeee2 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:43.852890 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-658f9b1b-0af3-4cf1-9ba4-309a954aeee2 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:43.853196 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-658f9b1b-0af3-4cf1-9ba4-309a954aeee2 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:43.889524 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-658f9b1b-0af3-4cf1-9ba4-309a954aeee2 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:43.890028 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-658f9b1b-0af3-4cf1-9ba4-309a954aeee2 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:43.890821 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-658f9b1b-0af3-4cf1-9ba4-309a954aeee2 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lazy-loading 'fault' on Instance uuid aa95581c-2e3a-49a5-a208-17a11ed46f20 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:37:44.095824 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-658f9b1b-0af3-4cf1-9ba4-309a954aeee2 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec88a8daaeb940d89d7f305fca4f5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243bfecc2f9744e087fe60f72caa3b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:44.111135 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-658f9b1b-0af3-4cf1-9ba4-309a954aeee2 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] 10.222.0.46 "GET /compute/v2.1/servers/aa95581c-2e3a-49a5-a208-17a11ed46f20" status: 200 len: 1291 microversion: 2.1 time: 0.285635 Jul 28 10:37:44.116955 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 472/917] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:37:43 2022] GET /compute/v2.1/servers/aa95581c-2e3a-49a5-a208-17a11ed46f20 => generated 1291 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:44.133189 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-065aaa9c-9f0d-454b-b67b-a4576b3e388b tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:44.134272 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-065aaa9c-9f0d-454b-b67b-a4576b3e388b tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 030a8979-96ed-4c85-a352-7a682e3fa390] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:44.148022 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-065aaa9c-9f0d-454b-b67b-a4576b3e388b tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:44.150353 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-065aaa9c-9f0d-454b-b67b-a4576b3e388b tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:44.152334 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-065aaa9c-9f0d-454b-b67b-a4576b3e388b tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:44.157503 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-065aaa9c-9f0d-454b-b67b-a4576b3e388b tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:44.176423 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-065aaa9c-9f0d-454b-b67b-a4576b3e388b tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] HTTP exception thrown: Instance 030a8979-96ed-4c85-a352-7a682e3fa390 could not be found. Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-065aaa9c-9f0d-454b-b67b-a4576b3e388b tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Request method failure captured: Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/030a8979-96ed-4c85-a352-7a682e3fa390 HTTP/1.1 Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mbtkvMjuUKaU1wx902eD3Y6JnTep6fYztVEEYH9qcoBlbEPwGHd3TIDToJJH3lRwFoRmTs2GK4OuYr26uDQGK0iZlHIo0AQUR-5FqJzLozT2WmrsxTwC5moQBH7BMOfKpiWONIGFcASWY5bqI6GKdEHyQH_jTP54i887bapyp2eqqI Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 58597d8408554881b9e936c5983663d5 Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ImagesTestJSON-1229646692 Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/58597d8408554881b9e936c5983663d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/58597d8408554881b9e936c5983663d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/58597d8408554881b9e936c5983663d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_58597d8408554881b9e936c5983663d5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ImagesTestJSON-1229646692 Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 58597d8408554881b9e936c5983663d5 Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ImagesTestJSON-1229646692 Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ImagesTestJSON-1229646692-project Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 1abbb9bb4988457abbf4ecf8005d33fb Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ImagesTestJSON-1229646692-project Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 030a8979-96ed-4c85-a352-7a682e3fa390 could not be found. Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '030a8979-96ed-4c85-a352-7a682e3fa390'} Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 030a8979-96ed-4c85-a352-7a682e3fa390 could not be found. Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 030a8979-96ed-4c85-a352-7a682e3fa390 could not be found. Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:44.188401 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:44.192690 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:44.192690 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:44.192690 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:37:44.192690 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:37:44.192690 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 030a8979-96ed-4c85-a352-7a682e3fa390 could not be found. Jul 28 10:37:44.192690 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:44.195400 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-065aaa9c-9f0d-454b-b67b-a4576b3e388b tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Returning 404 to user: Instance 030a8979-96ed-4c85-a352-7a682e3fa390 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:37:44.197454 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-065aaa9c-9f0d-454b-b67b-a4576b3e388b tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] 10.222.0.46 "GET /compute/v2.1/servers/030a8979-96ed-4c85-a352-7a682e3fa390" status: 404 len: 111 microversion: 2.1 time: 0.079163 Jul 28 10:37:44.200511 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 473/918] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:37:44 2022] GET /compute/v2.1/servers/030a8979-96ed-4c85-a352-7a682e3fa390 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:37:44.792285 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1749041162", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "d9e608ce-54d3-43b1-b332-dd984ba1da05"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:44.940187 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] validate_networks() for [('d9e608ce-54d3-43b1-b332-dd984ba1da05', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:37:45.787552 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:37:45.787949 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:37:45.788425 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:37:45.788831 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:37:45.789340 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:37:45.830974 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:45.834947 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:45.839830 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:45.840327 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:45.897068 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:37:45.897657 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:37:45.898347 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:37:45.898954 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:37:45.899476 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:37:45.917258 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Getting quotas for project 58597d8408554881b9e936c5983663d5. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:45.918182 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:45.919003 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:45.920656 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:45.921367 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:45.938613 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Getting quotas for user 1abbb9bb4988457abbf4ecf8005d33fb and project 58597d8408554881b9e936c5983663d5. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:45.971735 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Getting quotas for project de552247daa44b5e8251b69d2c4caf7d. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:45.982822 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:37:45.986291 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 00707657-cc6f-4d56-9a4d-d7981d0766f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:37:45.988581 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Getting quotas for user 18b5b68766ca4b43bd10f931984dbbd4 and project de552247daa44b5e8251b69d2c4caf7d. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:46.152981 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-773dad74-640a-4b1c-a224-a174ac711b59 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.364151 Jul 28 10:37:46.173567 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 474/919] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:37:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:37:46.190265 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2119b5fa-78a7-47d1-a360-3ff947707213 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:46.190895 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-2119b5fa-78a7-47d1-a360-3ff947707213 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: aa95581c-2e3a-49a5-a208-17a11ed46f20] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:46.221070 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2119b5fa-78a7-47d1-a360-3ff947707213 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:46.221551 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2119b5fa-78a7-47d1-a360-3ff947707213 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:46.230101 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2119b5fa-78a7-47d1-a360-3ff947707213 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:46.230568 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2119b5fa-78a7-47d1-a360-3ff947707213 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:46.348000 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2119b5fa-78a7-47d1-a360-3ff947707213 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:46.350915 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2119b5fa-78a7-47d1-a360-3ff947707213 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:46.353084 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-2119b5fa-78a7-47d1-a360-3ff947707213 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lazy-loading 'fault' on Instance uuid aa95581c-2e3a-49a5-a208-17a11ed46f20 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:37:46.458935 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:37:46.462191 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] [instance: 5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='fce9258f-07ae-4eb8-9260-3b2ebc41e5b0',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='48069353-764e-4675-9220-39c820e5fec5',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca79a4f6-919a-4be5-9ea2-8485710f9a60',volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:37:46.485409 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-2119b5fa-78a7-47d1-a360-3ff947707213 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec88a8daaeb940d89d7f305fca4f5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243bfecc2f9744e087fe60f72caa3b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:46.507045 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-2119b5fa-78a7-47d1-a360-3ff947707213 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] 10.222.0.46 "GET /compute/v2.1/servers/aa95581c-2e3a-49a5-a208-17a11ed46f20" status: 200 len: 1291 microversion: 2.1 time: 0.332191 Jul 28 10:37:46.510176 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 475/920] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:37:46 2022] GET /compute/v2.1/servers/aa95581c-2e3a-49a5-a208-17a11ed46f20 => generated 1291 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:46.515350 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-bdfbb134-5090-4d0b-8e72-6d5861368b0e tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:46.517078 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-bdfbb134-5090-4d0b-8e72-6d5861368b0e tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 00707657-cc6f-4d56-9a4d-d7981d0766f6] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:46.767553 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-bdfbb134-5090-4d0b-8e72-6d5861368b0e tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abbb9bb4988457abbf4ecf8005d33fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58597d8408554881b9e936c5983663d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:46.781166 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-bdfbb134-5090-4d0b-8e72-6d5861368b0e tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] 10.222.0.46 "GET /compute/v2.1/servers/00707657-cc6f-4d56-9a4d-d7981d0766f6" status: 200 len: 1208 microversion: 2.1 time: 0.266911 Jul 28 10:37:46.786581 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 476/921] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:37:46 2022] GET /compute/v2.1/servers/00707657-cc6f-4d56-9a4d-d7981d0766f6 => generated 1208 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:46.829459 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0cb90d3f-bdd0-494f-b47a-fce064c7e204 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:46.830951 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0cb90d3f-bdd0-494f-b47a-fce064c7e204 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: aa95581c-2e3a-49a5-a208-17a11ed46f20] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:46.859401 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0cb90d3f-bdd0-494f-b47a-fce064c7e204 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:46.861070 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0cb90d3f-bdd0-494f-b47a-fce064c7e204 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:46.863416 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0cb90d3f-bdd0-494f-b47a-fce064c7e204 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:46.865437 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0cb90d3f-bdd0-494f-b47a-fce064c7e204 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:46.938263 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0cb90d3f-bdd0-494f-b47a-fce064c7e204 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: aa95581c-2e3a-49a5-a208-17a11ed46f20] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:37:47.052803 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0cb90d3f-bdd0-494f-b47a-fce064c7e204 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: aa95581c-2e3a-49a5-a208-17a11ed46f20] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:37:47.055826 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0cb90d3f-bdd0-494f-b47a-fce064c7e204 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:47.056327 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0cb90d3f-bdd0-494f-b47a-fce064c7e204 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:47.056798 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-0cb90d3f-bdd0-494f-b47a-fce064c7e204 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: aa95581c-2e3a-49a5-a208-17a11ed46f20] instance's host None is down, deleting from database Jul 28 10:37:47.070504 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0cb90d3f-bdd0-494f-b47a-fce064c7e204 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: aa95581c-2e3a-49a5-a208-17a11ed46f20] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:37:47.290427 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c04e99fb-160f-47f1-bb56-08539abebeee tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.32 time: 9.697459 Jul 28 10:37:47.292175 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 446/922] 10.222.0.46 () {62 vars in 1189 bytes} [Thu Jul 28 10:37:37 2022] POST /compute/v2.1/servers => generated 403 bytes in 9700 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 10:37:47.312270 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-373b92f3-0120-4153-9301-1164d174b4a9 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:47.319812 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-373b92f3-0120-4153-9301-1164d174b4a9 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] [instance: 5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:47.348519 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0cb90d3f-bdd0-494f-b47a-fce064c7e204 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: aa95581c-2e3a-49a5-a208-17a11ed46f20] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:37:47.357946 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0cb90d3f-bdd0-494f-b47a-fce064c7e204 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: aa95581c-2e3a-49a5-a208-17a11ed46f20] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:37:47.505718 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=75,nova_cell0:UPDATE=19,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:47.519487 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-373b92f3-0120-4153-9301-1164d174b4a9 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b5b68766ca4b43bd10f931984dbbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de552247daa44b5e8251b69d2c4caf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:47.530789 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-373b92f3-0120-4153-9301-1164d174b4a9 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18b5b68766ca4b43bd10f931984dbbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de552247daa44b5e8251b69d2c4caf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:47.533098 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-373b92f3-0120-4153-9301-1164d174b4a9 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18b5b68766ca4b43bd10f931984dbbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de552247daa44b5e8251b69d2c4caf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:47.534323 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-373b92f3-0120-4153-9301-1164d174b4a9 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] 10.222.0.46 "GET /compute/v2.1/servers/5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3" status: 200 len: 1285 microversion: 2.32 time: 0.229079 Jul 28 10:37:47.561887 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 447/923] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:37:47 2022] GET /compute/v2.1/servers/5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3 => generated 1285 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:37:47.767997 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0cb90d3f-bdd0-494f-b47a-fce064c7e204 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] 10.222.0.46 "DELETE /compute/v2.1/servers/aa95581c-2e3a-49a5-a208-17a11ed46f20" status: 204 len: 0 microversion: 2.1 time: 0.967190 Jul 28 10:37:47.769784 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 477/924] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:37:46 2022] DELETE /compute/v2.1/servers/aa95581c-2e3a-49a5-a208-17a11ed46f20 => generated 0 bytes in 981 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:37:47.780139 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d4734039-d675-46b7-a4f0-5da0d2ddb83e tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:47.781257 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-d4734039-d675-46b7-a4f0-5da0d2ddb83e tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: aa95581c-2e3a-49a5-a208-17a11ed46f20] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:47.811677 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0271b05f-25ec-49b9-844e-84e859b32077 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:47.812436 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0271b05f-25ec-49b9-844e-84e859b32077 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 00707657-cc6f-4d56-9a4d-d7981d0766f6] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:47.827023 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d4734039-d675-46b7-a4f0-5da0d2ddb83e tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:47.827541 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d4734039-d675-46b7-a4f0-5da0d2ddb83e tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:47.833545 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d4734039-d675-46b7-a4f0-5da0d2ddb83e tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:47.834198 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d4734039-d675-46b7-a4f0-5da0d2ddb83e tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:47.854541 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0271b05f-25ec-49b9-844e-84e859b32077 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:47.857430 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0271b05f-25ec-49b9-844e-84e859b32077 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:47.863544 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0271b05f-25ec-49b9-844e-84e859b32077 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:47.869449 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0271b05f-25ec-49b9-844e-84e859b32077 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:47.912310 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-d4734039-d675-46b7-a4f0-5da0d2ddb83e tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] HTTP exception thrown: Instance aa95581c-2e3a-49a5-a208-17a11ed46f20 could not be found. Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d4734039-d675-46b7-a4f0-5da0d2ddb83e tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Request method failure captured: Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/aa95581c-2e3a-49a5-a208-17a11ed46f20 HTTP/1.1 Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mby_GkaIG7K_JbkuaDmgiClbfpniA0ViLMKZfyqXJbKXTEPKpoA0cDUqTqgqOO7--KbkbQghIfXRpmtgmA61vaG_IFRc6tbwcEFVkDyOR2o1xBvhvAFRGNxPLtaILYSooT2dv4wDSTq9Gw1MoIYXy-n7qQt7Ol1WN0owspTDmDIOWE Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 243bfecc2f9744e087fe60f72caa3b84 Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1692557787 Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/243bfecc2f9744e087fe60f72caa3b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/243bfecc2f9744e087fe60f72caa3b84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/243bfecc2f9744e087fe60f72caa3b84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_243bfecc2f9744e087fe60f72caa3b84", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServerDiskConfigTestJSON-1692557787 Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 243bfecc2f9744e087fe60f72caa3b84 Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1692557787 Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServerDiskConfigTestJSON-1692557787-project Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: ec88a8daaeb940d89d7f305fca4f5863 Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServerDiskConfigTestJSON-1692557787-project Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance aa95581c-2e3a-49a5-a208-17a11ed46f20 could not be found. Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'aa95581c-2e3a-49a5-a208-17a11ed46f20'} Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa95581c-2e3a-49a5-a208-17a11ed46f20 could not be found. Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa95581c-2e3a-49a5-a208-17a11ed46f20 could not be found. Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:47.923891 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:47.928816 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:47.928816 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:47.928816 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:47.928816 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:37:47.928816 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:37:47.928816 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa95581c-2e3a-49a5-a208-17a11ed46f20 could not be found. Jul 28 10:37:47.928816 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:47.931222 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d4734039-d675-46b7-a4f0-5da0d2ddb83e tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Returning 404 to user: Instance aa95581c-2e3a-49a5-a208-17a11ed46f20 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:37:47.932563 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d4734039-d675-46b7-a4f0-5da0d2ddb83e tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] 10.222.0.46 "GET /compute/v2.1/servers/aa95581c-2e3a-49a5-a208-17a11ed46f20" status: 404 len: 111 microversion: 2.1 time: 0.159380 Jul 28 10:37:47.940494 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 448/925] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:37:47 2022] GET /compute/v2.1/servers/aa95581c-2e3a-49a5-a208-17a11ed46f20 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:37:47.984382 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0271b05f-25ec-49b9-844e-84e859b32077 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:47.985804 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0271b05f-25ec-49b9-844e-84e859b32077 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:47.986931 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-0271b05f-25ec-49b9-844e-84e859b32077 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lazy-loading 'fault' on Instance uuid 00707657-cc6f-4d56-9a4d-d7981d0766f6 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:37:48.162551 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-0271b05f-25ec-49b9-844e-84e859b32077 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abbb9bb4988457abbf4ecf8005d33fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58597d8408554881b9e936c5983663d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:48.173295 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0271b05f-25ec-49b9-844e-84e859b32077 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] 10.222.0.46 "GET /compute/v2.1/servers/00707657-cc6f-4d56-9a4d-d7981d0766f6" status: 200 len: 1281 microversion: 2.1 time: 0.367876 Jul 28 10:37:48.173929 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 478/926] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:37:47 2022] GET /compute/v2.1/servers/00707657-cc6f-4d56-9a4d-d7981d0766f6 => generated 1281 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:37:48.198131 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-67f935d3-84af-4d75-acf7-ffca86503643 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:48.199071 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-67f935d3-84af-4d75-acf7-ffca86503643 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 00707657-cc6f-4d56-9a4d-d7981d0766f6] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:48.210844 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-67f935d3-84af-4d75-acf7-ffca86503643 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:48.213809 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-67f935d3-84af-4d75-acf7-ffca86503643 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:48.214878 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-67f935d3-84af-4d75-acf7-ffca86503643 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:48.215481 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-67f935d3-84af-4d75-acf7-ffca86503643 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:48.327491 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-67f935d3-84af-4d75-acf7-ffca86503643 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 00707657-cc6f-4d56-9a4d-d7981d0766f6] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:37:48.498462 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-67f935d3-84af-4d75-acf7-ffca86503643 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 00707657-cc6f-4d56-9a4d-d7981d0766f6] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:37:48.499292 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-67f935d3-84af-4d75-acf7-ffca86503643 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:48.499900 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-67f935d3-84af-4d75-acf7-ffca86503643 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:48.500513 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-67f935d3-84af-4d75-acf7-ffca86503643 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 00707657-cc6f-4d56-9a4d-d7981d0766f6] instance's host None is down, deleting from database Jul 28 10:37:48.505386 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-67f935d3-84af-4d75-acf7-ffca86503643 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 00707657-cc6f-4d56-9a4d-d7981d0766f6] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:37:48.534449 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1924389969", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "180b12f9-cf11-4e3c-b707-f07ef5d66391"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:48.639240 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] validate_networks() for [('180b12f9-cf11-4e3c-b707-f07ef5d66391', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:37:48.666102 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-67f935d3-84af-4d75-acf7-ffca86503643 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 00707657-cc6f-4d56-9a4d-d7981d0766f6] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:37:48.672409 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-67f935d3-84af-4d75-acf7-ffca86503643 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 00707657-cc6f-4d56-9a4d-d7981d0766f6] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:37:49.020777 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-67f935d3-84af-4d75-acf7-ffca86503643 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] 10.222.0.46 "DELETE /compute/v2.1/servers/00707657-cc6f-4d56-9a4d-d7981d0766f6" status: 204 len: 0 microversion: 2.1 time: 0.826041 Jul 28 10:37:49.021395 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 449/927] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:37:48 2022] DELETE /compute/v2.1/servers/00707657-cc6f-4d56-9a4d-d7981d0766f6 => generated 0 bytes in 828 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 10:37:49.038574 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-51d531a0-64e8-4995-89ea-705f96e011af tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:49.039476 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-51d531a0-64e8-4995-89ea-705f96e011af tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] [instance: 5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:49.166473 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-51d531a0-64e8-4995-89ea-705f96e011af tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b5b68766ca4b43bd10f931984dbbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de552247daa44b5e8251b69d2c4caf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:49.180491 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-51d531a0-64e8-4995-89ea-705f96e011af tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18b5b68766ca4b43bd10f931984dbbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de552247daa44b5e8251b69d2c4caf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:49.187091 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-51d531a0-64e8-4995-89ea-705f96e011af tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18b5b68766ca4b43bd10f931984dbbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de552247daa44b5e8251b69d2c4caf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:49.188967 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-51d531a0-64e8-4995-89ea-705f96e011af tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] 10.222.0.46 "GET /compute/v2.1/servers/5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3" status: 200 len: 1285 microversion: 2.32 time: 0.162976 Jul 28 10:37:49.201516 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 450/928] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:37:49 2022] GET /compute/v2.1/servers/5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3 => generated 1285 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:37:49.208381 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-cbfe2aa6-9d76-449f-b6dd-b8476769ef60 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:49.209268 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-cbfe2aa6-9d76-449f-b6dd-b8476769ef60 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 00707657-cc6f-4d56-9a4d-d7981d0766f6] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:49.223567 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cbfe2aa6-9d76-449f-b6dd-b8476769ef60 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:49.235194 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cbfe2aa6-9d76-449f-b6dd-b8476769ef60 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:49.236334 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cbfe2aa6-9d76-449f-b6dd-b8476769ef60 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:49.236928 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cbfe2aa6-9d76-449f-b6dd-b8476769ef60 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:49.260662 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-cbfe2aa6-9d76-449f-b6dd-b8476769ef60 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] HTTP exception thrown: Instance 00707657-cc6f-4d56-9a4d-d7981d0766f6 could not be found. Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-cbfe2aa6-9d76-449f-b6dd-b8476769ef60 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Request method failure captured: Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/00707657-cc6f-4d56-9a4d-d7981d0766f6 HTTP/1.1 Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mbtkvMjuUKaU1wx902eD3Y6JnTep6fYztVEEYH9qcoBlbEPwGHd3TIDToJJH3lRwFoRmTs2GK4OuYr26uDQGK0iZlHIo0AQUR-5FqJzLozT2WmrsxTwC5moQBH7BMOfKpiWONIGFcASWY5bqI6GKdEHyQH_jTP54i887bapyp2eqqI Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 58597d8408554881b9e936c5983663d5 Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ImagesTestJSON-1229646692 Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/58597d8408554881b9e936c5983663d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/58597d8408554881b9e936c5983663d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/58597d8408554881b9e936c5983663d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_58597d8408554881b9e936c5983663d5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ImagesTestJSON-1229646692 Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 58597d8408554881b9e936c5983663d5 Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ImagesTestJSON-1229646692 Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ImagesTestJSON-1229646692-project Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 1abbb9bb4988457abbf4ecf8005d33fb Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ImagesTestJSON-1229646692-project Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 00707657-cc6f-4d56-9a4d-d7981d0766f6 could not be found. Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '00707657-cc6f-4d56-9a4d-d7981d0766f6'} Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00707657-cc6f-4d56-9a4d-d7981d0766f6 could not be found. Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00707657-cc6f-4d56-9a4d-d7981d0766f6 could not be found. Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:49.263799 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:49.267955 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:49.267955 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:49.267955 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:37:49.267955 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:37:49.267955 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00707657-cc6f-4d56-9a4d-d7981d0766f6 could not be found. Jul 28 10:37:49.267955 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:49.272294 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-cbfe2aa6-9d76-449f-b6dd-b8476769ef60 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Returning 404 to user: Instance 00707657-cc6f-4d56-9a4d-d7981d0766f6 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:37:49.274874 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-cbfe2aa6-9d76-449f-b6dd-b8476769ef60 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] 10.222.0.46 "GET /compute/v2.1/servers/00707657-cc6f-4d56-9a4d-d7981d0766f6" status: 404 len: 111 microversion: 2.1 time: 0.071672 Jul 28 10:37:49.276166 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 451/929] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:37:49 2022] GET /compute/v2.1/servers/00707657-cc6f-4d56-9a4d-d7981d0766f6 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:37:50.174112 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-88046992", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "d9e608ce-54d3-43b1-b332-dd984ba1da05"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:50.285185 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] validate_networks() for [('d9e608ce-54d3-43b1-b332-dd984ba1da05', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:37:51.180066 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:37:51.182036 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:37:51.182561 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:37:51.182976 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:37:51.183390 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:37:51.194731 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:51.195180 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:51.195999 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:51.196413 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:51.251607 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Getting quotas for project 243bfecc2f9744e087fe60f72caa3b84. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:51.257434 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Getting quotas for user ec88a8daaeb940d89d7f305fca4f5863 and project 243bfecc2f9744e087fe60f72caa3b84. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:51.279224 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:37:51.279452 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:37:51.279990 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:37:51.280279 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:37:51.280854 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:37:51.282059 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:37:51.285593 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: ea4e8786-72aa-43db-93fa-5019d4660abf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:37:51.300342 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:51.301565 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:51.302736 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:51.303359 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:51.347635 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Getting quotas for project 58597d8408554881b9e936c5983663d5. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:51.353955 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Getting quotas for user 1abbb9bb4988457abbf4ecf8005d33fb and project 58597d8408554881b9e936c5983663d5. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:51.365639 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ce0684b2-41cc-426d-81e6-bd86d90375c8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.834886 Jul 28 10:37:51.371226 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:37:51.371435 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 479/930] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:37:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 10:37:51.373963 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 5907653e-bb61-4646-a7f8-97c5fe15a805] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:37:51.378082 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5bf20073-1322-41b8-a9e2-9cb0824dafc2 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:51.380750 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5bf20073-1322-41b8-a9e2-9cb0824dafc2 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] [instance: 5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:51.397210 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5bf20073-1322-41b8-a9e2-9cb0824dafc2 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:51.398901 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5bf20073-1322-41b8-a9e2-9cb0824dafc2 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:51.399801 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5bf20073-1322-41b8-a9e2-9cb0824dafc2 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:51.402081 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5bf20073-1322-41b8-a9e2-9cb0824dafc2 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:51.470691 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5bf20073-1322-41b8-a9e2-9cb0824dafc2 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:51.471341 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5bf20073-1322-41b8-a9e2-9cb0824dafc2 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:51.471977 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-5bf20073-1322-41b8-a9e2-9cb0824dafc2 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lazy-loading 'fault' on Instance uuid 5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:37:51.515413 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-60ba496e-a268-46c9-8d18-a24147a55ba6 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.346234 Jul 28 10:37:51.518064 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 452/931] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:37:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:37:51.529349 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-563c4720-eaae-4394-87af-66c1ef52787a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:51.532975 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-563c4720-eaae-4394-87af-66c1ef52787a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: ea4e8786-72aa-43db-93fa-5019d4660abf] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:51.639533 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-563c4720-eaae-4394-87af-66c1ef52787a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec88a8daaeb940d89d7f305fca4f5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243bfecc2f9744e087fe60f72caa3b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:51.649478 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-563c4720-eaae-4394-87af-66c1ef52787a tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] 10.222.0.46 "GET /compute/v2.1/servers/ea4e8786-72aa-43db-93fa-5019d4660abf" status: 200 len: 1218 microversion: 2.1 time: 0.129092 Jul 28 10:37:51.653465 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 453/932] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:37:51 2022] GET /compute/v2.1/servers/ea4e8786-72aa-43db-93fa-5019d4660abf => generated 1218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:51.669401 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-5bf20073-1322-41b8-a9e2-9cb0824dafc2 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b5b68766ca4b43bd10f931984dbbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de552247daa44b5e8251b69d2c4caf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:51.680499 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-38facb40-d5f6-4f79-8505-8f5973fcc078 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:51.681123 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-38facb40-d5f6-4f79-8505-8f5973fcc078 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 5907653e-bb61-4646-a7f8-97c5fe15a805] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:51.682959 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-5bf20073-1322-41b8-a9e2-9cb0824dafc2 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18b5b68766ca4b43bd10f931984dbbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de552247daa44b5e8251b69d2c4caf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:51.687149 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-5bf20073-1322-41b8-a9e2-9cb0824dafc2 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18b5b68766ca4b43bd10f931984dbbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de552247daa44b5e8251b69d2c4caf7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:51.693931 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-5bf20073-1322-41b8-a9e2-9cb0824dafc2 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] 10.222.0.46 "GET /compute/v2.1/servers/5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3" status: 200 len: 1596 microversion: 2.32 time: 0.321373 Jul 28 10:37:51.696190 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 480/933] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:37:51 2022] GET /compute/v2.1/servers/5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3 => generated 1596 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:37:51.730939 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5c450402-9592-43ad-9918-3c292ab1437d tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:51.733128 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5c450402-9592-43ad-9918-3c292ab1437d tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] [instance: 5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:51.751532 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5c450402-9592-43ad-9918-3c292ab1437d tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:51.752535 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5c450402-9592-43ad-9918-3c292ab1437d tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:51.753601 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5c450402-9592-43ad-9918-3c292ab1437d tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:51.754606 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5c450402-9592-43ad-9918-3c292ab1437d tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:51.831625 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5c450402-9592-43ad-9918-3c292ab1437d tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] [instance: 5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:37:51.854785 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-38facb40-d5f6-4f79-8505-8f5973fcc078 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abbb9bb4988457abbf4ecf8005d33fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58597d8408554881b9e936c5983663d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:51.864222 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-38facb40-d5f6-4f79-8505-8f5973fcc078 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] 10.222.0.46 "GET /compute/v2.1/servers/5907653e-bb61-4646-a7f8-97c5fe15a805" status: 200 len: 1206 microversion: 2.1 time: 0.209344 Jul 28 10:37:51.890278 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 454/934] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:37:51 2022] GET /compute/v2.1/servers/5907653e-bb61-4646-a7f8-97c5fe15a805 => generated 1206 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:52.002906 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5c450402-9592-43ad-9918-3c292ab1437d tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] [instance: 5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:37:52.023657 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5c450402-9592-43ad-9918-3c292ab1437d tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:52.024202 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5c450402-9592-43ad-9918-3c292ab1437d tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:52.024720 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-5c450402-9592-43ad-9918-3c292ab1437d tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] [instance: 5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3] instance's host None is down, deleting from database Jul 28 10:37:52.038282 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-5c450402-9592-43ad-9918-3c292ab1437d tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] [instance: 5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:37:52.127154 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-5c450402-9592-43ad-9918-3c292ab1437d tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] [instance: 5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:37:52.134300 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-5c450402-9592-43ad-9918-3c292ab1437d tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] [instance: 5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:37:52.671867 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-16f37500-1b89-42c4-8dff-e872ecce8b93 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:52.673506 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-16f37500-1b89-42c4-8dff-e872ecce8b93 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: ea4e8786-72aa-43db-93fa-5019d4660abf] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:52.684472 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-16f37500-1b89-42c4-8dff-e872ecce8b93 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:52.686981 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-16f37500-1b89-42c4-8dff-e872ecce8b93 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:52.690713 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-16f37500-1b89-42c4-8dff-e872ecce8b93 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:52.692780 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-16f37500-1b89-42c4-8dff-e872ecce8b93 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:52.787089 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-16f37500-1b89-42c4-8dff-e872ecce8b93 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:52.787626 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-16f37500-1b89-42c4-8dff-e872ecce8b93 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:52.788116 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-16f37500-1b89-42c4-8dff-e872ecce8b93 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lazy-loading 'fault' on Instance uuid ea4e8786-72aa-43db-93fa-5019d4660abf {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:37:52.919369 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-16f37500-1b89-42c4-8dff-e872ecce8b93 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec88a8daaeb940d89d7f305fca4f5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243bfecc2f9744e087fe60f72caa3b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:52.934473 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-16f37500-1b89-42c4-8dff-e872ecce8b93 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] 10.222.0.46 "GET /compute/v2.1/servers/ea4e8786-72aa-43db-93fa-5019d4660abf" status: 200 len: 1291 microversion: 2.1 time: 0.266940 Jul 28 10:37:52.950524 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 455/935] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:37:52 2022] GET /compute/v2.1/servers/ea4e8786-72aa-43db-93fa-5019d4660abf => generated 1291 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:52.961565 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4ebd2b73-c51f-4989-9f29-877637814f9e tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:52.962544 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-4ebd2b73-c51f-4989-9f29-877637814f9e tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 5907653e-bb61-4646-a7f8-97c5fe15a805] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:52.970070 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4ebd2b73-c51f-4989-9f29-877637814f9e tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:52.971249 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4ebd2b73-c51f-4989-9f29-877637814f9e tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:52.972772 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4ebd2b73-c51f-4989-9f29-877637814f9e tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:52.973544 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4ebd2b73-c51f-4989-9f29-877637814f9e tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:53.020683 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4ebd2b73-c51f-4989-9f29-877637814f9e tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:53.021461 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4ebd2b73-c51f-4989-9f29-877637814f9e tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:53.023343 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-4ebd2b73-c51f-4989-9f29-877637814f9e tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lazy-loading 'fault' on Instance uuid 5907653e-bb61-4646-a7f8-97c5fe15a805 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:37:53.136320 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-4ebd2b73-c51f-4989-9f29-877637814f9e tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abbb9bb4988457abbf4ecf8005d33fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58597d8408554881b9e936c5983663d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:53.152242 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-4ebd2b73-c51f-4989-9f29-877637814f9e tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] 10.222.0.46 "GET /compute/v2.1/servers/5907653e-bb61-4646-a7f8-97c5fe15a805" status: 200 len: 1279 microversion: 2.1 time: 0.199892 Jul 28 10:37:53.165882 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 456/936] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:37:52 2022] GET /compute/v2.1/servers/5907653e-bb61-4646-a7f8-97c5fe15a805 => generated 1279 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:53.174775 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c89635c7-7aba-4bed-9462-160340a6fc6b tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:53.174775 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c89635c7-7aba-4bed-9462-160340a6fc6b tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: ea4e8786-72aa-43db-93fa-5019d4660abf] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:53.193595 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c89635c7-7aba-4bed-9462-160340a6fc6b tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:53.195781 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c89635c7-7aba-4bed-9462-160340a6fc6b tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:53.199428 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c89635c7-7aba-4bed-9462-160340a6fc6b tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:53.201503 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c89635c7-7aba-4bed-9462-160340a6fc6b tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:53.229424 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-5c450402-9592-43ad-9918-3c292ab1437d tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3" status: 204 len: 0 microversion: 2.32 time: 1.510298 Jul 28 10:37:53.232534 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 481/937] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:37:51 2022] DELETE /compute/v2.1/servers/5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3 => generated 0 bytes in 1514 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:37:53.246649 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1dc6a4d9-7be9-4e23-82a1-2314afd353d7 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:53.247152 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-1dc6a4d9-7be9-4e23-82a1-2314afd353d7 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 5907653e-bb61-4646-a7f8-97c5fe15a805] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:53.254243 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c89635c7-7aba-4bed-9462-160340a6fc6b tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: ea4e8786-72aa-43db-93fa-5019d4660abf] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:37:53.262347 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1dc6a4d9-7be9-4e23-82a1-2314afd353d7 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:53.264080 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1dc6a4d9-7be9-4e23-82a1-2314afd353d7 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:53.264901 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1dc6a4d9-7be9-4e23-82a1-2314afd353d7 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:53.267417 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1dc6a4d9-7be9-4e23-82a1-2314afd353d7 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:53.370745 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c89635c7-7aba-4bed-9462-160340a6fc6b tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: ea4e8786-72aa-43db-93fa-5019d4660abf] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:37:53.380815 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c89635c7-7aba-4bed-9462-160340a6fc6b tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:53.381688 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c89635c7-7aba-4bed-9462-160340a6fc6b tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:53.385593 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-c89635c7-7aba-4bed-9462-160340a6fc6b tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: ea4e8786-72aa-43db-93fa-5019d4660abf] instance's host None is down, deleting from database Jul 28 10:37:53.386641 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-1dc6a4d9-7be9-4e23-82a1-2314afd353d7 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 5907653e-bb61-4646-a7f8-97c5fe15a805] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:37:53.397325 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-c89635c7-7aba-4bed-9462-160340a6fc6b tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: ea4e8786-72aa-43db-93fa-5019d4660abf] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:37:53.520568 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9,nova_api:UPDATE=3 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:53.527169 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-c89635c7-7aba-4bed-9462-160340a6fc6b tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: ea4e8786-72aa-43db-93fa-5019d4660abf] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:37:53.533707 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-1dc6a4d9-7be9-4e23-82a1-2314afd353d7 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 5907653e-bb61-4646-a7f8-97c5fe15a805] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:37:53.535261 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1dc6a4d9-7be9-4e23-82a1-2314afd353d7 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:53.535938 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1dc6a4d9-7be9-4e23-82a1-2314afd353d7 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:53.536632 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-1dc6a4d9-7be9-4e23-82a1-2314afd353d7 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 5907653e-bb61-4646-a7f8-97c5fe15a805] instance's host None is down, deleting from database Jul 28 10:37:53.538082 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-c89635c7-7aba-4bed-9462-160340a6fc6b tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: ea4e8786-72aa-43db-93fa-5019d4660abf] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:37:53.542268 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-1dc6a4d9-7be9-4e23-82a1-2314afd353d7 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 5907653e-bb61-4646-a7f8-97c5fe15a805] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:37:53.624282 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-1dc6a4d9-7be9-4e23-82a1-2314afd353d7 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 5907653e-bb61-4646-a7f8-97c5fe15a805] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:37:53.633908 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-1dc6a4d9-7be9-4e23-82a1-2314afd353d7 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 5907653e-bb61-4646-a7f8-97c5fe15a805] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:37:53.648430 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=63,nova_cell0:UPDATE=30,nova_cell0:DELETE=4,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:53.825539 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=72,nova_cell0:UPDATE=22,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:53.885461 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c89635c7-7aba-4bed-9462-160340a6fc6b tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ea4e8786-72aa-43db-93fa-5019d4660abf" status: 204 len: 0 microversion: 2.1 time: 0.718614 Jul 28 10:37:53.891199 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 457/938] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:37:53 2022] DELETE /compute/v2.1/servers/ea4e8786-72aa-43db-93fa-5019d4660abf => generated 0 bytes in 731 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:37:53.916856 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-fa6fa40c-1d18-49ab-a3ed-ae05d0090ab4 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:53.918517 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-fa6fa40c-1d18-49ab-a3ed-ae05d0090ab4 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] [instance: 5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:53.923039 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1dc6a4d9-7be9-4e23-82a1-2314afd353d7 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5907653e-bb61-4646-a7f8-97c5fe15a805" status: 204 len: 0 microversion: 2.1 time: 0.685271 Jul 28 10:37:53.923714 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 482/939] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:37:53 2022] DELETE /compute/v2.1/servers/5907653e-bb61-4646-a7f8-97c5fe15a805 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:37:53.934870 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fa6fa40c-1d18-49ab-a3ed-ae05d0090ab4 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:53.935613 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fa6fa40c-1d18-49ab-a3ed-ae05d0090ab4 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:53.936339 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2492fc3a-7690-49c2-bc85-72427b2ae6b8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:53.937029 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fa6fa40c-1d18-49ab-a3ed-ae05d0090ab4 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:53.937785 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fa6fa40c-1d18-49ab-a3ed-ae05d0090ab4 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:53.939214 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-2492fc3a-7690-49c2-bc85-72427b2ae6b8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: ea4e8786-72aa-43db-93fa-5019d4660abf] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:53.961316 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-fa6fa40c-1d18-49ab-a3ed-ae05d0090ab4 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] HTTP exception thrown: Instance 5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3 could not be found. Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-fa6fa40c-1d18-49ab-a3ed-ae05d0090ab4 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Request method failure captured: Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3 HTTP/1.1 Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4maa6EHgF4XcfMSfLSWZMYxtoLai58uADu4D8oRxLGhQtO-zofyPSS5KpRmnurF4FenA8Ne8tVl6zlPXilRRqz4Az18CpuVDTBkWsaJjqtGWXSzeSW5rnTaRSmR_MwrAxr_3wuqc-aviqGIbZQCXaR7SRhMwS7mjGLnbNdio3XHoeIQ Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: X-Openstack-Nova-Api-Version: 2.32 Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: de552247daa44b5e8251b69d2c4caf7d Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-TaggedBootDevicesTest-1054147157 Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/de552247daa44b5e8251b69d2c4caf7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/de552247daa44b5e8251b69d2c4caf7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/de552247daa44b5e8251b69d2c4caf7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_de552247daa44b5e8251b69d2c4caf7d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-TaggedBootDevicesTest-1054147157 Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: de552247daa44b5e8251b69d2c4caf7d Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1054147157 Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-TaggedBootDevicesTest-1054147157-project Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 18b5b68766ca4b43bd10f931984dbbd4 Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-TaggedBootDevicesTest-1054147157-project Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3 could not be found. Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3'} Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3 could not be found. Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3 could not be found. Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:53.963324 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:53.967085 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:53.967085 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:53.967085 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:53.967085 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:37:53.967085 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:37:53.967085 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3 could not be found. Jul 28 10:37:53.967085 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:53.967794 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2492fc3a-7690-49c2-bc85-72427b2ae6b8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:53.968446 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2492fc3a-7690-49c2-bc85-72427b2ae6b8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:53.970869 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-fa6fa40c-1d18-49ab-a3ed-ae05d0090ab4 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Returning 404 to user: Instance 5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:37:53.971908 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-fa6fa40c-1d18-49ab-a3ed-ae05d0090ab4 tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] 10.222.0.46 "GET /compute/v2.1/servers/5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3" status: 404 len: 111 microversion: 2.32 time: 0.082411 Jul 28 10:37:53.972021 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2492fc3a-7690-49c2-bc85-72427b2ae6b8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:53.973065 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 458/940] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:37:53 2022] GET /compute/v2.1/servers/5dd4d08c-0857-4be9-bd3e-2bcefc8c78e3 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:37:53.977208 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2492fc3a-7690-49c2-bc85-72427b2ae6b8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:53.980128 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c1f7d1cb-8d6a-4786-bdb2-52663e4b25c9 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:53.981314 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c1f7d1cb-8d6a-4786-bdb2-52663e4b25c9 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: 5907653e-bb61-4646-a7f8-97c5fe15a805] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:53.991534 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c1f7d1cb-8d6a-4786-bdb2-52663e4b25c9 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:53.993678 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c1f7d1cb-8d6a-4786-bdb2-52663e4b25c9 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:53.994776 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c1f7d1cb-8d6a-4786-bdb2-52663e4b25c9 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:53.995372 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c1f7d1cb-8d6a-4786-bdb2-52663e4b25c9 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:54.020685 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-2492fc3a-7690-49c2-bc85-72427b2ae6b8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] HTTP exception thrown: Instance ea4e8786-72aa-43db-93fa-5019d4660abf could not be found. Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2492fc3a-7690-49c2-bc85-72427b2ae6b8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Request method failure captured: Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/ea4e8786-72aa-43db-93fa-5019d4660abf HTTP/1.1 Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mby_GkaIG7K_JbkuaDmgiClbfpniA0ViLMKZfyqXJbKXTEPKpoA0cDUqTqgqOO7--KbkbQghIfXRpmtgmA61vaG_IFRc6tbwcEFVkDyOR2o1xBvhvAFRGNxPLtaILYSooT2dv4wDSTq9Gw1MoIYXy-n7qQt7Ol1WN0owspTDmDIOWE Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 243bfecc2f9744e087fe60f72caa3b84 Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1692557787 Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/243bfecc2f9744e087fe60f72caa3b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/243bfecc2f9744e087fe60f72caa3b84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/243bfecc2f9744e087fe60f72caa3b84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_243bfecc2f9744e087fe60f72caa3b84", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ServerDiskConfigTestJSON-1692557787 Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 243bfecc2f9744e087fe60f72caa3b84 Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1692557787 Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ServerDiskConfigTestJSON-1692557787-project Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: ec88a8daaeb940d89d7f305fca4f5863 Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ServerDiskConfigTestJSON-1692557787-project Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance ea4e8786-72aa-43db-93fa-5019d4660abf could not be found. Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'ea4e8786-72aa-43db-93fa-5019d4660abf'} Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea4e8786-72aa-43db-93fa-5019d4660abf could not be found. Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea4e8786-72aa-43db-93fa-5019d4660abf could not be found. Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:54.023103 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:54.026954 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:54.026954 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:54.026954 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:54.026954 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:37:54.026954 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:37:54.026954 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea4e8786-72aa-43db-93fa-5019d4660abf could not be found. Jul 28 10:37:54.026954 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:37:54.028602 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2492fc3a-7690-49c2-bc85-72427b2ae6b8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Returning 404 to user: Instance ea4e8786-72aa-43db-93fa-5019d4660abf could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:37:54.028856 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-c1f7d1cb-8d6a-4786-bdb2-52663e4b25c9 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] HTTP exception thrown: Instance 5907653e-bb61-4646-a7f8-97c5fe15a805 could not be found. Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c1f7d1cb-8d6a-4786-bdb2-52663e4b25c9 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Request method failure captured: Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/5907653e-bb61-4646-a7f8-97c5fe15a805 HTTP/1.1 Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mbtkvMjuUKaU1wx902eD3Y6JnTep6fYztVEEYH9qcoBlbEPwGHd3TIDToJJH3lRwFoRmTs2GK4OuYr26uDQGK0iZlHIo0AQUR-5FqJzLozT2WmrsxTwC5moQBH7BMOfKpiWONIGFcASWY5bqI6GKdEHyQH_jTP54i887bapyp2eqqI Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 58597d8408554881b9e936c5983663d5 Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ImagesTestJSON-1229646692 Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/58597d8408554881b9e936c5983663d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/58597d8408554881b9e936c5983663d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/58597d8408554881b9e936c5983663d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_58597d8408554881b9e936c5983663d5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ImagesTestJSON-1229646692 Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 58597d8408554881b9e936c5983663d5 Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ImagesTestJSON-1229646692 Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ImagesTestJSON-1229646692-project Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 1abbb9bb4988457abbf4ecf8005d33fb Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ImagesTestJSON-1229646692-project Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 5907653e-bb61-4646-a7f8-97c5fe15a805 could not be found. Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '5907653e-bb61-4646-a7f8-97c5fe15a805'} Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5907653e-bb61-4646-a7f8-97c5fe15a805 could not be found. Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5907653e-bb61-4646-a7f8-97c5fe15a805 could not be found. Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:54.032391 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:54.035881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:54.035881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:54.035881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:37:54.035881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:37:54.035881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5907653e-bb61-4646-a7f8-97c5fe15a805 could not be found. Jul 28 10:37:54.035881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:54.039419 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c1f7d1cb-8d6a-4786-bdb2-52663e4b25c9 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Returning 404 to user: Instance 5907653e-bb61-4646-a7f8-97c5fe15a805 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:37:54.043520 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-2492fc3a-7690-49c2-bc85-72427b2ae6b8 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] 10.222.0.46 "GET /compute/v2.1/servers/ea4e8786-72aa-43db-93fa-5019d4660abf" status: 404 len: 111 microversion: 2.1 time: 0.103758 Jul 28 10:37:54.045547 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c1f7d1cb-8d6a-4786-bdb2-52663e4b25c9 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] 10.222.0.46 "GET /compute/v2.1/servers/5907653e-bb61-4646-a7f8-97c5fe15a805" status: 404 len: 111 microversion: 2.1 time: 0.069325 Jul 28 10:37:54.054435 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 483/942] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:37:53 2022] GET /compute/v2.1/servers/ea4e8786-72aa-43db-93fa-5019d4660abf => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:37:54.064359 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2f12efef-c76d-4b84-aaae-4250f3076fad tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] Calling method '.version_select at 0x7fa94b9d80d0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:54.065463 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 459/942] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:37:53 2022] GET /compute/v2.1/servers/5907653e-bb61-4646-a7f8-97c5fe15a805 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:37:54.096323 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-2f12efef-c76d-4b84-aaae-4250f3076fad tempest-TaggedBootDevicesTest-1054147157 tempest-TaggedBootDevicesTest-1054147157-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-795338446" status: 204 len: 0 microversion: 2.32 time: 0.040368 Jul 28 10:37:54.100679 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 484/943] 10.222.0.46 () {60 vars in 1259 bytes} [Thu Jul 28 10:37:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-795338446 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:37:54.722755 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2073462567", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "d9e608ce-54d3-43b1-b332-dd984ba1da05"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:54.800493 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] validate_networks() for [('d9e608ce-54d3-43b1-b332-dd984ba1da05', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:37:54.852871 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-839687791", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "180b12f9-cf11-4e3c-b707-f07ef5d66391"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:54.924885 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] validate_networks() for [('180b12f9-cf11-4e3c-b707-f07ef5d66391', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:37:55.667250 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:37:55.667674 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:37:55.668423 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:37:55.669003 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:37:55.669551 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:37:55.691266 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:55.691942 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:55.692898 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:55.693515 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:55.731657 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Getting quotas for project 243bfecc2f9744e087fe60f72caa3b84. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:55.751734 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Getting quotas for user ec88a8daaeb940d89d7f305fca4f5863 and project 243bfecc2f9744e087fe60f72caa3b84. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:55.777702 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:37:55.779925 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: 665aba1c-1626-40ba-8e71-735e72ce9b44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:37:55.868909 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f486b3de-0d42-4817-8992-9e4a0940bcdc tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.021220 Jul 28 10:37:55.877898 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 485/944] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:37:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:37:55.975959 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:37:55.976436 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:37:55.976857 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:37:55.977265 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:37:55.977915 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:37:55.982168 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:37:55.999557 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:56.001287 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:56.003423 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:56.005671 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:56.092734 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Getting quotas for project 58597d8408554881b9e936c5983663d5. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:37:56.127467 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Getting quotas for user 1abbb9bb4988457abbf4ecf8005d33fb and project 58597d8408554881b9e936c5983663d5. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:37:56.183376 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:37:56.194172 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: ef772beb-f359-4da8-8626-e02002b983b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:37:56.325361 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f71823d7-b96c-4238-8928-67137cb686c3 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.609613 Jul 28 10:37:56.334637 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 460/945] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:37:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:37:56.346691 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6101fe69-e10f-4594-b225-4be61599e576 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:56.348863 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-6101fe69-e10f-4594-b225-4be61599e576 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: 665aba1c-1626-40ba-8e71-735e72ce9b44] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:56.366865 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6101fe69-e10f-4594-b225-4be61599e576 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:56.367905 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6101fe69-e10f-4594-b225-4be61599e576 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:56.369821 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6101fe69-e10f-4594-b225-4be61599e576 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:56.370901 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6101fe69-e10f-4594-b225-4be61599e576 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:56.495580 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6101fe69-e10f-4594-b225-4be61599e576 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:56.496419 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6101fe69-e10f-4594-b225-4be61599e576 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:56.497033 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-6101fe69-e10f-4594-b225-4be61599e576 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lazy-loading 'fault' on Instance uuid 665aba1c-1626-40ba-8e71-735e72ce9b44 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:37:56.628315 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d778948b-3c7b-4234-b3c4-6c366e8ecba8 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Action: 'create', calling method: .version_select at 0x7fa94b9e7af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-395093413", "description": "tempest-description-1902701515"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:57.148086 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-6101fe69-e10f-4594-b225-4be61599e576 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec88a8daaeb940d89d7f305fca4f5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243bfecc2f9744e087fe60f72caa3b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:57.163045 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6101fe69-e10f-4594-b225-4be61599e576 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] 10.222.0.46 "GET /compute/v2.1/servers/665aba1c-1626-40ba-8e71-735e72ce9b44" status: 200 len: 1290 microversion: 2.1 time: 0.827197 Jul 28 10:37:57.164872 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 461/946] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:37:56 2022] GET /compute/v2.1/servers/665aba1c-1626-40ba-8e71-735e72ce9b44 => generated 1290 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:57.169472 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8ee3d8ef-2af4-4634-96ea-2ec70bb449d4 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:57.170102 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-8ee3d8ef-2af4-4634-96ea-2ec70bb449d4 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: ef772beb-f359-4da8-8626-e02002b983b4] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:57.178493 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8ee3d8ef-2af4-4634-96ea-2ec70bb449d4 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:57.179297 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8ee3d8ef-2af4-4634-96ea-2ec70bb449d4 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:57.180315 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8ee3d8ef-2af4-4634-96ea-2ec70bb449d4 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:57.181204 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8ee3d8ef-2af4-4634-96ea-2ec70bb449d4 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:57.218147 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8ee3d8ef-2af4-4634-96ea-2ec70bb449d4 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:57.218781 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8ee3d8ef-2af4-4634-96ea-2ec70bb449d4 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:57.219434 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-8ee3d8ef-2af4-4634-96ea-2ec70bb449d4 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lazy-loading 'fault' on Instance uuid ef772beb-f359-4da8-8626-e02002b983b4 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:37:57.268677 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-8ee3d8ef-2af4-4634-96ea-2ec70bb449d4 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abbb9bb4988457abbf4ecf8005d33fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58597d8408554881b9e936c5983663d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:57.282676 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-8ee3d8ef-2af4-4634-96ea-2ec70bb449d4 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] 10.222.0.46 "GET /compute/v2.1/servers/ef772beb-f359-4da8-8626-e02002b983b4" status: 200 len: 1281 microversion: 2.1 time: 0.116316 Jul 28 10:37:57.284023 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 462/947] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:37:57 2022] GET /compute/v2.1/servers/ef772beb-f359-4da8-8626-e02002b983b4 => generated 1281 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:58.184501 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4762c3c8-69f9-4eb0-95fb-4282bc89a709 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:58.185837 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-4762c3c8-69f9-4eb0-95fb-4282bc89a709 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: 665aba1c-1626-40ba-8e71-735e72ce9b44] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:58.203555 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4762c3c8-69f9-4eb0-95fb-4282bc89a709 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:58.204327 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4762c3c8-69f9-4eb0-95fb-4282bc89a709 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:58.205331 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4762c3c8-69f9-4eb0-95fb-4282bc89a709 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:58.206088 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4762c3c8-69f9-4eb0-95fb-4282bc89a709 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:58.298413 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4762c3c8-69f9-4eb0-95fb-4282bc89a709 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:58.299149 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4762c3c8-69f9-4eb0-95fb-4282bc89a709 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:58.300646 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-4762c3c8-69f9-4eb0-95fb-4282bc89a709 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lazy-loading 'fault' on Instance uuid 665aba1c-1626-40ba-8e71-735e72ce9b44 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:37:58.448938 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-4762c3c8-69f9-4eb0-95fb-4282bc89a709 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec88a8daaeb940d89d7f305fca4f5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243bfecc2f9744e087fe60f72caa3b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:58.462751 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-4762c3c8-69f9-4eb0-95fb-4282bc89a709 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] 10.222.0.46 "GET /compute/v2.1/servers/665aba1c-1626-40ba-8e71-735e72ce9b44" status: 200 len: 1290 microversion: 2.1 time: 0.281978 Jul 28 10:37:58.464848 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 463/948] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:37:58 2022] GET /compute/v2.1/servers/665aba1c-1626-40ba-8e71-735e72ce9b44 => generated 1290 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:37:58.470652 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2698e1aa-da67-41de-9b11-e9fc2f2b1af0 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:58.482764 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-2698e1aa-da67-41de-9b11-e9fc2f2b1af0 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: ef772beb-f359-4da8-8626-e02002b983b4] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:58.495502 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2698e1aa-da67-41de-9b11-e9fc2f2b1af0 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:58.496222 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2698e1aa-da67-41de-9b11-e9fc2f2b1af0 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:58.497701 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2698e1aa-da67-41de-9b11-e9fc2f2b1af0 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:58.498344 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2698e1aa-da67-41de-9b11-e9fc2f2b1af0 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:58.557612 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-d778948b-3c7b-4234-b3c4-6c366e8ecba8 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 2.677984 Jul 28 10:37:58.567363 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 486/949] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:37:55 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 2680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:58.567790 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-32e6c17d-d40b-4f8b-b3f4-b62185f7cfee tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:58.570492 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-32e6c17d-d40b-4f8b-b3f4-b62185f7cfee tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: 665aba1c-1626-40ba-8e71-735e72ce9b44] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:58.582409 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2698e1aa-da67-41de-9b11-e9fc2f2b1af0 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:58.583884 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2698e1aa-da67-41de-9b11-e9fc2f2b1af0 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:58.585008 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-2698e1aa-da67-41de-9b11-e9fc2f2b1af0 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lazy-loading 'fault' on Instance uuid ef772beb-f359-4da8-8626-e02002b983b4 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:37:58.587701 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-32e6c17d-d40b-4f8b-b3f4-b62185f7cfee tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:58.590076 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-32e6c17d-d40b-4f8b-b3f4-b62185f7cfee tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:58.590922 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-32e6c17d-d40b-4f8b-b3f4-b62185f7cfee tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:58.591370 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-32e6c17d-d40b-4f8b-b3f4-b62185f7cfee tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:58.645465 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-32e6c17d-d40b-4f8b-b3f4-b62185f7cfee tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: 665aba1c-1626-40ba-8e71-735e72ce9b44] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:37:58.716210 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-2698e1aa-da67-41de-9b11-e9fc2f2b1af0 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abbb9bb4988457abbf4ecf8005d33fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58597d8408554881b9e936c5983663d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:58.729068 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-2698e1aa-da67-41de-9b11-e9fc2f2b1af0 tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] 10.222.0.46 "GET /compute/v2.1/servers/ef772beb-f359-4da8-8626-e02002b983b4" status: 200 len: 1281 microversion: 2.1 time: 0.262692 Jul 28 10:37:58.733787 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 464/950] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:37:58 2022] GET /compute/v2.1/servers/ef772beb-f359-4da8-8626-e02002b983b4 => generated 1281 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:58.744324 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f00000ed-c1f3-4dec-9d11-7d116a6b690d tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Action: 'create', calling method: .version_select at 0x7fa94ba22ca0>, body: {"security_group_rule": {"parent_group_id": "3af4284c-4e4e-477e-aa03-1be20586337e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:58.782506 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-32e6c17d-d40b-4f8b-b3f4-b62185f7cfee tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: 665aba1c-1626-40ba-8e71-735e72ce9b44] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:37:58.782822 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-32e6c17d-d40b-4f8b-b3f4-b62185f7cfee tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:58.783269 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-32e6c17d-d40b-4f8b-b3f4-b62185f7cfee tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:58.783827 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-32e6c17d-d40b-4f8b-b3f4-b62185f7cfee tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: 665aba1c-1626-40ba-8e71-735e72ce9b44] instance's host None is down, deleting from database Jul 28 10:37:58.787334 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-32e6c17d-d40b-4f8b-b3f4-b62185f7cfee tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: 665aba1c-1626-40ba-8e71-735e72ce9b44] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:37:58.874505 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-32e6c17d-d40b-4f8b-b3f4-b62185f7cfee tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: 665aba1c-1626-40ba-8e71-735e72ce9b44] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:37:58.883305 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-32e6c17d-d40b-4f8b-b3f4-b62185f7cfee tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: 665aba1c-1626-40ba-8e71-735e72ce9b44] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:37:59.279213 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-32e6c17d-d40b-4f8b-b3f4-b62185f7cfee tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] 10.222.0.46 "DELETE /compute/v2.1/servers/665aba1c-1626-40ba-8e71-735e72ce9b44" status: 204 len: 0 microversion: 2.1 time: 0.715325 Jul 28 10:37:59.285514 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 487/951] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:37:58 2022] DELETE /compute/v2.1/servers/665aba1c-1626-40ba-8e71-735e72ce9b44 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:37:59.294261 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c9e79671-8eda-4424-9c26-0cc211e8a36f tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:59.296933 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c9e79671-8eda-4424-9c26-0cc211e8a36f tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: ef772beb-f359-4da8-8626-e02002b983b4] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:59.320703 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c9e79671-8eda-4424-9c26-0cc211e8a36f tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:59.321435 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c9e79671-8eda-4424-9c26-0cc211e8a36f tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:59.322495 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c9e79671-8eda-4424-9c26-0cc211e8a36f tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:59.323630 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c9e79671-8eda-4424-9c26-0cc211e8a36f tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:59.389316 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c9e79671-8eda-4424-9c26-0cc211e8a36f tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: ef772beb-f359-4da8-8626-e02002b983b4] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:37:59.476811 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c9e79671-8eda-4424-9c26-0cc211e8a36f tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: ef772beb-f359-4da8-8626-e02002b983b4] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:37:59.477697 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c9e79671-8eda-4424-9c26-0cc211e8a36f tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:59.478328 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c9e79671-8eda-4424-9c26-0cc211e8a36f tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:59.478915 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-c9e79671-8eda-4424-9c26-0cc211e8a36f tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: ef772beb-f359-4da8-8626-e02002b983b4] instance's host None is down, deleting from database Jul 28 10:37:59.483705 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-c9e79671-8eda-4424-9c26-0cc211e8a36f tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: ef772beb-f359-4da8-8626-e02002b983b4] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:37:59.547033 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f00000ed-c1f3-4dec-9d11-7d116a6b690d tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.810511 Jul 28 10:37:59.557190 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 465/952] 10.222.0.46 () {60 vars in 1195 bytes} [Thu Jul 28 10:37:58 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:59.563858 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-42b8de10-223c-42ec-9f06-833b57226f26 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:59.564838 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-42b8de10-223c-42ec-9f06-833b57226f26 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] [instance: 665aba1c-1626-40ba-8e71-735e72ce9b44] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:37:59.575897 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-42b8de10-223c-42ec-9f06-833b57226f26 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:59.576770 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-42b8de10-223c-42ec-9f06-833b57226f26 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:59.578636 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-42b8de10-223c-42ec-9f06-833b57226f26 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:37:59.579275 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-42b8de10-223c-42ec-9f06-833b57226f26 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:37:59.611379 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-42b8de10-223c-42ec-9f06-833b57226f26 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] HTTP exception thrown: Instance 665aba1c-1626-40ba-8e71-735e72ce9b44 could not be found. Jul 28 10:37:59.612317 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-c9e79671-8eda-4424-9c26-0cc211e8a36f tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: ef772beb-f359-4da8-8626-e02002b983b4] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-42b8de10-223c-42ec-9f06-833b57226f26 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Request method failure captured: Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/665aba1c-1626-40ba-8e71-735e72ce9b44 HTTP/1.1 Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mby_GkaIG7K_JbkuaDmgiClbfpniA0ViLMKZfyqXJbKXTEPKpoA0cDUqTqgqOO7--KbkbQghIfXRpmtgmA61vaG_IFRc6tbwcEFVkDyOR2o1xBvhvAFRGNxPLtaILYSooT2dv4wDSTq9Gw1MoIYXy-n7qQt7Ol1WN0owspTDmDIOWE Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 243bfecc2f9744e087fe60f72caa3b84 Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1692557787 Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/243bfecc2f9744e087fe60f72caa3b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/243bfecc2f9744e087fe60f72caa3b84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/243bfecc2f9744e087fe60f72caa3b84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_243bfecc2f9744e087fe60f72caa3b84", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServerDiskConfigTestJSON-1692557787 Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 243bfecc2f9744e087fe60f72caa3b84 Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1692557787 Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServerDiskConfigTestJSON-1692557787-project Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: ec88a8daaeb940d89d7f305fca4f5863 Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServerDiskConfigTestJSON-1692557787-project Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 665aba1c-1626-40ba-8e71-735e72ce9b44 could not be found. Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '665aba1c-1626-40ba-8e71-735e72ce9b44'} Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 665aba1c-1626-40ba-8e71-735e72ce9b44 could not be found. Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 665aba1c-1626-40ba-8e71-735e72ce9b44 could not be found. Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:37:59.613632 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:59.617296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:37:59.617296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:37:59.617296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:37:59.617296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:37:59.617296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:37:59.617296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 665aba1c-1626-40ba-8e71-735e72ce9b44 could not be found. Jul 28 10:37:59.617296 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:37:59.619322 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-42b8de10-223c-42ec-9f06-833b57226f26 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] Returning 404 to user: Instance 665aba1c-1626-40ba-8e71-735e72ce9b44 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:37:59.620646 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-42b8de10-223c-42ec-9f06-833b57226f26 tempest-ServerDiskConfigTestJSON-1692557787 tempest-ServerDiskConfigTestJSON-1692557787-project] 10.222.0.46 "GET /compute/v2.1/servers/665aba1c-1626-40ba-8e71-735e72ce9b44" status: 404 len: 111 microversion: 2.1 time: 0.062232 Jul 28 10:37:59.621710 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-c9e79671-8eda-4424-9c26-0cc211e8a36f tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: ef772beb-f359-4da8-8626-e02002b983b4] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:37:59.623118 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 466/953] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:37:59 2022] GET /compute/v2.1/servers/665aba1c-1626-40ba-8e71-735e72ce9b44 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:37:59.642093 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-78a4bb2b-d8cc-443c-869a-25e777df1843 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Action: 'create', calling method: .version_select at 0x7fa94ba224c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-176701612", "description": "tempest-description-122279528"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:59.861733 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:RELEASE=3,nova_cell0:SELECT=59,nova_cell0:UPDATE=32,nova_cell0:DELETE=4,nova_cell0:SAVEPOINT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:00.028881 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c9e79671-8eda-4424-9c26-0cc211e8a36f tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ef772beb-f359-4da8-8626-e02002b983b4" status: 204 len: 0 microversion: 2.1 time: 0.741020 Jul 28 10:38:00.033968 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 488/954] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:37:59 2022] DELETE /compute/v2.1/servers/ef772beb-f359-4da8-8626-e02002b983b4 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:38:00.039996 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a73f61ee-d256-45c5-84c3-2586671d7ebe tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:00.044063 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a73f61ee-d256-45c5-84c3-2586671d7ebe tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] [instance: ef772beb-f359-4da8-8626-e02002b983b4] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:38:00.058240 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a73f61ee-d256-45c5-84c3-2586671d7ebe tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:00.063287 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a73f61ee-d256-45c5-84c3-2586671d7ebe tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:00.064526 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a73f61ee-d256-45c5-84c3-2586671d7ebe tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:00.065666 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a73f61ee-d256-45c5-84c3-2586671d7ebe tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:00.100238 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-a73f61ee-d256-45c5-84c3-2586671d7ebe tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] HTTP exception thrown: Instance ef772beb-f359-4da8-8626-e02002b983b4 could not be found. Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a73f61ee-d256-45c5-84c3-2586671d7ebe tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Request method failure captured: Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/ef772beb-f359-4da8-8626-e02002b983b4 HTTP/1.1 Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mbtkvMjuUKaU1wx902eD3Y6JnTep6fYztVEEYH9qcoBlbEPwGHd3TIDToJJH3lRwFoRmTs2GK4OuYr26uDQGK0iZlHIo0AQUR-5FqJzLozT2WmrsxTwC5moQBH7BMOfKpiWONIGFcASWY5bqI6GKdEHyQH_jTP54i887bapyp2eqqI Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 58597d8408554881b9e936c5983663d5 Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ImagesTestJSON-1229646692 Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/58597d8408554881b9e936c5983663d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/58597d8408554881b9e936c5983663d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/58597d8408554881b9e936c5983663d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_58597d8408554881b9e936c5983663d5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ImagesTestJSON-1229646692 Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 58597d8408554881b9e936c5983663d5 Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ImagesTestJSON-1229646692 Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ImagesTestJSON-1229646692-project Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 1abbb9bb4988457abbf4ecf8005d33fb Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ImagesTestJSON-1229646692-project Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance ef772beb-f359-4da8-8626-e02002b983b4 could not be found. Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'ef772beb-f359-4da8-8626-e02002b983b4'} Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef772beb-f359-4da8-8626-e02002b983b4 could not be found. Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef772beb-f359-4da8-8626-e02002b983b4 could not be found. Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:38:00.105938 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:38:00.111775 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:38:00.111775 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:38:00.111775 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:38:00.111775 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:38:00.111775 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef772beb-f359-4da8-8626-e02002b983b4 could not be found. Jul 28 10:38:00.111775 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:38:00.116878 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a73f61ee-d256-45c5-84c3-2586671d7ebe tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] Returning 404 to user: Instance ef772beb-f359-4da8-8626-e02002b983b4 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:38:00.118023 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a73f61ee-d256-45c5-84c3-2586671d7ebe tempest-ImagesTestJSON-1229646692 tempest-ImagesTestJSON-1229646692-project] 10.222.0.46 "GET /compute/v2.1/servers/ef772beb-f359-4da8-8626-e02002b983b4" status: 404 len: 111 microversion: 2.1 time: 0.082802 Jul 28 10:38:00.129285 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 489/955] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:38:00 2022] GET /compute/v2.1/servers/ef772beb-f359-4da8-8626-e02002b983b4 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:38:00.659992 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-78a4bb2b-d8cc-443c-869a-25e777df1843 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.032987 Jul 28 10:38:00.660805 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 467/956] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:37:59 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:00.675123 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f26a896c-cfe3-404c-bafb-6747f1aed8d3 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Action: 'create', calling method: .version_select at 0x7fa94b937160>, body: {"security_group_rule": {"parent_group_id": "fdb8d162-a443-4be7-9e51-1ff00fffe616", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:02.278215 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f26a896c-cfe3-404c-bafb-6747f1aed8d3 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.608570 Jul 28 10:38:02.280005 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 490/957] 10.222.0.46 () {60 vars in 1195 bytes} [Thu Jul 28 10:38:00 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:38:02.296908 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-57b5e35c-e3f6-4e2b-99ba-01bab0bfbad5 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Action: 'create', calling method: .version_select at 0x7fa94bc160d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-716364505", "description": "tempest-description-1422436046"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:03.222527 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-57b5e35c-e3f6-4e2b-99ba-01bab0bfbad5 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.930251 Jul 28 10:38:03.223740 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 468/958] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:38:02 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:03.248037 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9006b50b-c813-4192-9ad3-6e400a11587f tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Action: 'create', calling method: .version_select at 0x7fa94b99fee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2101913382", "description": "tempest-description-1486106152"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:04.045653 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9006b50b-c813-4192-9ad3-6e400a11587f tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.810083 Jul 28 10:38:04.049301 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 491/959] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:38:03 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:04.066608 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-30b25e50-5cf9-42fa-a118-718a5b70f9bf tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Action: 'create', calling method: .version_select at 0x7fa94bbf5160>, body: {"security_group_rule": {"parent_group_id": "336ef540-025f-4f02-bb8e-6d32e80ed3ba", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "b8f2a508-ba69-4089-b4a3-438b25597539"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:05.810959 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-30b25e50-5cf9-42fa-a118-718a5b70f9bf tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.753085 Jul 28 10:38:05.814290 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 469/960] 10.222.0.46 () {60 vars in 1195 bytes} [Thu Jul 28 10:38:04 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:05.829146 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c7b376ce-9da4-445a-8c2d-541c3a0be0fa tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Action: 'create', calling method: .version_select at 0x7fa94b937550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1695186363", "description": "tempest-description-989936006"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:05.840312 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=10 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:05.842644 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=34 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:06.586862 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c7b376ce-9da4-445a-8c2d-541c3a0be0fa tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.762120 Jul 28 10:38:06.587508 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 492/961] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:38:05 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:06.608124 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-edb3ebc2-2d01-4c24-959d-2a7258eb7bfd tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Action: 'create', calling method: .version_select at 0x7fa94bbe0f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-955561896", "description": "tempest-description-897216157"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:06.632092 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=6 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:06.635304 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=26 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:07.699830 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-edb3ebc2-2d01-4c24-959d-2a7258eb7bfd tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.101499 Jul 28 10:38:07.700619 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 470/962] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:38:06 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:07.721618 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0447e7dc-485c-45c7-b4ca-d70ee2e8fa41 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Action: 'create', calling method: .version_select at 0x7fa94b8e7f70>, body: {"security_group_rule": {"parent_group_id": "80067e2d-ebe7-46d7-a60b-9dcfd7e5a99f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "0487b15e-3972-4815-a53c-2100d6bf4fe4"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:08.913731 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0447e7dc-485c-45c7-b4ca-d70ee2e8fa41 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.203030 Jul 28 10:38:08.914542 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 493/963] 10.222.0.46 () {60 vars in 1195 bytes} [Thu Jul 28 10:38:07 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:08.927938 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-eff9ead6-8422-4166-8589-46a6dede2c52 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Calling method '.version_select at 0x7fa94b92fe50>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:09.568997 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:09.589385 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:UPDATE=8,nova_cell0:DELETE=2,nova_cell0:SELECT=40 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:10.312135 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-eff9ead6-8422-4166-8589-46a6dede2c52 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/0487b15e-3972-4815-a53c-2100d6bf4fe4" status: 202 len: 0 microversion: 2.1 time: 1.388705 Jul 28 10:38:10.316071 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 471/964] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:38:08 2022] DELETE /compute/v2.1/os-security-groups/0487b15e-3972-4815-a53c-2100d6bf4fe4 => generated 0 bytes in 1391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:10.318372 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:10.319644 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=11,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:10.324928 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-20547d90-5b23-4368-a0f5-a1d4a6a8c08f tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Calling method '.version_select at 0x7fa94b9d8160>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:10.547841 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-20547d90-5b23-4368-a0f5-a1d4a6a8c08f tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/80067e2d-ebe7-46d7-a60b-9dcfd7e5a99f" status: 200 len: 247 microversion: 2.1 time: 0.230342 Jul 28 10:38:10.548731 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 494/965] 10.222.0.46 () {58 vars in 1269 bytes} [Thu Jul 28 10:38:10 2022] GET /compute/v2.1/os-security-groups/80067e2d-ebe7-46d7-a60b-9dcfd7e5a99f => generated 247 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:10.566448 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e0734796-0f71-4f8d-88ab-4e20a0ed1b30 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Action: 'create', calling method: .version_select at 0x7fa94bc16310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1591951959", "description": "tempest-description-1959052792"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:11.224035 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e0734796-0f71-4f8d-88ab-4e20a0ed1b30 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.661674 Jul 28 10:38:11.225435 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 472/966] 10.222.0.46 () {60 vars in 1180 bytes} [Thu Jul 28 10:38:10 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:11.260302 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-302ec694-f460-481c-af5e-1a49204a0013 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Action: 'create', calling method: .version_select at 0x7fa94b8af550>, body: {"security_group_rule": {"parent_group_id": "f6c95e39-4b0a-4c56-9273-8b3416a94567", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:11.772213 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-302ec694-f460-481c-af5e-1a49204a0013 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.533278 Jul 28 10:38:11.773493 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 495/967] 10.222.0.46 () {60 vars in 1195 bytes} [Thu Jul 28 10:38:11 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:11.789261 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1ddc33a4-ae5a-4e89-9c96-6696b6b494ca tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Action: 'create', calling method: .version_select at 0x7fa94bc15820>, body: {"security_group_rule": {"parent_group_id": "f6c95e39-4b0a-4c56-9273-8b3416a94567", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:13.680317 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-1ddc33a4-ae5a-4e89-9c96-6696b6b494ca tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.897976 Jul 28 10:38:13.681206 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 473/968] 10.222.0.46 () {60 vars in 1195 bytes} [Thu Jul 28 10:38:11 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:13.701816 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-659e54e8-168a-4025-b660-7e1c9814ac62 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Calling method '.version_select at 0x7fa94b8afca0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:14.491223 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-659e54e8-168a-4025-b660-7e1c9814ac62 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/f6c95e39-4b0a-4c56-9273-8b3416a94567" status: 200 len: 665 microversion: 2.1 time: 0.800102 Jul 28 10:38:14.499153 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 496/969] 10.222.0.46 () {58 vars in 1269 bytes} [Thu Jul 28 10:38:13 2022] GET /compute/v2.1/os-security-groups/f6c95e39-4b0a-4c56-9273-8b3416a94567 => generated 665 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:14.506859 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-34de14c3-5d43-417f-8884-448e65417f0a tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Calling method '.version_select at 0x7fa94ba224c0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:14.888927 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-34de14c3-5d43-417f-8884-448e65417f0a tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-group-rules/dab792aa-07d6-4337-8c88-7679d5e4de4f" status: 202 len: 0 microversion: 2.1 time: 0.385911 Jul 28 10:38:14.897159 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 474/970] 10.222.0.46 () {58 vars in 1287 bytes} [Thu Jul 28 10:38:14 2022] DELETE /compute/v2.1/os-security-group-rules/dab792aa-07d6-4337-8c88-7679d5e4de4f => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:14.902215 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6e179c71-2e09-48bf-8c2b-590166855533 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Calling method '.version_select at 0x7fa94b8bd310>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:15.780159 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-6e179c71-2e09-48bf-8c2b-590166855533 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/f6c95e39-4b0a-4c56-9273-8b3416a94567" status: 202 len: 0 microversion: 2.1 time: 0.881752 Jul 28 10:38:15.785008 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 497/971] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:38:14 2022] DELETE /compute/v2.1/os-security-groups/f6c95e39-4b0a-4c56-9273-8b3416a94567 => generated 0 bytes in 885 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:15.794545 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ad823f1e-cbdb-4199-85cd-4a8ca48927f3 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Calling method '.version_select at 0x7fa94bcb3790>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:15.852827 n-d-850468-6 devstack@n-api.service[119463]: DEBUG neutronclient.v2_0.client [None req-ad823f1e-cbdb-4199-85cd-4a8ca48927f3 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0487b15e-3972-4815-a53c-2100d6bf4fe4 does not exist", "detail": ""}} {{(pid=119463) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 10:38:15.853760 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.security_group_api [None req-ad823f1e-cbdb-4199-85cd-4a8ca48927f3 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Neutron security group 0487b15e-3972-4815-a53c-2100d6bf4fe4 not found {{(pid=119463) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 10:38:15.855847 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-ad823f1e-cbdb-4199-85cd-4a8ca48927f3 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] HTTP exception thrown: Security group 0487b15e-3972-4815-a53c-2100d6bf4fe4 does not exist Jul 28 10:38:15.855847 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-63375fbd-bfd0-4a52-ab1a-4fb9566ca99d'] Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ad823f1e-cbdb-4199-85cd-4a8ca48927f3 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Request method failure captured: Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: request: DELETE /compute/v2.1/os-security-groups/0487b15e-3972-4815-a53c-2100d6bf4fe4 HTTP/1.1 Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mcDSQukDPIiZkkDp8pzLzJfsF_TYTLK9C-1kzbm4sOL-kYuyhgAnUUNsdUhU-HBvmlxUgatCWhtb7z2hXyS_hSbb3uYPAKcJ9ogsyOKqg5J76yzgT5pqFOuebJvnm0qsZQ2aTkgTTE7wYt-NNtWXDfwamD__l6lTvPkQ--OtasFroI Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: f5b2e8199075416eb008280658561912 Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-72927462 Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f5b2e8199075416eb008280658561912"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f5b2e8199075416eb008280658561912"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f5b2e8199075416eb008280658561912"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f5b2e8199075416eb008280658561912", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-SecurityGroupRulesTestJSON-72927462 Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: f5b2e8199075416eb008280658561912 Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-72927462 Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-SecurityGroupRulesTestJSON-72927462-project Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: b9028dbed498456999847e3db06535c5 Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-SecurityGroupRulesTestJSON-72927462-project Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: exception: Security group 0487b15e-3972-4815-a53c-2100d6bf4fe4 does not exist Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-63375fbd-bfd0-4a52-ab1a-4fb9566ca99d'] Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '0487b15e-3972-4815-a53c-2100d6bf4fe4'} Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 10:38:15.858270 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0487b15e-3972-4815-a53c-2100d6bf4fe4 does not exist Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63375fbd-bfd0-4a52-ab1a-4fb9566ca99d'] Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0487b15e-3972-4815-a53c-2100d6bf4fe4 does not exist Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63375fbd-bfd0-4a52-ab1a-4fb9566ca99d'] Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0487b15e-3972-4815-a53c-2100d6bf4fe4 does not exist Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63375fbd-bfd0-4a52-ab1a-4fb9566ca99d'] Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0487b15e-3972-4815-a53c-2100d6bf4fe4 does not exist Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63375fbd-bfd0-4a52-ab1a-4fb9566ca99d'] Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ad823f1e-cbdb-4199-85cd-4a8ca48927f3 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Returning 404 to user: Security group 0487b15e-3972-4815-a53c-2100d6bf4fe4 does not exist Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: Neutron server returns request_ids: ['req-63375fbd-bfd0-4a52-ab1a-4fb9566ca99d'] {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:38:15.861777 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ad823f1e-cbdb-4199-85cd-4a8ca48927f3 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/0487b15e-3972-4815-a53c-2100d6bf4fe4" status: 404 len: 194 microversion: 2.1 time: 0.073915 Jul 28 10:38:15.870032 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 475/972] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:38:15 2022] DELETE /compute/v2.1/os-security-groups/0487b15e-3972-4815-a53c-2100d6bf4fe4 => generated 194 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:38:15.874637 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2f948763-4bc8-4044-a302-ef49e90eb237 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Calling method '.version_select at 0x7fa94b8af5e0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:16.438298 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-2f948763-4bc8-4044-a302-ef49e90eb237 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/80067e2d-ebe7-46d7-a60b-9dcfd7e5a99f" status: 202 len: 0 microversion: 2.1 time: 0.570384 Jul 28 10:38:16.439328 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 498/973] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:38:15 2022] DELETE /compute/v2.1/os-security-groups/80067e2d-ebe7-46d7-a60b-9dcfd7e5a99f => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:16.455539 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-85c18728-0a35-497c-8ddd-60064923c529 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Calling method '.version_select at 0x7fa94b8af160>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:17.188932 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1ab39c81-0e8f-49e0-aa1c-092cc78ad10c tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Action: 'create', calling method: .version_select at 0x7fa94b958a60>, body: {"keypair": {"name": "tempest-keypair-601712399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVaUnhrZIeBMc4BJHaS3koZQkz4BbFFLTuTSIAq8s7JStoHmkS5qhWq2YYfXA0IEn87QzoYCv3+vJLQLPGH/mIG+lR2D2aaHN1CP0Vr2JefdAUPJ7UDAQCfKa8csmUOtA=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:17.240820 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-1ab39c81-0e8f-49e0-aa1c-092cc78ad10c tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Getting quotas for project 379dcc2f97914adaa94499fd20cd9db1. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:38:17.256890 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-1ab39c81-0e8f-49e0-aa1c-092cc78ad10c tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Getting quotas for user 03ef18439781414692668adce06788d3 and project 379dcc2f97914adaa94499fd20cd9db1. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:38:17.336845 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-1ab39c81-0e8f-49e0-aa1c-092cc78ad10c tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.371396 Jul 28 10:38:17.337966 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 476/974] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:38:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:18.069996 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-85c18728-0a35-497c-8ddd-60064923c529 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/b8f2a508-ba69-4089-b4a3-438b25597539" status: 202 len: 0 microversion: 2.1 time: 1.625162 Jul 28 10:38:18.071106 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 499/975] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:38:16 2022] DELETE /compute/v2.1/os-security-groups/b8f2a508-ba69-4089-b4a3-438b25597539 => generated 0 bytes in 1628 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:38:18.086461 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-84e6c432-90fc-4fa7-8714-cae8da7357d1 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Calling method '.version_select at 0x7fa94bbf51f0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:19.473202 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-84e6c432-90fc-4fa7-8714-cae8da7357d1 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/336ef540-025f-4f02-bb8e-6d32e80ed3ba" status: 202 len: 0 microversion: 2.1 time: 1.396202 Jul 28 10:38:19.475152 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 477/976] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:38:18 2022] DELETE /compute/v2.1/os-security-groups/336ef540-025f-4f02-bb8e-6d32e80ed3ba => generated 0 bytes in 1399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:19.494707 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7a2dabd9-5fdd-40f7-8f8c-4e78fb2e7122 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Calling method '.version_select at 0x7fa94b9feb80>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:20.429029 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7a5f1702-bead-4759-bb8d-220372dcdc26 tempest-ListImagesTestJSON-949618342 tempest-ListImagesTestJSON-949618342-project] Calling method '.version_select at 0x7fa94bc73820>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:20.504235 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-7a5f1702-bead-4759-bb8d-220372dcdc26 tempest-ListImagesTestJSON-949618342 tempest-ListImagesTestJSON-949618342-project] 10.222.0.46 "GET /compute/v2.1/images/eff4a889-87b7-4a4c-be7a-77433dc25faf" status: 200 len: 784 microversion: 2.1 time: 0.407070 Jul 28 10:38:20.514439 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 478/977] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Jul 28 10:38:20 2022] GET /compute/v2.1/images/eff4a889-87b7-4a4c-be7a-77433dc25faf => generated 784 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:20.520303 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b3ff79c7-cc34-4bdf-a34d-c3d6f8be2661 tempest-ListImagesTestJSON-949618342 tempest-ListImagesTestJSON-949618342-project] Calling method '.version_select at 0x7fa94bbe0820>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:20.635583 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b3ff79c7-cc34-4bdf-a34d-c3d6f8be2661 tempest-ListImagesTestJSON-949618342 tempest-ListImagesTestJSON-949618342-project] 10.222.0.46 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.119342 Jul 28 10:38:20.644690 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 479/978] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Jul 28 10:38:20 2022] GET /compute/v2.1/images => generated 445 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:20.649930 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ede05ea6-235b-4a2e-af03-03564d83c562 tempest-ListImagesTestJSON-949618342 tempest-ListImagesTestJSON-949618342-project] Calling method '.version_select at 0x7fa94bcb3a60>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:20.731766 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ede05ea6-235b-4a2e-af03-03564d83c562 tempest-ListImagesTestJSON-949618342 tempest-ListImagesTestJSON-949618342-project] 10.222.0.46 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.085558 Jul 28 10:38:20.732669 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 480/979] 10.222.0.46 () {58 vars in 1143 bytes} [Thu Jul 28 10:38:20 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:20.837172 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7a2dabd9-5fdd-40f7-8f8c-4e78fb2e7122 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/fdb8d162-a443-4be7-9e51-1ff00fffe616" status: 202 len: 0 microversion: 2.1 time: 1.353160 Jul 28 10:38:20.839078 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 500/980] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:38:19 2022] DELETE /compute/v2.1/os-security-groups/fdb8d162-a443-4be7-9e51-1ff00fffe616 => generated 0 bytes in 1356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:20.847986 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-eaecadfa-ebd0-4e67-b6ce-da1e49463dc7 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] Calling method '.version_select at 0x7fa94bc73c10>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:21.763104 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-eaecadfa-ebd0-4e67-b6ce-da1e49463dc7 tempest-SecurityGroupRulesTestJSON-72927462 tempest-SecurityGroupRulesTestJSON-72927462-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/3af4284c-4e4e-477e-aa03-1be20586337e" status: 202 len: 0 microversion: 2.1 time: 0.919748 Jul 28 10:38:21.766499 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 481/981] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 10:38:20 2022] DELETE /compute/v2.1/os-security-groups/3af4284c-4e4e-477e-aa03-1be20586337e => generated 0 bytes in 924 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:38:25.264478 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-708134347", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69500ed2-ae4f-4144-8e9d-24b29e196bec"}], "security_groups": [{"name": "tempest-securitygroup--1506837922"}], "key_name": "tempest-keypair-601712399", "user_data": "}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:26.113801 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] validate_networks() for [('69500ed2-ae4f-4144-8e9d-24b29e196bec', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:38:26.781430 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4f04f5aa-208d-4207-97c2-35e84a6c57fb tempest-AbsoluteLimitsTestJSON-1581685314 tempest-AbsoluteLimitsTestJSON-1581685314-project] Calling method '.version_select at 0x7fa94ba22f70>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:26.806890 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4f04f5aa-208d-4207-97c2-35e84a6c57fb tempest-AbsoluteLimitsTestJSON-1581685314 tempest-AbsoluteLimitsTestJSON-1581685314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:26.807702 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4f04f5aa-208d-4207-97c2-35e84a6c57fb tempest-AbsoluteLimitsTestJSON-1581685314 tempest-AbsoluteLimitsTestJSON-1581685314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:26.819746 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4f04f5aa-208d-4207-97c2-35e84a6c57fb tempest-AbsoluteLimitsTestJSON-1581685314 tempest-AbsoluteLimitsTestJSON-1581685314-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:26.820212 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4f04f5aa-208d-4207-97c2-35e84a6c57fb tempest-AbsoluteLimitsTestJSON-1581685314 tempest-AbsoluteLimitsTestJSON-1581685314-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:26.900045 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-4f04f5aa-208d-4207-97c2-35e84a6c57fb tempest-AbsoluteLimitsTestJSON-1581685314 tempest-AbsoluteLimitsTestJSON-1581685314-project] 10.222.0.46 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.589650 Jul 28 10:38:26.904583 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 482/982] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Jul 28 10:38:26 2022] GET /compute/v2.1/limits => generated 511 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:27.622575 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:38:27.623120 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:38:27.628127 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:38:27.629725 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:38:27.630369 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:38:27.651710 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:27.652874 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:27.658232 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:27.660244 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:27.691127 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Getting quotas for project 379dcc2f97914adaa94499fd20cd9db1. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:38:27.708968 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Getting quotas for user 03ef18439781414692668adce06788d3 and project 379dcc2f97914adaa94499fd20cd9db1. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:38:27.728210 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:38:27.731660 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 227c693a-0f30-4dd6-92b8-53c601029444] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:38:27.850061 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-dfdcaa47-e34b-48d0-9037-3474e74a0260 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.588075 Jul 28 10:38:27.850905 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 501/983] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:38:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 2593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:38:27.865674 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e722ab3d-ebda-42fb-b87c-5c683c71082b tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:27.866382 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-e722ab3d-ebda-42fb-b87c-5c683c71082b tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 227c693a-0f30-4dd6-92b8-53c601029444] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:38:28.024924 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-e722ab3d-ebda-42fb-b87c-5c683c71082b tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef18439781414692668adce06788d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379dcc2f97914adaa94499fd20cd9db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:28.042197 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e722ab3d-ebda-42fb-b87c-5c683c71082b tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] 10.222.0.46 "GET /compute/v2.1/servers/227c693a-0f30-4dd6-92b8-53c601029444" status: 200 len: 1236 microversion: 2.1 time: 0.177830 Jul 28 10:38:28.054645 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 483/984] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:38:27 2022] GET /compute/v2.1/servers/227c693a-0f30-4dd6-92b8-53c601029444 => generated 1236 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:29.072523 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8d2e79f7-3db5-4d29-9fcb-e5b77033d414 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:29.076304 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-8d2e79f7-3db5-4d29-9fcb-e5b77033d414 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 227c693a-0f30-4dd6-92b8-53c601029444] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:38:29.090056 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8d2e79f7-3db5-4d29-9fcb-e5b77033d414 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:29.091493 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8d2e79f7-3db5-4d29-9fcb-e5b77033d414 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:29.093808 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8d2e79f7-3db5-4d29-9fcb-e5b77033d414 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:29.095248 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8d2e79f7-3db5-4d29-9fcb-e5b77033d414 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:29.138323 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8d2e79f7-3db5-4d29-9fcb-e5b77033d414 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:29.139136 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8d2e79f7-3db5-4d29-9fcb-e5b77033d414 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:29.140598 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-8d2e79f7-3db5-4d29-9fcb-e5b77033d414 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lazy-loading 'fault' on Instance uuid 227c693a-0f30-4dd6-92b8-53c601029444 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:38:29.227057 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-8d2e79f7-3db5-4d29-9fcb-e5b77033d414 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef18439781414692668adce06788d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379dcc2f97914adaa94499fd20cd9db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:29.269775 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-8d2e79f7-3db5-4d29-9fcb-e5b77033d414 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] 10.222.0.46 "GET /compute/v2.1/servers/227c693a-0f30-4dd6-92b8-53c601029444" status: 200 len: 1309 microversion: 2.1 time: 0.207545 Jul 28 10:38:29.281682 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 502/985] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:38:29 2022] GET /compute/v2.1/servers/227c693a-0f30-4dd6-92b8-53c601029444 => generated 1309 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:29.329091 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-fdf0469c-f95c-4c6e-acee-b8ae4b68e61b tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:29.329091 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-fdf0469c-f95c-4c6e-acee-b8ae4b68e61b tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 227c693a-0f30-4dd6-92b8-53c601029444] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:38:29.364043 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fdf0469c-f95c-4c6e-acee-b8ae4b68e61b tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:29.373778 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fdf0469c-f95c-4c6e-acee-b8ae4b68e61b tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:29.375691 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fdf0469c-f95c-4c6e-acee-b8ae4b68e61b tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:29.376299 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fdf0469c-f95c-4c6e-acee-b8ae4b68e61b tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:29.482779 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-fdf0469c-f95c-4c6e-acee-b8ae4b68e61b tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 227c693a-0f30-4dd6-92b8-53c601029444] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:38:29.684512 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-fdf0469c-f95c-4c6e-acee-b8ae4b68e61b tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 227c693a-0f30-4dd6-92b8-53c601029444] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:38:29.685745 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fdf0469c-f95c-4c6e-acee-b8ae4b68e61b tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:29.689199 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-fdf0469c-f95c-4c6e-acee-b8ae4b68e61b tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:29.690189 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-fdf0469c-f95c-4c6e-acee-b8ae4b68e61b tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 227c693a-0f30-4dd6-92b8-53c601029444] instance's host None is down, deleting from database Jul 28 10:38:29.701467 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-fdf0469c-f95c-4c6e-acee-b8ae4b68e61b tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 227c693a-0f30-4dd6-92b8-53c601029444] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:38:30.152776 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-fdf0469c-f95c-4c6e-acee-b8ae4b68e61b tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 227c693a-0f30-4dd6-92b8-53c601029444] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:38:30.160917 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-fdf0469c-f95c-4c6e-acee-b8ae4b68e61b tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 227c693a-0f30-4dd6-92b8-53c601029444] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:38:30.599970 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-fdf0469c-f95c-4c6e-acee-b8ae4b68e61b tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] 10.222.0.46 "DELETE /compute/v2.1/servers/227c693a-0f30-4dd6-92b8-53c601029444" status: 204 len: 0 microversion: 2.1 time: 1.276414 Jul 28 10:38:30.600877 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 484/986] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:38:29 2022] DELETE /compute/v2.1/servers/227c693a-0f30-4dd6-92b8-53c601029444 => generated 0 bytes in 1278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:38:30.613224 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-436b6fa2-7fdc-4140-ad0d-b60b06ff139f tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:30.631562 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-436b6fa2-7fdc-4140-ad0d-b60b06ff139f tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 227c693a-0f30-4dd6-92b8-53c601029444] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:38:30.645312 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-436b6fa2-7fdc-4140-ad0d-b60b06ff139f tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:30.646131 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-436b6fa2-7fdc-4140-ad0d-b60b06ff139f tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:30.647496 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-436b6fa2-7fdc-4140-ad0d-b60b06ff139f tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:30.653621 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-436b6fa2-7fdc-4140-ad0d-b60b06ff139f tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:30.794931 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-436b6fa2-7fdc-4140-ad0d-b60b06ff139f tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] HTTP exception thrown: Instance 227c693a-0f30-4dd6-92b8-53c601029444 could not be found. Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-436b6fa2-7fdc-4140-ad0d-b60b06ff139f tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Request method failure captured: Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/227c693a-0f30-4dd6-92b8-53c601029444 HTTP/1.1 Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mcXgHvKt0z11d0uZ2SDcZgVxNRz66AN_SZO3XxfYBZQmq1hxIAqa86aa19K0KWg6g7s7OgLk54eF7glIYgrXcBF1SX5NwaQ6sCWkn_pBiKXeFU5L12kGxLOBM4xplkdK4sgqbk8WZe1ztVfOBKgbsYSt4Kvku3dXL5ip2iIIEhWkHs Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 379dcc2f97914adaa94499fd20cd9db1 Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-AttachVolumeTestJSON-848021686 Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/379dcc2f97914adaa94499fd20cd9db1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/379dcc2f97914adaa94499fd20cd9db1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/379dcc2f97914adaa94499fd20cd9db1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_379dcc2f97914adaa94499fd20cd9db1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-AttachVolumeTestJSON-848021686 Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 379dcc2f97914adaa94499fd20cd9db1 Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-AttachVolumeTestJSON-848021686 Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-AttachVolumeTestJSON-848021686-project Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 03ef18439781414692668adce06788d3 Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-AttachVolumeTestJSON-848021686-project Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 227c693a-0f30-4dd6-92b8-53c601029444 could not be found. Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '227c693a-0f30-4dd6-92b8-53c601029444'} Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 227c693a-0f30-4dd6-92b8-53c601029444 could not be found. Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 227c693a-0f30-4dd6-92b8-53c601029444 could not be found. Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:38:30.807431 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:38:30.816933 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:38:30.816933 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:38:30.816933 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:38:30.816933 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:38:30.816933 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:38:30.816933 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 227c693a-0f30-4dd6-92b8-53c601029444 could not be found. Jul 28 10:38:30.816933 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:38:30.824083 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-436b6fa2-7fdc-4140-ad0d-b60b06ff139f tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Returning 404 to user: Instance 227c693a-0f30-4dd6-92b8-53c601029444 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:38:30.825924 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-436b6fa2-7fdc-4140-ad0d-b60b06ff139f tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] 10.222.0.46 "GET /compute/v2.1/servers/227c693a-0f30-4dd6-92b8-53c601029444" status: 404 len: 111 microversion: 2.1 time: 0.220181 Jul 28 10:38:30.827622 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 503/987] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:38:30 2022] GET /compute/v2.1/servers/227c693a-0f30-4dd6-92b8-53c601029444 => generated 111 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:38:30.867577 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ca9204d1-18fa-4aef-9d75-eac493c28188 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Calling method '.version_select at 0x7fa94ba22820>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:30.987362 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ca9204d1-18fa-4aef-9d75-eac493c28188 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-601712399" status: 202 len: 0 microversion: 2.1 time: 0.140290 Jul 28 10:38:31.001185 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 485/988] 10.222.0.46 () {58 vars in 1218 bytes} [Thu Jul 28 10:38:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-601712399 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:34.195414 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-da73efba-46df-4273-8119-d5fb78db2a20 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Action: 'create', calling method: .version_select at 0x7fa94b937a60>, body: {"keypair": {"name": "tempest-keypair-202800334", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb74nJ+s7Ze+XH5xXX+peU5AsNOsxbdsNzzIJGkT2rKHdB2mCMP5Qy5kojZIVD1L2IpOk8Vh53QraXD1pC0OkwcSa6HZyuGoQQANq394xPnlB4F0B6LYWS56y7Ydnxkmg=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:34.226017 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-da73efba-46df-4273-8119-d5fb78db2a20 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Getting quotas for project 379dcc2f97914adaa94499fd20cd9db1. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:38:34.232316 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-da73efba-46df-4273-8119-d5fb78db2a20 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Getting quotas for user 03ef18439781414692668adce06788d3 and project 379dcc2f97914adaa94499fd20cd9db1. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:38:34.263098 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-da73efba-46df-4273-8119-d5fb78db2a20 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.077917 Jul 28 10:38:34.274091 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 504/989] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:38:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:34.768916 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1257396944", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "fa3ecf2c-6614-4894-bc11-9eaf1178a585"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:34.898587 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] validate_networks() for [('fa3ecf2c-6614-4894-bc11-9eaf1178a585', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:38:36.414489 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:38:36.416259 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:38:36.418616 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:38:36.419858 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:38:36.420710 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:38:36.440286 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:36.440900 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:36.442104 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:36.443062 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:36.493477 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Getting quotas for project 50fb148287634cd88cc27a88a4ed00a1. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:38:36.508766 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Getting quotas for user ab15aa9e59f747399e930c053549ab76 and project 50fb148287634cd88cc27a88a4ed00a1. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:38:36.536123 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:38:36.540693 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] [instance: 71eece65-768c-41e3-89e9-87ac63faf774] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:38:36.664899 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-752cd3aa-ae8d-4378-bc4d-b382fd05d27c tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.129776 Jul 28 10:38:36.668272 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 486/990] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:38:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:38:36.678537 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2139d021-b17a-4ebf-9d6a-c5332ec77fe9 tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:36.679152 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-2139d021-b17a-4ebf-9d6a-c5332ec77fe9 tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] [instance: 71eece65-768c-41e3-89e9-87ac63faf774] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:38:37.213736 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-2139d021-b17a-4ebf-9d6a-c5332ec77fe9 tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab15aa9e59f747399e930c053549ab76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fb148287634cd88cc27a88a4ed00a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:37.228026 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-2139d021-b17a-4ebf-9d6a-c5332ec77fe9 tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] 10.222.0.46 "GET /compute/v2.1/servers/71eece65-768c-41e3-89e9-87ac63faf774" status: 200 len: 1217 microversion: 2.1 time: 0.553330 Jul 28 10:38:37.231605 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 505/991] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:38:36 2022] GET /compute/v2.1/servers/71eece65-768c-41e3-89e9-87ac63faf774 => generated 1217 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:38.269681 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d1139568-4e48-4f00-9938-591e04f094fe tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:38.271159 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-d1139568-4e48-4f00-9938-591e04f094fe tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] [instance: 71eece65-768c-41e3-89e9-87ac63faf774] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:38:38.289846 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d1139568-4e48-4f00-9938-591e04f094fe tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:38.291034 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d1139568-4e48-4f00-9938-591e04f094fe tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:38.295399 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d1139568-4e48-4f00-9938-591e04f094fe tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:38.296839 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d1139568-4e48-4f00-9938-591e04f094fe tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:38.360210 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d1139568-4e48-4f00-9938-591e04f094fe tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:38.361479 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d1139568-4e48-4f00-9938-591e04f094fe tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:38.366467 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-d1139568-4e48-4f00-9938-591e04f094fe tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lazy-loading 'fault' on Instance uuid 71eece65-768c-41e3-89e9-87ac63faf774 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:38:38.675836 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-d1139568-4e48-4f00-9938-591e04f094fe tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab15aa9e59f747399e930c053549ab76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fb148287634cd88cc27a88a4ed00a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:38.690166 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d1139568-4e48-4f00-9938-591e04f094fe tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] 10.222.0.46 "GET /compute/v2.1/servers/71eece65-768c-41e3-89e9-87ac63faf774" status: 200 len: 1290 microversion: 2.1 time: 0.421912 Jul 28 10:38:38.691671 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 487/992] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:38:38 2022] GET /compute/v2.1/servers/71eece65-768c-41e3-89e9-87ac63faf774 => generated 1290 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:38.715326 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-033c7419-639b-44c6-bb45-5e0d35d152ef tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:38.717500 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-033c7419-639b-44c6-bb45-5e0d35d152ef tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] [instance: 71eece65-768c-41e3-89e9-87ac63faf774] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:38:38.726562 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:38.740968 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-033c7419-639b-44c6-bb45-5e0d35d152ef tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:38.741635 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-033c7419-639b-44c6-bb45-5e0d35d152ef tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:38.745552 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-033c7419-639b-44c6-bb45-5e0d35d152ef tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:38.746412 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-033c7419-639b-44c6-bb45-5e0d35d152ef tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:38.829528 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-033c7419-639b-44c6-bb45-5e0d35d152ef tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] [instance: 71eece65-768c-41e3-89e9-87ac63faf774] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:38:38.938787 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-033c7419-639b-44c6-bb45-5e0d35d152ef tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] [instance: 71eece65-768c-41e3-89e9-87ac63faf774] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:38:38.939985 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-033c7419-639b-44c6-bb45-5e0d35d152ef tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:38.940618 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-033c7419-639b-44c6-bb45-5e0d35d152ef tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:38.941808 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-033c7419-639b-44c6-bb45-5e0d35d152ef tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] [instance: 71eece65-768c-41e3-89e9-87ac63faf774] instance's host None is down, deleting from database Jul 28 10:38:38.949263 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-033c7419-639b-44c6-bb45-5e0d35d152ef tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] [instance: 71eece65-768c-41e3-89e9-87ac63faf774] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:38:39.226325 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-033c7419-639b-44c6-bb45-5e0d35d152ef tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] [instance: 71eece65-768c-41e3-89e9-87ac63faf774] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:38:39.241748 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-033c7419-639b-44c6-bb45-5e0d35d152ef tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] [instance: 71eece65-768c-41e3-89e9-87ac63faf774] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:38:39.646554 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-033c7419-639b-44c6-bb45-5e0d35d152ef tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] 10.222.0.46 "DELETE /compute/v2.1/servers/71eece65-768c-41e3-89e9-87ac63faf774" status: 204 len: 0 microversion: 2.1 time: 0.936933 Jul 28 10:38:39.647490 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 506/993] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:38:38 2022] DELETE /compute/v2.1/servers/71eece65-768c-41e3-89e9-87ac63faf774 => generated 0 bytes in 939 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 10:38:39.676841 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0c94b2ba-86da-46c4-b657-1313c79c08dd tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:39.680142 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-0c94b2ba-86da-46c4-b657-1313c79c08dd tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] [instance: 71eece65-768c-41e3-89e9-87ac63faf774] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:38:39.694237 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:39.698834 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0c94b2ba-86da-46c4-b657-1313c79c08dd tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:39.701881 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0c94b2ba-86da-46c4-b657-1313c79c08dd tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:39.704867 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0c94b2ba-86da-46c4-b657-1313c79c08dd tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:39.705987 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0c94b2ba-86da-46c4-b657-1313c79c08dd tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:39.788687 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-0c94b2ba-86da-46c4-b657-1313c79c08dd tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] HTTP exception thrown: Instance 71eece65-768c-41e3-89e9-87ac63faf774 could not be found. Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0c94b2ba-86da-46c4-b657-1313c79c08dd tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Request method failure captured: Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/71eece65-768c-41e3-89e9-87ac63faf774 HTTP/1.1 Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mcq2Y2itxGOrtqQoOi4ZvH0Pzy12fQ6ksQGIX2s5Sn1ahKyVwVrK_mljmeWZqxx9G82QMLyMvwy08HnqRTDC1F3sTfSCXo_nw7bHpQO-NVp0hTdmkZA3FIMriR6RbfAYWp5D9Ln_vMb9qEaKnp5vnau8HtD95R4OL0N5x92el4xh_A Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 50fb148287634cd88cc27a88a4ed00a1 Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-InstanceActionsTestJSON-181561003 Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/50fb148287634cd88cc27a88a4ed00a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/50fb148287634cd88cc27a88a4ed00a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/50fb148287634cd88cc27a88a4ed00a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_50fb148287634cd88cc27a88a4ed00a1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-InstanceActionsTestJSON-181561003 Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 50fb148287634cd88cc27a88a4ed00a1 Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-InstanceActionsTestJSON-181561003 Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-InstanceActionsTestJSON-181561003-project Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: ab15aa9e59f747399e930c053549ab76 Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-InstanceActionsTestJSON-181561003-project Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 71eece65-768c-41e3-89e9-87ac63faf774 could not be found. Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '71eece65-768c-41e3-89e9-87ac63faf774'} Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71eece65-768c-41e3-89e9-87ac63faf774 could not be found. Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71eece65-768c-41e3-89e9-87ac63faf774 could not be found. Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:38:39.792881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:38:39.803345 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:38:39.803345 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:38:39.803345 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:38:39.803345 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:38:39.803345 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:38:39.803345 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71eece65-768c-41e3-89e9-87ac63faf774 could not be found. Jul 28 10:38:39.803345 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:38:39.814465 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0c94b2ba-86da-46c4-b657-1313c79c08dd tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] Returning 404 to user: Instance 71eece65-768c-41e3-89e9-87ac63faf774 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:38:39.816125 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-0c94b2ba-86da-46c4-b657-1313c79c08dd tempest-InstanceActionsTestJSON-181561003 tempest-InstanceActionsTestJSON-181561003-project] 10.222.0.46 "GET /compute/v2.1/servers/71eece65-768c-41e3-89e9-87ac63faf774" status: 404 len: 111 microversion: 2.1 time: 0.163797 Jul 28 10:38:39.818557 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 488/994] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:38:39 2022] GET /compute/v2.1/servers/71eece65-768c-41e3-89e9-87ac63faf774 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:38:40.433161 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2586397", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69500ed2-ae4f-4144-8e9d-24b29e196bec"}], "security_groups": [{"name": "tempest-securitygroup--1127496327"}], "key_name": "tempest-keypair-202800334", "user_data": "}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:41.272463 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] validate_networks() for [('69500ed2-ae4f-4144-8e9d-24b29e196bec', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:38:45.341592 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:38:45.342747 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:38:45.344282 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:38:45.345040 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:38:45.345643 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:38:45.367830 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:45.368598 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:45.369616 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:45.370401 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:45.428219 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Getting quotas for project 379dcc2f97914adaa94499fd20cd9db1. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:38:45.444810 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Getting quotas for user 03ef18439781414692668adce06788d3 and project 379dcc2f97914adaa94499fd20cd9db1. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:38:45.477908 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:38:45.487476 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 319758b5-2a65-4373-9541-a108f238deb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:38:45.578549 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7a7a1ee3-a624-4ed3-8e0f-69a345f5b3e3 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.158197 Jul 28 10:38:45.579400 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 507/995] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:38:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 5164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:38:45.595302 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-96e0ea4a-fa2b-407b-b1e1-f5e87608ed4d tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:45.596002 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-96e0ea4a-fa2b-407b-b1e1-f5e87608ed4d tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 319758b5-2a65-4373-9541-a108f238deb2] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:38:45.972257 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-96e0ea4a-fa2b-407b-b1e1-f5e87608ed4d tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef18439781414692668adce06788d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379dcc2f97914adaa94499fd20cd9db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:45.982028 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-96e0ea4a-fa2b-407b-b1e1-f5e87608ed4d tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] 10.222.0.46 "GET /compute/v2.1/servers/319758b5-2a65-4373-9541-a108f238deb2" status: 200 len: 1234 microversion: 2.1 time: 0.395239 Jul 28 10:38:45.982508 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 489/996] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:38:45 2022] GET /compute/v2.1/servers/319758b5-2a65-4373-9541-a108f238deb2 => generated 1234 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:46.288086 n-d-850468-6 devstack@n-api.service[119463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:38:46.288614 n-d-850468-6 devstack@n-api.service[119463]: Thu Jul 28 10:38:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 10:38:47.012737 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-40268ab0-2072-42c6-ba1d-588699609cbb tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:47.013674 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-40268ab0-2072-42c6-ba1d-588699609cbb tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 319758b5-2a65-4373-9541-a108f238deb2] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:38:47.050967 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-40268ab0-2072-42c6-ba1d-588699609cbb tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:47.055223 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-40268ab0-2072-42c6-ba1d-588699609cbb tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:47.058978 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-40268ab0-2072-42c6-ba1d-588699609cbb tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:47.063334 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-40268ab0-2072-42c6-ba1d-588699609cbb tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:47.198419 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-40268ab0-2072-42c6-ba1d-588699609cbb tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:47.205133 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-40268ab0-2072-42c6-ba1d-588699609cbb tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:47.209552 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-40268ab0-2072-42c6-ba1d-588699609cbb tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lazy-loading 'fault' on Instance uuid 319758b5-2a65-4373-9541-a108f238deb2 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:38:47.378650 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-40268ab0-2072-42c6-ba1d-588699609cbb tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef18439781414692668adce06788d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379dcc2f97914adaa94499fd20cd9db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:47.403600 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-40268ab0-2072-42c6-ba1d-588699609cbb tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] 10.222.0.46 "GET /compute/v2.1/servers/319758b5-2a65-4373-9541-a108f238deb2" status: 200 len: 1307 microversion: 2.1 time: 0.402383 Jul 28 10:38:47.404883 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 508/997] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:38:46 2022] GET /compute/v2.1/servers/319758b5-2a65-4373-9541-a108f238deb2 => generated 1307 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:47.433401 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-440cbfd7-253d-4ea3-8304-af5d87033f9d tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:47.435656 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-440cbfd7-253d-4ea3-8304-af5d87033f9d tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 319758b5-2a65-4373-9541-a108f238deb2] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:38:47.443999 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:47.473007 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-440cbfd7-253d-4ea3-8304-af5d87033f9d tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:47.474153 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-440cbfd7-253d-4ea3-8304-af5d87033f9d tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:47.475649 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-440cbfd7-253d-4ea3-8304-af5d87033f9d tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:47.476576 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-440cbfd7-253d-4ea3-8304-af5d87033f9d tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:47.550333 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-440cbfd7-253d-4ea3-8304-af5d87033f9d tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 319758b5-2a65-4373-9541-a108f238deb2] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:38:47.653656 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-440cbfd7-253d-4ea3-8304-af5d87033f9d tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 319758b5-2a65-4373-9541-a108f238deb2] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:38:47.654947 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-440cbfd7-253d-4ea3-8304-af5d87033f9d tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:47.656721 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-440cbfd7-253d-4ea3-8304-af5d87033f9d tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:47.657778 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-440cbfd7-253d-4ea3-8304-af5d87033f9d tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 319758b5-2a65-4373-9541-a108f238deb2] instance's host None is down, deleting from database Jul 28 10:38:47.662420 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-440cbfd7-253d-4ea3-8304-af5d87033f9d tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 319758b5-2a65-4373-9541-a108f238deb2] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:38:47.799240 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-440cbfd7-253d-4ea3-8304-af5d87033f9d tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 319758b5-2a65-4373-9541-a108f238deb2] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:38:47.807645 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-440cbfd7-253d-4ea3-8304-af5d87033f9d tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 319758b5-2a65-4373-9541-a108f238deb2] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:38:48.223556 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=62,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:48.257769 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-440cbfd7-253d-4ea3-8304-af5d87033f9d tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] 10.222.0.46 "DELETE /compute/v2.1/servers/319758b5-2a65-4373-9541-a108f238deb2" status: 204 len: 0 microversion: 2.1 time: 0.833240 Jul 28 10:38:48.258644 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 490/998] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:38:47 2022] DELETE /compute/v2.1/servers/319758b5-2a65-4373-9541-a108f238deb2 => generated 0 bytes in 835 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:38:48.273773 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-09d507a2-5e7e-4c05-9cbd-63f8a3bfe691 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:48.274409 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-09d507a2-5e7e-4c05-9cbd-63f8a3bfe691 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] [instance: 319758b5-2a65-4373-9541-a108f238deb2] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:38:48.310006 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-09d507a2-5e7e-4c05-9cbd-63f8a3bfe691 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:48.313984 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-09d507a2-5e7e-4c05-9cbd-63f8a3bfe691 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:48.315960 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-09d507a2-5e7e-4c05-9cbd-63f8a3bfe691 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:38:48.318368 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-09d507a2-5e7e-4c05-9cbd-63f8a3bfe691 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:38:48.371221 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-09d507a2-5e7e-4c05-9cbd-63f8a3bfe691 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] HTTP exception thrown: Instance 319758b5-2a65-4373-9541-a108f238deb2 could not be found. Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-09d507a2-5e7e-4c05-9cbd-63f8a3bfe691 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Request method failure captured: Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/319758b5-2a65-4373-9541-a108f238deb2 HTTP/1.1 Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mcXgHvKt0z11d0uZ2SDcZgVxNRz66AN_SZO3XxfYBZQmq1hxIAqa86aa19K0KWg6g7s7OgLk54eF7glIYgrXcBF1SX5NwaQ6sCWkn_pBiKXeFU5L12kGxLOBM4xplkdK4sgqbk8WZe1ztVfOBKgbsYSt4Kvku3dXL5ip2iIIEhWkHs Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 379dcc2f97914adaa94499fd20cd9db1 Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-AttachVolumeTestJSON-848021686 Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/379dcc2f97914adaa94499fd20cd9db1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/379dcc2f97914adaa94499fd20cd9db1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/379dcc2f97914adaa94499fd20cd9db1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_379dcc2f97914adaa94499fd20cd9db1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-AttachVolumeTestJSON-848021686 Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 379dcc2f97914adaa94499fd20cd9db1 Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-AttachVolumeTestJSON-848021686 Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-AttachVolumeTestJSON-848021686-project Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 03ef18439781414692668adce06788d3 Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-AttachVolumeTestJSON-848021686-project Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 319758b5-2a65-4373-9541-a108f238deb2 could not be found. Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '319758b5-2a65-4373-9541-a108f238deb2'} Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 319758b5-2a65-4373-9541-a108f238deb2 could not be found. Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 319758b5-2a65-4373-9541-a108f238deb2 could not be found. Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:38:48.373836 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:38:48.378841 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:38:48.378841 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:38:48.378841 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:38:48.378841 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:38:48.378841 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:38:48.378841 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 319758b5-2a65-4373-9541-a108f238deb2 could not be found. Jul 28 10:38:48.378841 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:38:48.378841 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-09d507a2-5e7e-4c05-9cbd-63f8a3bfe691 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Returning 404 to user: Instance 319758b5-2a65-4373-9541-a108f238deb2 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:38:48.379747 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-09d507a2-5e7e-4c05-9cbd-63f8a3bfe691 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] 10.222.0.46 "GET /compute/v2.1/servers/319758b5-2a65-4373-9541-a108f238deb2" status: 404 len: 111 microversion: 2.1 time: 0.116246 Jul 28 10:38:48.384252 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 509/999] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:38:48 2022] GET /compute/v2.1/servers/319758b5-2a65-4373-9541-a108f238deb2 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:38:48.394977 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4ac5dc87-d517-46f7-bff3-7fd4a9cd2ec4 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] Calling method '.version_select at 0x7fa94bc15790>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:48.440322 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-4ac5dc87-d517-46f7-bff3-7fd4a9cd2ec4 tempest-AttachVolumeTestJSON-848021686 tempest-AttachVolumeTestJSON-848021686-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-202800334" status: 202 len: 0 microversion: 2.1 time: 0.051066 Jul 28 10:38:48.445220 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 491/1000] 10.222.0.46 () {58 vars in 1218 bytes} [Thu Jul 28 10:38:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-202800334 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:54.939597 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-78d482f7-4b4d-4b7a-8d59-1992794b7d24 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Action: 'create', calling method: .version_select at 0x7fa94b8e7ca0>, body: {"keypair": {"name": "tempest-keypair-1015487755", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGiw7EJ3c0984lX6xbgK8RmyZyIKsk8iWQD1g30mIsKXwfiaEm4jXhtt7jbrBbmPpix9nblH9wBxHUYaoV0AwViFJmW0uJTGfHH5rh6z8hbPrOj7Z+chtq72bw5k7l3KQ=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:54.951675 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:54.993616 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-78d482f7-4b4d-4b7a-8d59-1992794b7d24 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Getting quotas for project 64cc6289ea42425b991fefecc2283ad4. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:38:55.018137 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-78d482f7-4b4d-4b7a-8d59-1992794b7d24 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Getting quotas for user dbe6b0528a9c4b43b19c021fa7cce6c1 and project 64cc6289ea42425b991fefecc2283ad4. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:38:55.110569 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-78d482f7-4b4d-4b7a-8d59-1992794b7d24 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.022172 Jul 28 10:38:55.111194 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 510/1001] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:38:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:59.102045 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=16 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:59.102927 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:38:59.585570 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1575314933", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "57359a1a-235d-4fb9-b480-45a4e841934e"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:59.741613 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] validate_networks() for [('57359a1a-235d-4fb9-b480-45a4e841934e', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:39:01.563002 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:01.564544 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=48,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:02.317651 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2cfe1d41-025d-40e6-956f-48c61c3e6ee9 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Action: 'create', calling method: .version_select at 0x7fa94b90da60>, body: {"keypair": {"name": "tempest-keypair-1850566441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFs5ShAM1qzKxIku+Cvp/MNjK1zjFaMo8l9nqpIwaZkYSd9E+V8LTd+85X+d9l3GmZ8YP6+U4sI3CNnoSHwx79Jn/Uek2ennIT3vAZy+zSz0qIdTghUS9Qlj3Gz4jPfJbg=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:02.416224 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:39:02.418313 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:39:02.419546 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:39:02.424512 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:39:02.431664 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:39:02.447906 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=23 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:02.451737 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-2cfe1d41-025d-40e6-956f-48c61c3e6ee9 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Getting quotas for project 68c2fb476a154c3bb04127e64323fe4f. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:39:02.484569 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-2cfe1d41-025d-40e6-956f-48c61c3e6ee9 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Getting quotas for user fc14a1b00c2e4916a71a667aef6ec064 and project 68c2fb476a154c3bb04127e64323fe4f. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:39:02.503088 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:02.503548 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:02.515789 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:02.522574 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:02.560209 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-2cfe1d41-025d-40e6-956f-48c61c3e6ee9 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.002845 Jul 28 10:39:02.565980 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 511/1002] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:39:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:39:02.599584 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Getting quotas for project 3965b1f18dbe42e3b1a8d3cc06e787ff. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:39:02.615401 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Getting quotas for user d5d64c7b72c14b919b05c2c645f6430b and project 3965b1f18dbe42e3b1a8d3cc06e787ff. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:39:02.665525 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:39:02.668591 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 9485fc67-a713-40e2-b668-4ab159afd840] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:39:02.873610 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-80d6f2a1-f4a7-444e-8903-2795b0dd31be tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.770044 Jul 28 10:39:02.878701 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 492/1003] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:38:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:39:03.307751 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1687668248", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "57359a1a-235d-4fb9-b480-45a4e841934e"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:03.419341 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] validate_networks() for [('57359a1a-235d-4fb9-b480-45a4e841934e', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:39:05.111321 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "31a46682-7954-480a-a4de-5f409759b267"}], "security_groups": [{"name": "tempest-securitygroup--743985009"}], "key_name": "tempest-keypair-1015487755", "user_data": "}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:05.137053 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:39:05.138003 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:39:05.138458 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:39:05.140727 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:39:05.141004 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:39:05.167579 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:05.168035 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:05.168843 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:05.169661 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:05.251775 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Getting quotas for project 3965b1f18dbe42e3b1a8d3cc06e787ff. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:39:05.277384 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Getting quotas for user d5d64c7b72c14b919b05c2c645f6430b and project 3965b1f18dbe42e3b1a8d3cc06e787ff. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:39:05.317270 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:39:05.319540 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: c82c945b-51d1-4f7b-aa9e-0a9f84263137] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:39:05.514068 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a345f440-dc56-4f7a-bdd1-8a0b08b0cd3d tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.209903 Jul 28 10:39:05.517013 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 512/1004] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:39:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:39:05.805896 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] validate_networks() for [('31a46682-7954-480a-a4de-5f409759b267', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:39:05.931725 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2052200225", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "451", "networks": [{"uuid": "57359a1a-235d-4fb9-b480-45a4e841934e"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:06.057101 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] validate_networks() for [('57359a1a-235d-4fb9-b480-45a4e841934e', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:39:07.570619 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:39:07.571167 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:39:07.571748 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:39:07.572172 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:39:07.572592 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:39:07.595841 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:07.596330 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:07.597162 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:07.597610 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:07.643938 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Getting quotas for project 64cc6289ea42425b991fefecc2283ad4. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:39:07.657590 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Getting quotas for user dbe6b0528a9c4b43b19c021fa7cce6c1 and project 64cc6289ea42425b991fefecc2283ad4. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:39:07.677532 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:39:07.682433 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] [instance: 9eaf3533-646b-40e4-a091-6d33e25550e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:39:07.807260 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ff911e3a-306f-477b-b946-b9303f178f45 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.703829 Jul 28 10:39:07.807951 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 493/1005] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:39:05 2022] POST /compute/v2.1/servers => generated 408 bytes in 2706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:39:07.833437 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7766384c-b8a1-4303-b288-4956c5417621 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:07.837163 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-7766384c-b8a1-4303-b288-4956c5417621 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] [instance: 9eaf3533-646b-40e4-a091-6d33e25550e2] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:08.098808 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-7766384c-b8a1-4303-b288-4956c5417621 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe6b0528a9c4b43b19c021fa7cce6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64cc6289ea42425b991fefecc2283ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:08.110871 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-7766384c-b8a1-4303-b288-4956c5417621 tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] 10.222.0.46 "GET /compute/v2.1/servers/9eaf3533-646b-40e4-a091-6d33e25550e2" status: 200 len: 1226 microversion: 2.1 time: 0.290812 Jul 28 10:39:08.128579 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 494/1006] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:39:07 2022] GET /compute/v2.1/servers/9eaf3533-646b-40e4-a091-6d33e25550e2 => generated 1226 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:08.770231 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:39:08.771669 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:39:08.773649 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:39:08.774348 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:39:08.776806 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:39:08.830672 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:08.831554 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:08.833211 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:08.834066 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:08.900143 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Getting quotas for project 3965b1f18dbe42e3b1a8d3cc06e787ff. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:39:08.909363 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Getting quotas for user d5d64c7b72c14b919b05c2c645f6430b and project 3965b1f18dbe42e3b1a8d3cc06e787ff. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:39:09.055338 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:39:09.057825 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 43055861-475e-4c4c-ac33-428a805ba10e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:39:09.137089 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-172cd932-d222-497f-acc1-ebddb39eacdb tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:09.137736 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-172cd932-d222-497f-acc1-ebddb39eacdb tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] [instance: 9eaf3533-646b-40e4-a091-6d33e25550e2] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:09.163628 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-172cd932-d222-497f-acc1-ebddb39eacdb tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:09.164657 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-172cd932-d222-497f-acc1-ebddb39eacdb tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:09.166834 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-172cd932-d222-497f-acc1-ebddb39eacdb tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:09.169064 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-172cd932-d222-497f-acc1-ebddb39eacdb tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:09.211671 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-74098939-f932-4437-ae06-88e2e60cd23f tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.285507 Jul 28 10:39:09.212336 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 513/1007] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:39:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:39:09.239489 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4c226d58-eaa8-4bce-935e-ab2d99ba8395 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:09.240139 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-4c226d58-eaa8-4bce-935e-ab2d99ba8395 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 43055861-475e-4c4c-ac33-428a805ba10e] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:09.294033 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-172cd932-d222-497f-acc1-ebddb39eacdb tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:09.295692 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-172cd932-d222-497f-acc1-ebddb39eacdb tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:09.297475 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-172cd932-d222-497f-acc1-ebddb39eacdb tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lazy-loading 'fault' on Instance uuid 9eaf3533-646b-40e4-a091-6d33e25550e2 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:39:09.564618 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-4c226d58-eaa8-4bce-935e-ab2d99ba8395 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d64c7b72c14b919b05c2c645f6430b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3965b1f18dbe42e3b1a8d3cc06e787ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:09.572407 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-4c226d58-eaa8-4bce-935e-ab2d99ba8395 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] 10.222.0.46 "GET /compute/v2.1/servers/43055861-475e-4c4c-ac33-428a805ba10e" status: 200 len: 1221 microversion: 2.1 time: 0.350169 Jul 28 10:39:09.580614 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 514/1008] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:39:09 2022] GET /compute/v2.1/servers/43055861-475e-4c4c-ac33-428a805ba10e => generated 1221 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:09.745987 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-172cd932-d222-497f-acc1-ebddb39eacdb tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe6b0528a9c4b43b19c021fa7cce6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64cc6289ea42425b991fefecc2283ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:09.756940 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-172cd932-d222-497f-acc1-ebddb39eacdb tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] 10.222.0.46 "GET /compute/v2.1/servers/9eaf3533-646b-40e4-a091-6d33e25550e2" status: 200 len: 1299 microversion: 2.1 time: 0.626757 Jul 28 10:39:09.777888 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 495/1009] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:39:09 2022] GET /compute/v2.1/servers/9eaf3533-646b-40e4-a091-6d33e25550e2 => generated 1299 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:09.787965 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-85054fa4-1713-41fd-a2da-50c93762729f tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:09.788469 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-85054fa4-1713-41fd-a2da-50c93762729f tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] [instance: 9eaf3533-646b-40e4-a091-6d33e25550e2] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:09.805195 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-85054fa4-1713-41fd-a2da-50c93762729f tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:09.807305 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-85054fa4-1713-41fd-a2da-50c93762729f tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:09.808351 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-85054fa4-1713-41fd-a2da-50c93762729f tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:09.808810 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-85054fa4-1713-41fd-a2da-50c93762729f tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:09.878757 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-85054fa4-1713-41fd-a2da-50c93762729f tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] [instance: 9eaf3533-646b-40e4-a091-6d33e25550e2] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:39:10.014816 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-85054fa4-1713-41fd-a2da-50c93762729f tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] [instance: 9eaf3533-646b-40e4-a091-6d33e25550e2] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:39:10.017787 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-85054fa4-1713-41fd-a2da-50c93762729f tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:10.018556 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-85054fa4-1713-41fd-a2da-50c93762729f tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:10.019170 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-85054fa4-1713-41fd-a2da-50c93762729f tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] [instance: 9eaf3533-646b-40e4-a091-6d33e25550e2] instance's host None is down, deleting from database Jul 28 10:39:10.023964 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-85054fa4-1713-41fd-a2da-50c93762729f tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] [instance: 9eaf3533-646b-40e4-a091-6d33e25550e2] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:39:10.112319 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-85054fa4-1713-41fd-a2da-50c93762729f tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] [instance: 9eaf3533-646b-40e4-a091-6d33e25550e2] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:39:10.127956 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-85054fa4-1713-41fd-a2da-50c93762729f tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] [instance: 9eaf3533-646b-40e4-a091-6d33e25550e2] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:39:10.605726 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-95281a9c-a1ed-402f-95a5-820b1a64767a tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:10.608046 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-95281a9c-a1ed-402f-95a5-820b1a64767a tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 43055861-475e-4c4c-ac33-428a805ba10e] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:10.625914 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-95281a9c-a1ed-402f-95a5-820b1a64767a tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:10.636778 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-85054fa4-1713-41fd-a2da-50c93762729f tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9eaf3533-646b-40e4-a091-6d33e25550e2" status: 204 len: 0 microversion: 2.1 time: 0.852575 Jul 28 10:39:10.637278 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-95281a9c-a1ed-402f-95a5-820b1a64767a tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:10.643790 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 515/1010] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:39:09 2022] DELETE /compute/v2.1/servers/9eaf3533-646b-40e4-a091-6d33e25550e2 => generated 0 bytes in 855 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:39:10.648102 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-95281a9c-a1ed-402f-95a5-820b1a64767a tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:10.650278 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8124e4eb-96bc-41b8-93c9-76cbfbc7b01a tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:10.651235 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-8124e4eb-96bc-41b8-93c9-76cbfbc7b01a tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] [instance: 9eaf3533-646b-40e4-a091-6d33e25550e2] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:10.661163 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-95281a9c-a1ed-402f-95a5-820b1a64767a tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:10.683399 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8124e4eb-96bc-41b8-93c9-76cbfbc7b01a tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:10.691799 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8124e4eb-96bc-41b8-93c9-76cbfbc7b01a tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:10.694490 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8124e4eb-96bc-41b8-93c9-76cbfbc7b01a tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:10.695030 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-8124e4eb-96bc-41b8-93c9-76cbfbc7b01a tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:10.737127 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-8124e4eb-96bc-41b8-93c9-76cbfbc7b01a tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] HTTP exception thrown: Instance 9eaf3533-646b-40e4-a091-6d33e25550e2 could not be found. Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8124e4eb-96bc-41b8-93c9-76cbfbc7b01a tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Request method failure captured: Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/9eaf3533-646b-40e4-a091-6d33e25550e2 HTTP/1.1 Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mc9XJTHiAfywOfkf1s3LN24ADWNgHCJM4ehGHBmf6_rP97TpC8cQNRwW69DoWFxGdAEhZKLW4gXyo_hcjA1MEgtFMvMSDdjF_TWo1jQkO9JlZWAh0EhpR5iIZX4T1B14b6ekM4OZPp9y5wrwnrhEXxVNyag6hTN8MFnyI-ieeBxpPM Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 64cc6289ea42425b991fefecc2283ad4 Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ServersTestFqdnHostnames-845557534 Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/64cc6289ea42425b991fefecc2283ad4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/64cc6289ea42425b991fefecc2283ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/64cc6289ea42425b991fefecc2283ad4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_64cc6289ea42425b991fefecc2283ad4", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ServersTestFqdnHostnames-845557534 Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 64cc6289ea42425b991fefecc2283ad4 Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-845557534 Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ServersTestFqdnHostnames-845557534-project Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: dbe6b0528a9c4b43b19c021fa7cce6c1 Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ServersTestFqdnHostnames-845557534-project Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 9eaf3533-646b-40e4-a091-6d33e25550e2 could not be found. Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '9eaf3533-646b-40e4-a091-6d33e25550e2'} Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9eaf3533-646b-40e4-a091-6d33e25550e2 could not be found. Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9eaf3533-646b-40e4-a091-6d33e25550e2 could not be found. Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:39:10.743181 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:39:10.747424 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:39:10.747424 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:39:10.747424 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:39:10.747424 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:39:10.747424 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:39:10.747424 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9eaf3533-646b-40e4-a091-6d33e25550e2 could not be found. Jul 28 10:39:10.747424 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:39:10.758754 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8124e4eb-96bc-41b8-93c9-76cbfbc7b01a tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Returning 404 to user: Instance 9eaf3533-646b-40e4-a091-6d33e25550e2 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:39:10.759804 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-8124e4eb-96bc-41b8-93c9-76cbfbc7b01a tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] 10.222.0.46 "GET /compute/v2.1/servers/9eaf3533-646b-40e4-a091-6d33e25550e2" status: 404 len: 111 microversion: 2.1 time: 0.114784 Jul 28 10:39:10.770077 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 516/1011] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:39:10 2022] GET /compute/v2.1/servers/9eaf3533-646b-40e4-a091-6d33e25550e2 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:39:10.777208 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a29cca50-7237-464b-adc6-e25e9006a94b tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] Calling method '.version_select at 0x7fa94b8e7c10>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:10.802022 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-95281a9c-a1ed-402f-95a5-820b1a64767a tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:10.802613 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-95281a9c-a1ed-402f-95a5-820b1a64767a tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:10.804556 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-95281a9c-a1ed-402f-95a5-820b1a64767a tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lazy-loading 'fault' on Instance uuid 43055861-475e-4c4c-ac33-428a805ba10e {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:39:10.843472 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a29cca50-7237-464b-adc6-e25e9006a94b tempest-ServersTestFqdnHostnames-845557534 tempest-ServersTestFqdnHostnames-845557534-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015487755" status: 202 len: 0 microversion: 2.1 time: 0.069859 Jul 28 10:39:10.849598 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 517/1012] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Jul 28 10:39:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015487755 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:39:11.735777 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-95281a9c-a1ed-402f-95a5-820b1a64767a tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d64c7b72c14b919b05c2c645f6430b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3965b1f18dbe42e3b1a8d3cc06e787ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:11.761577 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-95281a9c-a1ed-402f-95a5-820b1a64767a tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] 10.222.0.46 "GET /compute/v2.1/servers/43055861-475e-4c4c-ac33-428a805ba10e" status: 200 len: 1294 microversion: 2.1 time: 1.163242 Jul 28 10:39:11.765950 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 496/1013] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:39:10 2022] GET /compute/v2.1/servers/43055861-475e-4c4c-ac33-428a805ba10e => generated 1294 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:11.788077 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-db266820-9616-4742-9ea4-c39075807d62 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:11.789146 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-db266820-9616-4742-9ea4-c39075807d62 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 43055861-475e-4c4c-ac33-428a805ba10e] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:11.801838 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-db266820-9616-4742-9ea4-c39075807d62 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:11.804000 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-db266820-9616-4742-9ea4-c39075807d62 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:11.810959 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-db266820-9616-4742-9ea4-c39075807d62 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:11.814233 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-db266820-9616-4742-9ea4-c39075807d62 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:11.828566 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-42d75a04-0fc4-431e-8589-dc6aced1522f tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] Calling method '.version_select at 0x7fa94bc15790>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:11.939827 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-db266820-9616-4742-9ea4-c39075807d62 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 43055861-475e-4c4c-ac33-428a805ba10e] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:39:11.945104 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-42d75a04-0fc4-431e-8589-dc6aced1522f tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/5c1c185d-6937-42d4-9b10-4d3439cd8b65" status: 200 len: 351 microversion: 2.1 time: 0.125724 Jul 28 10:39:11.953560 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 497/1014] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:39:11 2022] GET /compute/v2.1/os-volumes/5c1c185d-6937-42d4-9b10-4d3439cd8b65 => generated 351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:39:12.080983 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-db266820-9616-4742-9ea4-c39075807d62 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 43055861-475e-4c4c-ac33-428a805ba10e] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:39:12.083652 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-db266820-9616-4742-9ea4-c39075807d62 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:12.084452 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-db266820-9616-4742-9ea4-c39075807d62 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:12.086010 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-db266820-9616-4742-9ea4-c39075807d62 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 43055861-475e-4c4c-ac33-428a805ba10e] instance's host None is down, deleting from database Jul 28 10:39:12.093349 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-db266820-9616-4742-9ea4-c39075807d62 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 43055861-475e-4c4c-ac33-428a805ba10e] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:39:12.223142 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-db266820-9616-4742-9ea4-c39075807d62 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 43055861-475e-4c4c-ac33-428a805ba10e] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:39:12.232442 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-db266820-9616-4742-9ea4-c39075807d62 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 43055861-475e-4c4c-ac33-428a805ba10e] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:39:12.692180 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-db266820-9616-4742-9ea4-c39075807d62 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] 10.222.0.46 "DELETE /compute/v2.1/servers/43055861-475e-4c4c-ac33-428a805ba10e" status: 204 len: 0 microversion: 2.1 time: 0.908764 Jul 28 10:39:12.694069 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 518/1015] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:39:11 2022] DELETE /compute/v2.1/servers/43055861-475e-4c4c-ac33-428a805ba10e => generated 0 bytes in 912 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:39:12.704517 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1681ff48-46f6-4c79-b367-996137897192 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:12.705748 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1681ff48-46f6-4c79-b367-996137897192 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 43055861-475e-4c4c-ac33-428a805ba10e] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:12.726630 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1681ff48-46f6-4c79-b367-996137897192 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:12.728483 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1681ff48-46f6-4c79-b367-996137897192 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:12.732012 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1681ff48-46f6-4c79-b367-996137897192 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:12.737840 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1681ff48-46f6-4c79-b367-996137897192 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:12.795282 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-1681ff48-46f6-4c79-b367-996137897192 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] HTTP exception thrown: Instance 43055861-475e-4c4c-ac33-428a805ba10e could not be found. Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1681ff48-46f6-4c79-b367-996137897192 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Request method failure captured: Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/43055861-475e-4c4c-ac33-428a805ba10e HTTP/1.1 Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mdBta6N1EeSE82HM5kBCjQvQEW8OzzrZFQFIoLn57YYC3Kv4cvfF-4BjKqWuIJG3RmH4uAOWN4gmguHgxFnqF1_1I8CEzzcw6mymL-iMXPJTKAvR4h88ZF55VN_AGKHak_qh1o32E3CucCS4JJFewqh9HB67b_RMIH-okxldKBDoiM Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 3965b1f18dbe42e3b1a8d3cc06e787ff Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ListServerFiltersTestJSON-417294713 Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3965b1f18dbe42e3b1a8d3cc06e787ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3965b1f18dbe42e3b1a8d3cc06e787ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3965b1f18dbe42e3b1a8d3cc06e787ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3965b1f18dbe42e3b1a8d3cc06e787ff", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ListServerFiltersTestJSON-417294713 Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 3965b1f18dbe42e3b1a8d3cc06e787ff Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-417294713 Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ListServerFiltersTestJSON-417294713-project Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: d5d64c7b72c14b919b05c2c645f6430b Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ListServerFiltersTestJSON-417294713-project Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 43055861-475e-4c4c-ac33-428a805ba10e could not be found. Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '43055861-475e-4c4c-ac33-428a805ba10e'} Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43055861-475e-4c4c-ac33-428a805ba10e could not be found. Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43055861-475e-4c4c-ac33-428a805ba10e could not be found. Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:39:12.799498 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:12.803840 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:39:12.803840 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:39:12.803840 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:39:12.803840 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:39:12.803840 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:39:12.803840 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43055861-475e-4c4c-ac33-428a805ba10e could not be found. Jul 28 10:39:12.803840 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:12.806647 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1681ff48-46f6-4c79-b367-996137897192 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Returning 404 to user: Instance 43055861-475e-4c4c-ac33-428a805ba10e could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:39:12.808002 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-1681ff48-46f6-4c79-b367-996137897192 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] 10.222.0.46 "GET /compute/v2.1/servers/43055861-475e-4c4c-ac33-428a805ba10e" status: 404 len: 111 microversion: 2.1 time: 0.109605 Jul 28 10:39:12.808739 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 498/1016] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:39:12 2022] GET /compute/v2.1/servers/43055861-475e-4c4c-ac33-428a805ba10e => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:39:12.826032 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-28eab4b1-5d10-40ad-ae79-ce049c3f4768 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:12.826533 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-28eab4b1-5d10-40ad-ae79-ce049c3f4768 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: c82c945b-51d1-4f7b-aa9e-0a9f84263137] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:12.837712 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-28eab4b1-5d10-40ad-ae79-ce049c3f4768 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:12.838309 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-28eab4b1-5d10-40ad-ae79-ce049c3f4768 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:12.839269 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-28eab4b1-5d10-40ad-ae79-ce049c3f4768 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:12.845621 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-28eab4b1-5d10-40ad-ae79-ce049c3f4768 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:12.927052 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-28eab4b1-5d10-40ad-ae79-ce049c3f4768 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: c82c945b-51d1-4f7b-aa9e-0a9f84263137] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:39:12.964133 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=62,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:13.046543 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-28eab4b1-5d10-40ad-ae79-ce049c3f4768 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: c82c945b-51d1-4f7b-aa9e-0a9f84263137] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:39:13.053329 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-28eab4b1-5d10-40ad-ae79-ce049c3f4768 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:13.054114 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-28eab4b1-5d10-40ad-ae79-ce049c3f4768 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:13.054576 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-28eab4b1-5d10-40ad-ae79-ce049c3f4768 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: c82c945b-51d1-4f7b-aa9e-0a9f84263137] instance's host None is down, deleting from database Jul 28 10:39:13.058429 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-28eab4b1-5d10-40ad-ae79-ce049c3f4768 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: c82c945b-51d1-4f7b-aa9e-0a9f84263137] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:39:13.191728 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-28eab4b1-5d10-40ad-ae79-ce049c3f4768 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: c82c945b-51d1-4f7b-aa9e-0a9f84263137] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:39:13.200887 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-28eab4b1-5d10-40ad-ae79-ce049c3f4768 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: c82c945b-51d1-4f7b-aa9e-0a9f84263137] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:39:13.569154 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-28eab4b1-5d10-40ad-ae79-ce049c3f4768 tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c82c945b-51d1-4f7b-aa9e-0a9f84263137" status: 204 len: 0 microversion: 2.1 time: 0.748222 Jul 28 10:39:13.569154 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 519/1017] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:39:12 2022] DELETE /compute/v2.1/servers/c82c945b-51d1-4f7b-aa9e-0a9f84263137 => generated 0 bytes in 750 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:39:13.579394 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-caa6c215-4185-4151-977a-cc66a04b3edd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:13.580324 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-caa6c215-4185-4151-977a-cc66a04b3edd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: c82c945b-51d1-4f7b-aa9e-0a9f84263137] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:13.597520 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-caa6c215-4185-4151-977a-cc66a04b3edd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:13.599200 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-caa6c215-4185-4151-977a-cc66a04b3edd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:13.602087 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-caa6c215-4185-4151-977a-cc66a04b3edd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:13.604430 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-caa6c215-4185-4151-977a-cc66a04b3edd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:13.646870 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-caa6c215-4185-4151-977a-cc66a04b3edd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] HTTP exception thrown: Instance c82c945b-51d1-4f7b-aa9e-0a9f84263137 could not be found. Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-caa6c215-4185-4151-977a-cc66a04b3edd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Request method failure captured: Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/c82c945b-51d1-4f7b-aa9e-0a9f84263137 HTTP/1.1 Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mdBta6N1EeSE82HM5kBCjQvQEW8OzzrZFQFIoLn57YYC3Kv4cvfF-4BjKqWuIJG3RmH4uAOWN4gmguHgxFnqF1_1I8CEzzcw6mymL-iMXPJTKAvR4h88ZF55VN_AGKHak_qh1o32E3CucCS4JJFewqh9HB67b_RMIH-okxldKBDoiM Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 3965b1f18dbe42e3b1a8d3cc06e787ff Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ListServerFiltersTestJSON-417294713 Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3965b1f18dbe42e3b1a8d3cc06e787ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3965b1f18dbe42e3b1a8d3cc06e787ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3965b1f18dbe42e3b1a8d3cc06e787ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3965b1f18dbe42e3b1a8d3cc06e787ff", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ListServerFiltersTestJSON-417294713 Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 3965b1f18dbe42e3b1a8d3cc06e787ff Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-417294713 Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ListServerFiltersTestJSON-417294713-project Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: d5d64c7b72c14b919b05c2c645f6430b Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ListServerFiltersTestJSON-417294713-project Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance c82c945b-51d1-4f7b-aa9e-0a9f84263137 could not be found. Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'c82c945b-51d1-4f7b-aa9e-0a9f84263137'} Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c82c945b-51d1-4f7b-aa9e-0a9f84263137 could not be found. Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c82c945b-51d1-4f7b-aa9e-0a9f84263137 could not be found. Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:39:13.651534 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:13.656485 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:39:13.656485 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:39:13.656485 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:39:13.656485 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:39:13.656485 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:39:13.656485 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c82c945b-51d1-4f7b-aa9e-0a9f84263137 could not be found. Jul 28 10:39:13.656485 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:13.659560 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-caa6c215-4185-4151-977a-cc66a04b3edd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Returning 404 to user: Instance c82c945b-51d1-4f7b-aa9e-0a9f84263137 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:39:13.661712 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-caa6c215-4185-4151-977a-cc66a04b3edd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] 10.222.0.46 "GET /compute/v2.1/servers/c82c945b-51d1-4f7b-aa9e-0a9f84263137" status: 404 len: 111 microversion: 2.1 time: 0.088703 Jul 28 10:39:13.666181 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 499/1018] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:39:13 2022] GET /compute/v2.1/servers/c82c945b-51d1-4f7b-aa9e-0a9f84263137 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:39:13.674947 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a800dc4f-27cf-41f9-a597-944834a48fbd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:13.675449 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a800dc4f-27cf-41f9-a597-944834a48fbd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 9485fc67-a713-40e2-b668-4ab159afd840] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:13.688526 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a800dc4f-27cf-41f9-a597-944834a48fbd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:13.688981 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a800dc4f-27cf-41f9-a597-944834a48fbd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:13.694650 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a800dc4f-27cf-41f9-a597-944834a48fbd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:13.696728 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a800dc4f-27cf-41f9-a597-944834a48fbd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:13.804034 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a800dc4f-27cf-41f9-a597-944834a48fbd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 9485fc67-a713-40e2-b668-4ab159afd840] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:39:13.996946 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a800dc4f-27cf-41f9-a597-944834a48fbd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 9485fc67-a713-40e2-b668-4ab159afd840] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:39:14.000228 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a800dc4f-27cf-41f9-a597-944834a48fbd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:14.001617 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a800dc4f-27cf-41f9-a597-944834a48fbd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:14.002580 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-a800dc4f-27cf-41f9-a597-944834a48fbd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 9485fc67-a713-40e2-b668-4ab159afd840] instance's host None is down, deleting from database Jul 28 10:39:14.013308 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-a800dc4f-27cf-41f9-a597-944834a48fbd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 9485fc67-a713-40e2-b668-4ab159afd840] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:39:14.510660 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-a800dc4f-27cf-41f9-a597-944834a48fbd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 9485fc67-a713-40e2-b668-4ab159afd840] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:39:14.518367 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-a800dc4f-27cf-41f9-a597-944834a48fbd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 9485fc67-a713-40e2-b668-4ab159afd840] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:39:14.714865 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=8,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:14.893707 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a800dc4f-27cf-41f9-a597-944834a48fbd tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9485fc67-a713-40e2-b668-4ab159afd840" status: 204 len: 0 microversion: 2.1 time: 1.223510 Jul 28 10:39:14.894561 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 520/1019] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:39:13 2022] DELETE /compute/v2.1/servers/9485fc67-a713-40e2-b668-4ab159afd840 => generated 0 bytes in 1225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:39:14.903144 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8ad3b881-32b5-443b-b722-87899e860e8e tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:14.904034 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-8ad3b881-32b5-443b-b722-87899e860e8e tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] [instance: 9485fc67-a713-40e2-b668-4ab159afd840] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:14.920192 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8ad3b881-32b5-443b-b722-87899e860e8e tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:14.920661 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8ad3b881-32b5-443b-b722-87899e860e8e tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:14.922540 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8ad3b881-32b5-443b-b722-87899e860e8e tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:14.922985 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8ad3b881-32b5-443b-b722-87899e860e8e tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:14.979645 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-3ca12742-0f09-421e-8b29-12f269d44a90 tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] Calling method '.version_select at 0x7fa94b937820>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:14.992440 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-8ad3b881-32b5-443b-b722-87899e860e8e tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] HTTP exception thrown: Instance 9485fc67-a713-40e2-b668-4ab159afd840 could not be found. Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8ad3b881-32b5-443b-b722-87899e860e8e tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Request method failure captured: Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/9485fc67-a713-40e2-b668-4ab159afd840 HTTP/1.1 Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mdBta6N1EeSE82HM5kBCjQvQEW8OzzrZFQFIoLn57YYC3Kv4cvfF-4BjKqWuIJG3RmH4uAOWN4gmguHgxFnqF1_1I8CEzzcw6mymL-iMXPJTKAvR4h88ZF55VN_AGKHak_qh1o32E3CucCS4JJFewqh9HB67b_RMIH-okxldKBDoiM Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 3965b1f18dbe42e3b1a8d3cc06e787ff Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ListServerFiltersTestJSON-417294713 Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3965b1f18dbe42e3b1a8d3cc06e787ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3965b1f18dbe42e3b1a8d3cc06e787ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3965b1f18dbe42e3b1a8d3cc06e787ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3965b1f18dbe42e3b1a8d3cc06e787ff", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ListServerFiltersTestJSON-417294713 Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 3965b1f18dbe42e3b1a8d3cc06e787ff Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-417294713 Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ListServerFiltersTestJSON-417294713-project Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: d5d64c7b72c14b919b05c2c645f6430b Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ListServerFiltersTestJSON-417294713-project Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 9485fc67-a713-40e2-b668-4ab159afd840 could not be found. Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '9485fc67-a713-40e2-b668-4ab159afd840'} Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9485fc67-a713-40e2-b668-4ab159afd840 could not be found. Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9485fc67-a713-40e2-b668-4ab159afd840 could not be found. Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:39:14.994073 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:14.997656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:39:14.997656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:39:14.997656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:39:14.997656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:39:14.997656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:39:14.997656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9485fc67-a713-40e2-b668-4ab159afd840 could not be found. Jul 28 10:39:14.997656 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:14.997656 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8ad3b881-32b5-443b-b722-87899e860e8e tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] Returning 404 to user: Instance 9485fc67-a713-40e2-b668-4ab159afd840 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:39:14.997656 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-8ad3b881-32b5-443b-b722-87899e860e8e tempest-ListServerFiltersTestJSON-417294713 tempest-ListServerFiltersTestJSON-417294713-project] 10.222.0.46 "GET /compute/v2.1/servers/9485fc67-a713-40e2-b668-4ab159afd840" status: 404 len: 111 microversion: 2.1 time: 0.096921 Jul 28 10:39:15.002256 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 500/1020] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:39:14 2022] GET /compute/v2.1/servers/9485fc67-a713-40e2-b668-4ab159afd840 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:39:15.078656 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-3ca12742-0f09-421e-8b29-12f269d44a90 tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f454b0ee-c105-4200-ab3f-0037f1adcc18" status: 200 len: 351 microversion: 2.1 time: 0.103156 Jul 28 10:39:15.087202 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 521/1021] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:39:14 2022] GET /compute/v2.1/os-volumes/f454b0ee-c105-4200-ab3f-0037f1adcc18 => generated 351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:39:17.972380 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-99feafa7-a559-4631-a632-d8073421e8c8 tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] Calling method '.version_select at 0x7fa94bc73af0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:17.992078 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:18.103374 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-99feafa7-a559-4631-a632-d8073421e8c8 tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/aa8bafc1-8f42-46c0-94fb-e5373f9e3b9c" status: 200 len: 351 microversion: 2.1 time: 0.131454 Jul 28 10:39:18.109478 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 501/1022] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:39:17 2022] GET /compute/v2.1/os-volumes/aa8bafc1-8f42-46c0-94fb-e5373f9e3b9c => generated 351 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:39:18.132591 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8c5932a7-cef0-4a53-a8a1-3b9f0884fc2c tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] Calling method '.version_select at 0x7fa94b8e7f70>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:18.492596 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-8c5932a7-cef0-4a53-a8a1-3b9f0884fc2c tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.364079 Jul 28 10:39:18.493480 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 522/1023] 10.222.0.46 () {58 vars in 1134 bytes} [Thu Jul 28 10:39:18 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:18.504464 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=14 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:18.512640 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-db474ffe-2e25-48d4-b011-3b970ea1c02c tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] Calling method '.version_select at 0x7fa94bcf1c10>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:18.684998 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-db474ffe-2e25-48d4-b011-3b970ea1c02c tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.181118 Jul 28 10:39:18.685570 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 502/1024] 10.222.0.46 () {58 vars in 1149 bytes} [Thu Jul 28 10:39:18 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:39:18.701995 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-60edf181-b906-40b9-ad9e-469103d42efa tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] Calling method '.version_select at 0x7fa94b8e74c0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:18.870223 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:18.894730 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-60edf181-b906-40b9-ad9e-469103d42efa tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.196718 Jul 28 10:39:18.895593 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 523/1025] 10.222.0.46 () {58 vars in 1134 bytes} [Thu Jul 28 10:39:18 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:18.914221 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3a0eee42-116b-45ba-b1f1-1b4f30a1e304 tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] Calling method '.version_select at 0x7fa94bcf1e50>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:19.223050 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3a0eee42-116b-45ba-b1f1-1b4f30a1e304 tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.314304 Jul 28 10:39:19.237849 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 503/1026] 10.222.0.46 () {58 vars in 1167 bytes} [Thu Jul 28 10:39:18 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:39:19.242806 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-79b88d60-feed-4386-a880-d7badcfa9922 tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] Calling method '.version_select at 0x7fa94b937820>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:19.559316 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-79b88d60-feed-4386-a880-d7badcfa9922 tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.320809 Jul 28 10:39:19.560776 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 524/1027] 10.222.0.46 () {58 vars in 1170 bytes} [Thu Jul 28 10:39:19 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:39:19.584461 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c331a826-4c58-4b3a-9b88-84686e02ade0 tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] Calling method '.version_select at 0x7fa94bc73dc0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:19.813650 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c331a826-4c58-4b3a-9b88-84686e02ade0 tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.240649 Jul 28 10:39:19.827987 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=17 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:19.832320 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 504/1028] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Jul 28 10:39:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:19.834888 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c5d640c6-292c-4412-ac61-7d5beb4bf7d3 tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] Calling method '.version_select at 0x7fa94b8b6b80>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:20.048786 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c5d640c6-292c-4412-ac61-7d5beb4bf7d3 tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.223272 Jul 28 10:39:20.065415 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 525/1029] 10.222.0.46 () {58 vars in 1188 bytes} [Thu Jul 28 10:39:19 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:39:20.071549 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-dba356fc-b94a-48f5-9c7d-ba70b9c27b20 tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] Calling method '.version_select at 0x7fa94bdf6040>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:20.253324 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-dba356fc-b94a-48f5-9c7d-ba70b9c27b20 tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.194361 Jul 28 10:39:20.266307 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 505/1030] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Jul 28 10:39:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:21.093072 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c5d640c6-292c-4412-ac61-7d5beb4bf7d3 tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:21.094854 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c5d640c6-292c-4412-ac61-7d5beb4bf7d3 tempest-VolumesTestJSON-332076824 tempest-VolumesTestJSON-332076824-project] 10.222.0.46 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002221 Jul 28 10:39:21.095607 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 526/1031] 10.222.0.46 () {56 vars in 886 bytes} [Thu Jul 28 10:39:21 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 28 10:39:48.062903 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=6 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:48.065152 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=26 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:48.606264 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-329020372", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "73775266-e740-4d58-80c3-5cad247ffca6"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:48.729171 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] validate_networks() for [('73775266-e740-4d58-80c3-5cad247ffca6', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:39:49.020784 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=4,nova_api:UPDATE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:49.022971 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=40,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:49.331267 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:39:49.332407 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:39:49.333322 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:39:49.333907 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:39:49.334648 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:39:49.367638 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:49.369119 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:49.370200 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:49.371655 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:49.400428 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Getting quotas for project c2e65742727a438083e4c2f1457181d7. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:39:49.413691 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Getting quotas for user 3adf065926f44c9090306f224787aeb5 and project c2e65742727a438083e4c2f1457181d7. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:39:49.442006 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:39:49.450262 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] [instance: 4928e314-cd7d-4921-9f6a-177db89ae3d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:39:49.530213 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-2af3d537-ee6a-4d69-8fc1-2e1314a6ad0f tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.469084 Jul 28 10:39:49.538239 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 506/1032] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Jul 28 10:39:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1478 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 10:39:49.543431 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-edf69010-8a9c-4275-9863-01a4e73c338d tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:49.544052 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-edf69010-8a9c-4275-9863-01a4e73c338d tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] [instance: 4928e314-cd7d-4921-9f6a-177db89ae3d0] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:49.632083 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-edf69010-8a9c-4275-9863-01a4e73c338d tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adf065926f44c9090306f224787aeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e65742727a438083e4c2f1457181d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:49.649482 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-edf69010-8a9c-4275-9863-01a4e73c338d tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3adf065926f44c9090306f224787aeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e65742727a438083e4c2f1457181d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:49.652486 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-edf69010-8a9c-4275-9863-01a4e73c338d tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3adf065926f44c9090306f224787aeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e65742727a438083e4c2f1457181d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:49.656467 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-edf69010-8a9c-4275-9863-01a4e73c338d tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] 10.222.0.46 "GET /compute/v2.1/servers/4928e314-cd7d-4921-9f6a-177db89ae3d0" status: 200 len: 1261 microversion: 2.26 time: 0.116819 Jul 28 10:39:49.674041 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 507/1033] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:39:49 2022] GET /compute/v2.1/servers/4928e314-cd7d-4921-9f6a-177db89ae3d0 => generated 1261 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:49.711987 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-2139130064", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d43e09c9-da4b-48da-8e04-8c49b14ff213"}], "security_groups": [{"name": "tempest-securitygroup--956659692"}], "key_name": "tempest-keypair-1850566441", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "e08d6d6f-be47-4de3-a316-a49aa294ba25", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:49.789498 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-2022388920", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "2679ca73-1b44-4a58-8920-c704d26127c9"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:49.932757 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] validate_networks() for [('2679ca73-1b44-4a58-8920-c704d26127c9', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:39:50.190901 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] validate_networks() for [('d43e09c9-da4b-48da-8e04-8c49b14ff213', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:39:51.308968 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Getting quotas for project 68c2fb476a154c3bb04127e64323fe4f. Resources: dict_keys(['metadata_items']) {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:39:51.328872 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Getting quotas for user fc14a1b00c2e4916a71a667aef6ec064 and project 68c2fb476a154c3bb04127e64323fe4f. Resources: dict_keys(['metadata_items']) {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:39:51.366830 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:39:51.377472 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:39:51.380942 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:39:51.381432 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:39:51.382018 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:39:51.413013 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:51.413462 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:51.414298 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:51.426256 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:51.471296 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Getting quotas for project 68c2fb476a154c3bb04127e64323fe4f. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:39:51.483203 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Getting quotas for user fc14a1b00c2e4916a71a667aef6ec064 and project 68c2fb476a154c3bb04127e64323fe4f. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:39:51.607708 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:39:51.610631 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] [instance: 918393f7-a52e-4877-95dc-c4bfc060ed92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e08d6d6f-be47-4de3-a316-a49aa294ba25',volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:39:51.863369 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-0c18519a-34f1-411f-9b21-130a52bebe1b tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.157048 Jul 28 10:39:51.868758 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 508/1034] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:39:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 2163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:39:51.874948 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-94debc68-1bba-438e-b1b7-d54da5f8f4ce tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:51.886615 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-94debc68-1bba-438e-b1b7-d54da5f8f4ce tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] [instance: 4928e314-cd7d-4921-9f6a-177db89ae3d0] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:51.910874 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-94debc68-1bba-438e-b1b7-d54da5f8f4ce tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:51.918569 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-94debc68-1bba-438e-b1b7-d54da5f8f4ce tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:51.919690 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-94debc68-1bba-438e-b1b7-d54da5f8f4ce tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:51.922419 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-94debc68-1bba-438e-b1b7-d54da5f8f4ce tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:51.974453 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-94debc68-1bba-438e-b1b7-d54da5f8f4ce tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:51.975155 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-94debc68-1bba-438e-b1b7-d54da5f8f4ce tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:51.975804 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-94debc68-1bba-438e-b1b7-d54da5f8f4ce tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lazy-loading 'fault' on Instance uuid 4928e314-cd7d-4921-9f6a-177db89ae3d0 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:39:52.476966 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-94debc68-1bba-438e-b1b7-d54da5f8f4ce tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adf065926f44c9090306f224787aeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e65742727a438083e4c2f1457181d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:52.506306 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-94debc68-1bba-438e-b1b7-d54da5f8f4ce tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3adf065926f44c9090306f224787aeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e65742727a438083e4c2f1457181d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:52.510151 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-94debc68-1bba-438e-b1b7-d54da5f8f4ce tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3adf065926f44c9090306f224787aeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e65742727a438083e4c2f1457181d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:52.522439 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-94debc68-1bba-438e-b1b7-d54da5f8f4ce tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] 10.222.0.46 "GET /compute/v2.1/servers/4928e314-cd7d-4921-9f6a-177db89ae3d0" status: 200 len: 1334 microversion: 2.26 time: 0.652273 Jul 28 10:39:52.549589 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 509/1035] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:39:51 2022] GET /compute/v2.1/servers/4928e314-cd7d-4921-9f6a-177db89ae3d0 => generated 1334 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:52.559888 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-9394f3ca-5e26-4b8a-a5c3-6799d7678b72 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:52.564659 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-9394f3ca-5e26-4b8a-a5c3-6799d7678b72 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] [instance: 918393f7-a52e-4877-95dc-c4bfc060ed92] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:52.572933 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9394f3ca-5e26-4b8a-a5c3-6799d7678b72 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:52.575292 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9394f3ca-5e26-4b8a-a5c3-6799d7678b72 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:52.579575 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9394f3ca-5e26-4b8a-a5c3-6799d7678b72 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:52.580987 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9394f3ca-5e26-4b8a-a5c3-6799d7678b72 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:52.666593 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9394f3ca-5e26-4b8a-a5c3-6799d7678b72 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:52.667074 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9394f3ca-5e26-4b8a-a5c3-6799d7678b72 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:52.667553 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-9394f3ca-5e26-4b8a-a5c3-6799d7678b72 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lazy-loading 'fault' on Instance uuid 918393f7-a52e-4877-95dc-c4bfc060ed92 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:39:52.697583 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:39:52.698135 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:39:52.698506 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:39:52.698920 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:39:52.699337 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:39:52.716395 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:52.716857 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:52.718375 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:52.718832 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:52.773639 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-9394f3ca-5e26-4b8a-a5c3-6799d7678b72 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc14a1b00c2e4916a71a667aef6ec064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c2fb476a154c3bb04127e64323fe4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:52.785748 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-9394f3ca-5e26-4b8a-a5c3-6799d7678b72 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] 10.222.0.46 "GET /compute/v2.1/servers/918393f7-a52e-4877-95dc-c4bfc060ed92" status: 200 len: 1241 microversion: 2.1 time: 0.234424 Jul 28 10:39:52.790425 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 510/1036] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:39:52 2022] GET /compute/v2.1/servers/918393f7-a52e-4877-95dc-c4bfc060ed92 => generated 1241 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:52.796191 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8648547d-5894-49ac-9897-624ccb1a8206 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:52.813634 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Getting quotas for project 97efe251e6184edcba2038bc2390f885. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:39:52.814296 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-8648547d-5894-49ac-9897-624ccb1a8206 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] [instance: 4928e314-cd7d-4921-9f6a-177db89ae3d0] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:52.829331 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Getting quotas for user 8183775fd9cf48b5a90d5ac1dc0dcfff and project 97efe251e6184edcba2038bc2390f885. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:39:52.840013 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8648547d-5894-49ac-9897-624ccb1a8206 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:52.840589 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8648547d-5894-49ac-9897-624ccb1a8206 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:52.847574 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8648547d-5894-49ac-9897-624ccb1a8206 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:52.848036 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8648547d-5894-49ac-9897-624ccb1a8206 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:52.853810 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:39:52.858620 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] [instance: 528a1c2d-9ea5-412b-9769-cd4eec909fc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:39:52.934419 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-8648547d-5894-49ac-9897-624ccb1a8206 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] [instance: 4928e314-cd7d-4921-9f6a-177db89ae3d0] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:39:52.964148 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0ebc9888-9260-431c-b6c1-122e1a3da72e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.949685 Jul 28 10:39:52.972749 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 527/1037] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:39:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:39:52.978680 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a66309e4-fb4a-4fdf-8b95-6e2f882f151d tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:52.980698 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a66309e4-fb4a-4fdf-8b95-6e2f882f151d tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] [instance: 528a1c2d-9ea5-412b-9769-cd4eec909fc6] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:53.076485 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-8648547d-5894-49ac-9897-624ccb1a8206 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] [instance: 4928e314-cd7d-4921-9f6a-177db89ae3d0] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:39:53.077514 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8648547d-5894-49ac-9897-624ccb1a8206 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:53.082593 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8648547d-5894-49ac-9897-624ccb1a8206 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:53.083080 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-8648547d-5894-49ac-9897-624ccb1a8206 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] [instance: 4928e314-cd7d-4921-9f6a-177db89ae3d0] instance's host None is down, deleting from database Jul 28 10:39:53.088490 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-8648547d-5894-49ac-9897-624ccb1a8206 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] [instance: 4928e314-cd7d-4921-9f6a-177db89ae3d0] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:39:53.236951 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-8648547d-5894-49ac-9897-624ccb1a8206 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] [instance: 4928e314-cd7d-4921-9f6a-177db89ae3d0] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:39:53.247510 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-8648547d-5894-49ac-9897-624ccb1a8206 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] [instance: 4928e314-cd7d-4921-9f6a-177db89ae3d0] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:39:53.433130 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-a66309e4-fb4a-4fdf-8b95-6e2f882f151d tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8183775fd9cf48b5a90d5ac1dc0dcfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97efe251e6184edcba2038bc2390f885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:53.447640 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a66309e4-fb4a-4fdf-8b95-6e2f882f151d tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] 10.222.0.46 "GET /compute/v2.1/servers/528a1c2d-9ea5-412b-9769-cd4eec909fc6" status: 200 len: 1216 microversion: 2.1 time: 0.473382 Jul 28 10:39:53.448173 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 528/1038] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:39:52 2022] GET /compute/v2.1/servers/528a1c2d-9ea5-412b-9769-cd4eec909fc6 => generated 1216 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:53.659956 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-8648547d-5894-49ac-9897-624ccb1a8206 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4928e314-cd7d-4921-9f6a-177db89ae3d0" status: 204 len: 0 microversion: 2.26 time: 0.868228 Jul 28 10:39:53.660609 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 511/1039] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:39:52 2022] DELETE /compute/v2.1/servers/4928e314-cd7d-4921-9f6a-177db89ae3d0 => generated 0 bytes in 869 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:39:53.675098 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a0561268-9c40-4fbf-b1db-3ee747bc9bb9 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:53.677156 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a0561268-9c40-4fbf-b1db-3ee747bc9bb9 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] [instance: 4928e314-cd7d-4921-9f6a-177db89ae3d0] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:53.702820 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a0561268-9c40-4fbf-b1db-3ee747bc9bb9 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:53.703797 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a0561268-9c40-4fbf-b1db-3ee747bc9bb9 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:53.703797 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a0561268-9c40-4fbf-b1db-3ee747bc9bb9 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:53.707771 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a0561268-9c40-4fbf-b1db-3ee747bc9bb9 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:53.745652 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-a0561268-9c40-4fbf-b1db-3ee747bc9bb9 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] HTTP exception thrown: Instance 4928e314-cd7d-4921-9f6a-177db89ae3d0 could not be found. Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a0561268-9c40-4fbf-b1db-3ee747bc9bb9 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Request method failure captured: Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/4928e314-cd7d-4921-9f6a-177db89ae3d0 HTTP/1.1 Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mdzGnUp_2U1sV3MEDyZwBH6bJPk9PZ38XnY9JX6MN4zPDHlERpNUs2LGqmsZ0Hn00dk-qoIzWn5kO_h2pyipg9HdN9ZXPFLMTeA48biXbcnpFDYGeEUeYavaWRxPafF4-Q7MY6DVRf3_v4pnFLLTblCEz3xZcZIXDM_q6iDKri10fk Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: X-Openstack-Nova-Api-Version: 2.26 Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: c2e65742727a438083e4c2f1457181d7 Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ServerTagsTestJSON-983351976 Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c2e65742727a438083e4c2f1457181d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c2e65742727a438083e4c2f1457181d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c2e65742727a438083e4c2f1457181d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c2e65742727a438083e4c2f1457181d7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ServerTagsTestJSON-983351976 Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: c2e65742727a438083e4c2f1457181d7 Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ServerTagsTestJSON-983351976 Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ServerTagsTestJSON-983351976-project Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 3adf065926f44c9090306f224787aeb5 Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ServerTagsTestJSON-983351976-project Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 4928e314-cd7d-4921-9f6a-177db89ae3d0 could not be found. Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '4928e314-cd7d-4921-9f6a-177db89ae3d0'} Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4928e314-cd7d-4921-9f6a-177db89ae3d0 could not be found. Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4928e314-cd7d-4921-9f6a-177db89ae3d0 could not be found. Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:39:53.747824 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:39:53.754131 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:39:53.754131 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:39:53.754131 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:39:53.754131 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:39:53.754131 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:39:53.754131 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4928e314-cd7d-4921-9f6a-177db89ae3d0 could not be found. Jul 28 10:39:53.754131 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:39:53.756277 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a0561268-9c40-4fbf-b1db-3ee747bc9bb9 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] Returning 404 to user: Instance 4928e314-cd7d-4921-9f6a-177db89ae3d0 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:39:53.757390 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a0561268-9c40-4fbf-b1db-3ee747bc9bb9 tempest-ServerTagsTestJSON-983351976 tempest-ServerTagsTestJSON-983351976-project] 10.222.0.46 "GET /compute/v2.1/servers/4928e314-cd7d-4921-9f6a-177db89ae3d0" status: 404 len: 111 microversion: 2.26 time: 0.092611 Jul 28 10:39:53.758490 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 529/1040] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:39:53 2022] GET /compute/v2.1/servers/4928e314-cd7d-4921-9f6a-177db89ae3d0 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:39:53.814427 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f4e7ab01-607f-4755-a585-bbb695899523 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:53.815056 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f4e7ab01-607f-4755-a585-bbb695899523 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] [instance: 918393f7-a52e-4877-95dc-c4bfc060ed92] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:53.830573 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f4e7ab01-607f-4755-a585-bbb695899523 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:53.831027 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f4e7ab01-607f-4755-a585-bbb695899523 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:53.831836 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f4e7ab01-607f-4755-a585-bbb695899523 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:53.832277 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f4e7ab01-607f-4755-a585-bbb695899523 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:53.933163 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f4e7ab01-607f-4755-a585-bbb695899523 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:53.933618 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f4e7ab01-607f-4755-a585-bbb695899523 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:53.938216 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-f4e7ab01-607f-4755-a585-bbb695899523 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lazy-loading 'fault' on Instance uuid 918393f7-a52e-4877-95dc-c4bfc060ed92 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:39:54.333761 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-f4e7ab01-607f-4755-a585-bbb695899523 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc14a1b00c2e4916a71a667aef6ec064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c2fb476a154c3bb04127e64323fe4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:54.361619 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f4e7ab01-607f-4755-a585-bbb695899523 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] 10.222.0.46 "GET /compute/v2.1/servers/918393f7-a52e-4877-95dc-c4bfc060ed92" status: 200 len: 1241 microversion: 2.1 time: 0.553240 Jul 28 10:39:54.363211 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 512/1041] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:39:53 2022] GET /compute/v2.1/servers/918393f7-a52e-4877-95dc-c4bfc060ed92 => generated 1241 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:54.383198 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4698069a-d7e7-43cf-bf2e-86e5c4dc8c75 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:54.384307 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-4698069a-d7e7-43cf-bf2e-86e5c4dc8c75 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] [instance: 918393f7-a52e-4877-95dc-c4bfc060ed92] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:54.402261 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4698069a-d7e7-43cf-bf2e-86e5c4dc8c75 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:54.406380 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4698069a-d7e7-43cf-bf2e-86e5c4dc8c75 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:54.411635 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4698069a-d7e7-43cf-bf2e-86e5c4dc8c75 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:54.414009 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4698069a-d7e7-43cf-bf2e-86e5c4dc8c75 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:54.524223 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-4698069a-d7e7-43cf-bf2e-86e5c4dc8c75 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] [instance: 918393f7-a52e-4877-95dc-c4bfc060ed92] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:39:54.617960 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7bd3326a-ca14-444f-aaed-47caa3da44a3 tempest-PortsAdminExtendedAttrsTestJSON-1736153733 tempest-PortsAdminExtendedAttrsTestJSON-1736153733-project-admin] Calling method '.version_select at 0x7fa94b9fee50>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:54.618837 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:39:54.618837 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:39:54.620051 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7bd3326a-ca14-444f-aaed-47caa3da44a3 tempest-PortsAdminExtendedAttrsTestJSON-1736153733 tempest-PortsAdminExtendedAttrsTestJSON-1736153733-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:54.620705 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7bd3326a-ca14-444f-aaed-47caa3da44a3 tempest-PortsAdminExtendedAttrsTestJSON-1736153733 tempest-PortsAdminExtendedAttrsTestJSON-1736153733-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:54.659573 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7bd3326a-ca14-444f-aaed-47caa3da44a3 tempest-PortsAdminExtendedAttrsTestJSON-1736153733 tempest-PortsAdminExtendedAttrsTestJSON-1736153733-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:54.660040 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7bd3326a-ca14-444f-aaed-47caa3da44a3 tempest-PortsAdminExtendedAttrsTestJSON-1736153733 tempest-PortsAdminExtendedAttrsTestJSON-1736153733-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:54.663047 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-4698069a-d7e7-43cf-bf2e-86e5c4dc8c75 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] [instance: 918393f7-a52e-4877-95dc-c4bfc060ed92] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:39:54.666973 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4698069a-d7e7-43cf-bf2e-86e5c4dc8c75 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:54.666973 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4698069a-d7e7-43cf-bf2e-86e5c4dc8c75 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:54.667446 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-4698069a-d7e7-43cf-bf2e-86e5c4dc8c75 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] [instance: 918393f7-a52e-4877-95dc-c4bfc060ed92] instance's host None is down, deleting from database Jul 28 10:39:54.676992 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-4698069a-d7e7-43cf-bf2e-86e5c4dc8c75 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] [instance: 918393f7-a52e-4877-95dc-c4bfc060ed92] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:39:54.699271 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7bd3326a-ca14-444f-aaed-47caa3da44a3 tempest-PortsAdminExtendedAttrsTestJSON-1736153733 tempest-PortsAdminExtendedAttrsTestJSON-1736153733-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:54.699742 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7bd3326a-ca14-444f-aaed-47caa3da44a3 tempest-PortsAdminExtendedAttrsTestJSON-1736153733 tempest-PortsAdminExtendedAttrsTestJSON-1736153733-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:54.714051 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7bd3326a-ca14-444f-aaed-47caa3da44a3 tempest-PortsAdminExtendedAttrsTestJSON-1736153733 tempest-PortsAdminExtendedAttrsTestJSON-1736153733-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.551161 Jul 28 10:39:54.715022 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 530/1042] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:39:54 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:39:54.723120 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-de6f2acf-fe84-4ea7-bac6-c654a094067e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:54.723757 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-de6f2acf-fe84-4ea7-bac6-c654a094067e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] [instance: 528a1c2d-9ea5-412b-9769-cd4eec909fc6] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:54.730529 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-de6f2acf-fe84-4ea7-bac6-c654a094067e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:54.730986 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-de6f2acf-fe84-4ea7-bac6-c654a094067e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:54.731776 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-de6f2acf-fe84-4ea7-bac6-c654a094067e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:54.732225 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-de6f2acf-fe84-4ea7-bac6-c654a094067e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:54.771549 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-de6f2acf-fe84-4ea7-bac6-c654a094067e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:54.772027 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-de6f2acf-fe84-4ea7-bac6-c654a094067e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:54.772526 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-de6f2acf-fe84-4ea7-bac6-c654a094067e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lazy-loading 'fault' on Instance uuid 528a1c2d-9ea5-412b-9769-cd4eec909fc6 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:39:54.773505 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-4698069a-d7e7-43cf-bf2e-86e5c4dc8c75 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] [instance: 918393f7-a52e-4877-95dc-c4bfc060ed92] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:39:54.779759 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-4698069a-d7e7-43cf-bf2e-86e5c4dc8c75 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] [instance: 918393f7-a52e-4877-95dc-c4bfc060ed92] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:39:54.939415 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-de6f2acf-fe84-4ea7-bac6-c654a094067e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8183775fd9cf48b5a90d5ac1dc0dcfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97efe251e6184edcba2038bc2390f885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:54.967320 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-de6f2acf-fe84-4ea7-bac6-c654a094067e tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] 10.222.0.46 "GET /compute/v2.1/servers/528a1c2d-9ea5-412b-9769-cd4eec909fc6" status: 200 len: 1289 microversion: 2.1 time: 0.250976 Jul 28 10:39:54.968451 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 531/1043] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:39:54 2022] GET /compute/v2.1/servers/528a1c2d-9ea5-412b-9769-cd4eec909fc6 => generated 1289 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:54.991767 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2dbfd4ab-711c-4dc5-92cf-d0e599d02e6f tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:54.992280 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-2dbfd4ab-711c-4dc5-92cf-d0e599d02e6f tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] [instance: 528a1c2d-9ea5-412b-9769-cd4eec909fc6] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:55.021896 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2dbfd4ab-711c-4dc5-92cf-d0e599d02e6f tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:55.022355 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2dbfd4ab-711c-4dc5-92cf-d0e599d02e6f tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:55.023153 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2dbfd4ab-711c-4dc5-92cf-d0e599d02e6f tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:55.023601 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2dbfd4ab-711c-4dc5-92cf-d0e599d02e6f tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:55.114342 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-2dbfd4ab-711c-4dc5-92cf-d0e599d02e6f tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] [instance: 528a1c2d-9ea5-412b-9769-cd4eec909fc6] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:39:55.287170 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-2dbfd4ab-711c-4dc5-92cf-d0e599d02e6f tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] [instance: 528a1c2d-9ea5-412b-9769-cd4eec909fc6] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:39:55.292886 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2dbfd4ab-711c-4dc5-92cf-d0e599d02e6f tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:55.293800 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2dbfd4ab-711c-4dc5-92cf-d0e599d02e6f tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:55.295019 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-2dbfd4ab-711c-4dc5-92cf-d0e599d02e6f tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] [instance: 528a1c2d-9ea5-412b-9769-cd4eec909fc6] instance's host None is down, deleting from database Jul 28 10:39:55.312104 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-2dbfd4ab-711c-4dc5-92cf-d0e599d02e6f tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] [instance: 528a1c2d-9ea5-412b-9769-cd4eec909fc6] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:39:55.337111 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=75,nova_cell0:UPDATE=19,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:39:55.489465 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-4698069a-d7e7-43cf-bf2e-86e5c4dc8c75 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] 10.222.0.46 "DELETE /compute/v2.1/servers/918393f7-a52e-4877-95dc-c4bfc060ed92" status: 204 len: 0 microversion: 2.1 time: 1.111233 Jul 28 10:39:55.490639 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 513/1044] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:39:54 2022] DELETE /compute/v2.1/servers/918393f7-a52e-4877-95dc-c4bfc060ed92 => generated 0 bytes in 1113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:39:55.500564 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-adc3bbb9-8c42-47cc-8c3c-48da04ffbc91 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:55.504597 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-adc3bbb9-8c42-47cc-8c3c-48da04ffbc91 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] [instance: 918393f7-a52e-4877-95dc-c4bfc060ed92] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:55.520420 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-adc3bbb9-8c42-47cc-8c3c-48da04ffbc91 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:55.527772 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-adc3bbb9-8c42-47cc-8c3c-48da04ffbc91 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:55.528780 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-adc3bbb9-8c42-47cc-8c3c-48da04ffbc91 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:55.529419 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-adc3bbb9-8c42-47cc-8c3c-48da04ffbc91 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:55.566477 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-2dbfd4ab-711c-4dc5-92cf-d0e599d02e6f tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] [instance: 528a1c2d-9ea5-412b-9769-cd4eec909fc6] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:39:55.570773 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-adc3bbb9-8c42-47cc-8c3c-48da04ffbc91 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] HTTP exception thrown: Instance 918393f7-a52e-4877-95dc-c4bfc060ed92 could not be found. Jul 28 10:39:55.585036 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-2dbfd4ab-711c-4dc5-92cf-d0e599d02e6f tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] [instance: 528a1c2d-9ea5-412b-9769-cd4eec909fc6] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-adc3bbb9-8c42-47cc-8c3c-48da04ffbc91 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Request method failure captured: Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/918393f7-a52e-4877-95dc-c4bfc060ed92 HTTP/1.1 Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mdFoym_tkSHcusqiI1dM2MzbSdVRBHo60iwb1qD0PK9btGV3nTHS4FoArSJwLNBV5sCIVBY5i6rdH0S403v-BOcbC2bNDROVallus1YDCk4hknohJ1XWK7Ncv0ewlcdqMQfhB50cu0HkHfa6oZ5-KBkrkVeQ_6r7KmMsFa7omS7c7Q Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 68c2fb476a154c3bb04127e64323fe4f Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServersTestBootFromVolume-603039276 Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/68c2fb476a154c3bb04127e64323fe4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/68c2fb476a154c3bb04127e64323fe4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/68c2fb476a154c3bb04127e64323fe4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_68c2fb476a154c3bb04127e64323fe4f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServersTestBootFromVolume-603039276 Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 68c2fb476a154c3bb04127e64323fe4f Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServersTestBootFromVolume-603039276 Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServersTestBootFromVolume-603039276-project Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: fc14a1b00c2e4916a71a667aef6ec064 Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServersTestBootFromVolume-603039276-project Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 918393f7-a52e-4877-95dc-c4bfc060ed92 could not be found. Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '918393f7-a52e-4877-95dc-c4bfc060ed92'} Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 918393f7-a52e-4877-95dc-c4bfc060ed92 could not be found. Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 918393f7-a52e-4877-95dc-c4bfc060ed92 could not be found. Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:39:55.597155 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:55.600990 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:39:55.600990 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:39:55.600990 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:39:55.600990 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:39:55.600990 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:39:55.600990 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 918393f7-a52e-4877-95dc-c4bfc060ed92 could not be found. Jul 28 10:39:55.600990 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:55.602762 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-adc3bbb9-8c42-47cc-8c3c-48da04ffbc91 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Returning 404 to user: Instance 918393f7-a52e-4877-95dc-c4bfc060ed92 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:39:55.606233 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-adc3bbb9-8c42-47cc-8c3c-48da04ffbc91 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] 10.222.0.46 "GET /compute/v2.1/servers/918393f7-a52e-4877-95dc-c4bfc060ed92" status: 404 len: 111 microversion: 2.1 time: 0.110007 Jul 28 10:39:55.606948 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 514/1045] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:39:55 2022] GET /compute/v2.1/servers/918393f7-a52e-4877-95dc-c4bfc060ed92 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:39:55.617047 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3762fcd2-a64b-408d-84f1-1dcf332a95c5 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] Calling method '.version_select at 0x7fa94bda03a0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:55.693409 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3762fcd2-a64b-408d-84f1-1dcf332a95c5 tempest-ServersTestBootFromVolume-603039276 tempest-ServersTestBootFromVolume-603039276-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1850566441" status: 202 len: 0 microversion: 2.1 time: 0.080606 Jul 28 10:39:55.694595 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 515/1046] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Jul 28 10:39:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1850566441 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:39:56.050191 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-2dbfd4ab-711c-4dc5-92cf-d0e599d02e6f tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] 10.222.0.46 "DELETE /compute/v2.1/servers/528a1c2d-9ea5-412b-9769-cd4eec909fc6" status: 204 len: 0 microversion: 2.1 time: 1.064031 Jul 28 10:39:56.051226 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 532/1047] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:39:54 2022] DELETE /compute/v2.1/servers/528a1c2d-9ea5-412b-9769-cd4eec909fc6 => generated 0 bytes in 1067 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:39:56.064805 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-62d674bb-7c61-4338-ac9a-2259ec8e6e90 tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:56.065676 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-62d674bb-7c61-4338-ac9a-2259ec8e6e90 tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] [instance: 528a1c2d-9ea5-412b-9769-cd4eec909fc6] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:39:56.081147 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-62d674bb-7c61-4338-ac9a-2259ec8e6e90 tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:56.086959 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-62d674bb-7c61-4338-ac9a-2259ec8e6e90 tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:56.088428 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-62d674bb-7c61-4338-ac9a-2259ec8e6e90 tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:39:56.089069 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-62d674bb-7c61-4338-ac9a-2259ec8e6e90 tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:39:56.131586 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-62d674bb-7c61-4338-ac9a-2259ec8e6e90 tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] HTTP exception thrown: Instance 528a1c2d-9ea5-412b-9769-cd4eec909fc6 could not be found. Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-62d674bb-7c61-4338-ac9a-2259ec8e6e90 tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Request method failure captured: Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/528a1c2d-9ea5-412b-9769-cd4eec909fc6 HTTP/1.1 Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4md0ZFLTiWYujnZfYBmeMePkq5bz0E-_a5AW5YQB1HEC1BPNkOiWyA26mc9ZSXceyKJqbD3y2dloX5f3oye2XU7PyVcd2PLHjXTCgFTVt5Zek_OdJEhHTQ17d_mY1m-PQ2jDFFUVm1pQ-XyovW08c6qmPfmFIGU4g7uyXNTbS-WxiGY Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 97efe251e6184edcba2038bc2390f885 Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServerPasswordTestJSON-942178423 Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/97efe251e6184edcba2038bc2390f885"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/97efe251e6184edcba2038bc2390f885"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/97efe251e6184edcba2038bc2390f885"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_97efe251e6184edcba2038bc2390f885", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServerPasswordTestJSON-942178423 Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 97efe251e6184edcba2038bc2390f885 Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServerPasswordTestJSON-942178423 Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServerPasswordTestJSON-942178423-project Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 8183775fd9cf48b5a90d5ac1dc0dcfff Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServerPasswordTestJSON-942178423-project Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 528a1c2d-9ea5-412b-9769-cd4eec909fc6 could not be found. Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '528a1c2d-9ea5-412b-9769-cd4eec909fc6'} Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 528a1c2d-9ea5-412b-9769-cd4eec909fc6 could not be found. Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 528a1c2d-9ea5-412b-9769-cd4eec909fc6 could not be found. Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:39:56.135660 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:56.139965 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:39:56.139965 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:39:56.139965 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:39:56.139965 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:39:56.139965 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:39:56.139965 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 528a1c2d-9ea5-412b-9769-cd4eec909fc6 could not be found. Jul 28 10:39:56.139965 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:39:56.145401 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-62d674bb-7c61-4338-ac9a-2259ec8e6e90 tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] Returning 404 to user: Instance 528a1c2d-9ea5-412b-9769-cd4eec909fc6 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:39:56.146753 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-62d674bb-7c61-4338-ac9a-2259ec8e6e90 tempest-ServerPasswordTestJSON-942178423 tempest-ServerPasswordTestJSON-942178423-project] 10.222.0.46 "GET /compute/v2.1/servers/528a1c2d-9ea5-412b-9769-cd4eec909fc6" status: 404 len: 111 microversion: 2.1 time: 0.091224 Jul 28 10:39:56.158035 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 516/1048] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:39:56 2022] GET /compute/v2.1/servers/528a1c2d-9ea5-412b-9769-cd4eec909fc6 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:40:07.999005 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=8 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:07.999893 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=8 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:08.000562 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:08.001374 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=36,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:08.781609 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6fa3f72e-f8a5-4ab7-9365-426e9d462596 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Action: 'create', calling method: .version_select at 0x7fa94b9fe9d0>, body: {"keypair": {"name": "tempest-keypair-1658990391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8ANBlN2sDjSTnazzrJB/IV2+QYqiQDr3i4fXs2fCJrpi42d7PiKMqvrhrBnPcWOp/Cc0+IG8Z5VlHPkYxjZAjuvPXy/gY5uFavBYaszu+Aao2/jklgTXmbQ13d7HnE8g=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:40:08.817416 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-6fa3f72e-f8a5-4ab7-9365-426e9d462596 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Getting quotas for project ec19e33656204aba8f69bb49d4c16d4a. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:40:08.827703 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-6fa3f72e-f8a5-4ab7-9365-426e9d462596 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Getting quotas for user 2c6c51373c8946fcb1b9215635314bfd and project ec19e33656204aba8f69bb49d4c16d4a. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:40:08.886444 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-6fa3f72e-f8a5-4ab7-9365-426e9d462596 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.892189 Jul 28 10:40:08.887755 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 533/1049] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:40:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:40:14.829054 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:14.830183 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=18 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:14.831234 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:14.831929 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=5,nova_cell0:UPDATE=11,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:14.838736 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2069225195", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "372a43c0-b145-47bb-b735-e65fe29e096f"}], "security_groups": [{"name": "tempest-securitygroup--1758306955"}], "key_name": "tempest-keypair-1658990391", "user_data": "}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:40:15.292569 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] validate_networks() for [('372a43c0-b145-47bb-b735-e65fe29e096f', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:40:16.334057 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-080670d9-31ab-4761-9ecb-be2c08ee00b4 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-735375147", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": "none"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:40:16.434104 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-080670d9-31ab-4761-9ecb-be2c08ee00b4 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:40:16.434826 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-080670d9-31ab-4761-9ecb-be2c08ee00b4 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:40:16.435438 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-080670d9-31ab-4761-9ecb-be2c08ee00b4 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:40:16.436862 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-080670d9-31ab-4761-9ecb-be2c08ee00b4 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:40:16.437572 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-080670d9-31ab-4761-9ecb-be2c08ee00b4 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:40:16.466304 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-080670d9-31ab-4761-9ecb-be2c08ee00b4 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:16.468185 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-080670d9-31ab-4761-9ecb-be2c08ee00b4 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:16.470318 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-080670d9-31ab-4761-9ecb-be2c08ee00b4 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:16.471019 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-080670d9-31ab-4761-9ecb-be2c08ee00b4 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:16.512997 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-080670d9-31ab-4761-9ecb-be2c08ee00b4 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Getting quotas for project 44d45b70b77c4f0f87f36c85fa956300. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:40:16.533758 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-080670d9-31ab-4761-9ecb-be2c08ee00b4 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Getting quotas for user 4bb76dec6f214fa98282fe4cd8738618 and project 44d45b70b77c4f0f87f36c85fa956300. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:40:16.552037 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-080670d9-31ab-4761-9ecb-be2c08ee00b4 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:40:16.555764 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-080670d9-31ab-4761-9ecb-be2c08ee00b4 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] [instance: 908d4ce8-6e3f-4acc-81d3-67ef243287b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:40:16.664677 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-080670d9-31ab-4761-9ecb-be2c08ee00b4 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.897720 Jul 28 10:40:16.665735 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 534/1050] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Jul 28 10:40:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 28 10:40:16.678977 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7eb580c6-c1a6-4a4f-a985-78868ed07c8b tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:16.679610 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-7eb580c6-c1a6-4a4f-a985-78868ed07c8b tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] [instance: 908d4ce8-6e3f-4acc-81d3-67ef243287b3] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:16.711806 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:40:16.712343 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:40:16.712937 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:40:16.713462 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:40:16.715259 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:40:16.743416 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:16.747580 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:16.751541 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:16.752402 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:16.761492 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-7eb580c6-c1a6-4a4f-a985-78868ed07c8b tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb76dec6f214fa98282fe4cd8738618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d45b70b77c4f0f87f36c85fa956300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:16.775263 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-7eb580c6-c1a6-4a4f-a985-78868ed07c8b tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4bb76dec6f214fa98282fe4cd8738618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d45b70b77c4f0f87f36c85fa956300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:16.780323 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-7eb580c6-c1a6-4a4f-a985-78868ed07c8b tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4bb76dec6f214fa98282fe4cd8738618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d45b70b77c4f0f87f36c85fa956300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:16.782661 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7eb580c6-c1a6-4a4f-a985-78868ed07c8b tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] 10.222.0.46 "GET /compute/v2.1/servers/908d4ce8-6e3f-4acc-81d3-67ef243287b3" status: 200 len: 1277 microversion: 2.54 time: 0.108114 Jul 28 10:40:16.797904 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 535/1051] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:40:16 2022] GET /compute/v2.1/servers/908d4ce8-6e3f-4acc-81d3-67ef243287b3 => generated 1277 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:16.825660 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Getting quotas for project ec19e33656204aba8f69bb49d4c16d4a. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:40:16.845658 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Getting quotas for user 2c6c51373c8946fcb1b9215635314bfd and project ec19e33656204aba8f69bb49d4c16d4a. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:40:16.892572 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:40:16.896766 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: cb0c1f5b-6980-4921-b837-f2613a6185c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:40:17.017474 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c2b3ba5a-bcbd-4a31-9311-ba0df952c179 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.188177 Jul 28 10:40:17.018512 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 517/1052] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:40:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 2192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:40:17.030691 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0e79aac6-05dd-443c-8645-9191b40afbeb tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:17.035669 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-0e79aac6-05dd-443c-8645-9191b40afbeb tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: cb0c1f5b-6980-4921-b837-f2613a6185c4] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:17.144732 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4487db90-7ed4-42b5-8883-9a67475f8f58 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-807416092", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": "none"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:40:17.286979 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-0e79aac6-05dd-443c-8645-9191b40afbeb tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6c51373c8946fcb1b9215635314bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec19e33656204aba8f69bb49d4c16d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:17.301440 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-0e79aac6-05dd-443c-8645-9191b40afbeb tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0c1f5b-6980-4921-b837-f2613a6185c4" status: 200 len: 1242 microversion: 2.1 time: 0.274447 Jul 28 10:40:17.305267 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 518/1053] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:17 2022] GET /compute/v2.1/servers/cb0c1f5b-6980-4921-b837-f2613a6185c4 => generated 1242 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:17.650809 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-4487db90-7ed4-42b5-8883-9a67475f8f58 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:40:17.650809 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-4487db90-7ed4-42b5-8883-9a67475f8f58 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:40:17.651317 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-4487db90-7ed4-42b5-8883-9a67475f8f58 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:40:17.651938 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-4487db90-7ed4-42b5-8883-9a67475f8f58 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:40:17.652422 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-4487db90-7ed4-42b5-8883-9a67475f8f58 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:40:17.665415 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4487db90-7ed4-42b5-8883-9a67475f8f58 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:17.666371 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4487db90-7ed4-42b5-8883-9a67475f8f58 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:17.667495 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4487db90-7ed4-42b5-8883-9a67475f8f58 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:17.668154 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4487db90-7ed4-42b5-8883-9a67475f8f58 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:17.692223 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-4487db90-7ed4-42b5-8883-9a67475f8f58 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Getting quotas for project 528c459192e849e1ac08d567486e339c. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:40:17.698732 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-4487db90-7ed4-42b5-8883-9a67475f8f58 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Getting quotas for user 71ffba5d8a5544b68f5c120707ccc725 and project 528c459192e849e1ac08d567486e339c. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:40:17.715089 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-4487db90-7ed4-42b5-8883-9a67475f8f58 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:40:17.718998 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-4487db90-7ed4-42b5-8883-9a67475f8f58 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: c68019e4-968f-4447-9366-0ce8149f94f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:40:17.802638 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-4487db90-7ed4-42b5-8883-9a67475f8f58 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.010158 Jul 28 10:40:17.808998 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 536/1054] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Jul 28 10:40:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 10:40:17.812219 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3e96477e-19a4-4f4b-a72c-90987a29b5d5 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:17.813593 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3e96477e-19a4-4f4b-a72c-90987a29b5d5 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] [instance: 908d4ce8-6e3f-4acc-81d3-67ef243287b3] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:17.833164 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2f4756a1-e6db-4ea2-840d-2e2bd0a37456 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:17.834029 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3e96477e-19a4-4f4b-a72c-90987a29b5d5 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:17.835224 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3e96477e-19a4-4f4b-a72c-90987a29b5d5 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:17.837595 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-2f4756a1-e6db-4ea2-840d-2e2bd0a37456 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: c68019e4-968f-4447-9366-0ce8149f94f6] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:17.838725 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3e96477e-19a4-4f4b-a72c-90987a29b5d5 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:17.840647 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3e96477e-19a4-4f4b-a72c-90987a29b5d5 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:17.931106 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3e96477e-19a4-4f4b-a72c-90987a29b5d5 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:17.932653 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3e96477e-19a4-4f4b-a72c-90987a29b5d5 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:17.933848 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-3e96477e-19a4-4f4b-a72c-90987a29b5d5 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lazy-loading 'fault' on Instance uuid 908d4ce8-6e3f-4acc-81d3-67ef243287b3 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:40:17.965604 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-2f4756a1-e6db-4ea2-840d-2e2bd0a37456 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ffba5d8a5544b68f5c120707ccc725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528c459192e849e1ac08d567486e339c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:17.978404 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-2f4756a1-e6db-4ea2-840d-2e2bd0a37456 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71ffba5d8a5544b68f5c120707ccc725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528c459192e849e1ac08d567486e339c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:17.981254 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-2f4756a1-e6db-4ea2-840d-2e2bd0a37456 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71ffba5d8a5544b68f5c120707ccc725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528c459192e849e1ac08d567486e339c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:17.983463 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-2f4756a1-e6db-4ea2-840d-2e2bd0a37456 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] 10.222.0.46 "GET /compute/v2.1/servers/c68019e4-968f-4447-9366-0ce8149f94f6" status: 200 len: 1277 microversion: 2.47 time: 0.165239 Jul 28 10:40:18.002584 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 537/1055] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:40:17 2022] GET /compute/v2.1/servers/c68019e4-968f-4447-9366-0ce8149f94f6 => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:18.147806 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-3e96477e-19a4-4f4b-a72c-90987a29b5d5 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb76dec6f214fa98282fe4cd8738618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d45b70b77c4f0f87f36c85fa956300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:18.168074 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-3e96477e-19a4-4f4b-a72c-90987a29b5d5 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4bb76dec6f214fa98282fe4cd8738618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d45b70b77c4f0f87f36c85fa956300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:18.179081 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-3e96477e-19a4-4f4b-a72c-90987a29b5d5 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4bb76dec6f214fa98282fe4cd8738618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d45b70b77c4f0f87f36c85fa956300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:18.183985 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3e96477e-19a4-4f4b-a72c-90987a29b5d5 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] 10.222.0.46 "GET /compute/v2.1/servers/908d4ce8-6e3f-4acc-81d3-67ef243287b3" status: 200 len: 1350 microversion: 2.54 time: 0.376940 Jul 28 10:40:18.187371 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 519/1056] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:40:17 2022] GET /compute/v2.1/servers/908d4ce8-6e3f-4acc-81d3-67ef243287b3 => generated 1350 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:18.212533 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4065dfce-ebcc-4a89-8ce7-6c337874819b tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:18.212920 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-4065dfce-ebcc-4a89-8ce7-6c337874819b tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] [instance: 908d4ce8-6e3f-4acc-81d3-67ef243287b3] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:18.227369 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4065dfce-ebcc-4a89-8ce7-6c337874819b tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:18.229811 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4065dfce-ebcc-4a89-8ce7-6c337874819b tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:18.231173 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4065dfce-ebcc-4a89-8ce7-6c337874819b tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:18.233534 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4065dfce-ebcc-4a89-8ce7-6c337874819b tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:18.257638 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b0509574-bc83-4efc-83b5-8cbc0653c940 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1907928994", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": "none"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:40:18.341508 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-4065dfce-ebcc-4a89-8ce7-6c337874819b tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] [instance: 908d4ce8-6e3f-4acc-81d3-67ef243287b3] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:40:18.354765 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b0509574-bc83-4efc-83b5-8cbc0653c940 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:40:18.355208 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b0509574-bc83-4efc-83b5-8cbc0653c940 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:40:18.356565 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b0509574-bc83-4efc-83b5-8cbc0653c940 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:40:18.357000 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b0509574-bc83-4efc-83b5-8cbc0653c940 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:40:18.359804 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b0509574-bc83-4efc-83b5-8cbc0653c940 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:40:18.376039 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b0509574-bc83-4efc-83b5-8cbc0653c940 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:18.376592 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b0509574-bc83-4efc-83b5-8cbc0653c940 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:18.377735 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b0509574-bc83-4efc-83b5-8cbc0653c940 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:18.378337 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b0509574-bc83-4efc-83b5-8cbc0653c940 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:18.410507 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-b0509574-bc83-4efc-83b5-8cbc0653c940 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Getting quotas for project 528c459192e849e1ac08d567486e339c. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:40:18.419616 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-b0509574-bc83-4efc-83b5-8cbc0653c940 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Getting quotas for user 71ffba5d8a5544b68f5c120707ccc725 and project 528c459192e849e1ac08d567486e339c. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:40:18.447340 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b0509574-bc83-4efc-83b5-8cbc0653c940 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:40:18.455625 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b0509574-bc83-4efc-83b5-8cbc0653c940 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: 74d0ab03-7e65-4963-8406-01b17499d5be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:40:18.491125 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-4065dfce-ebcc-4a89-8ce7-6c337874819b tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] [instance: 908d4ce8-6e3f-4acc-81d3-67ef243287b3] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:40:18.492131 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4065dfce-ebcc-4a89-8ce7-6c337874819b tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:18.492876 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4065dfce-ebcc-4a89-8ce7-6c337874819b tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:18.493420 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-4065dfce-ebcc-4a89-8ce7-6c337874819b tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] [instance: 908d4ce8-6e3f-4acc-81d3-67ef243287b3] instance's host None is down, deleting from database Jul 28 10:40:18.500152 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-4065dfce-ebcc-4a89-8ce7-6c337874819b tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] [instance: 908d4ce8-6e3f-4acc-81d3-67ef243287b3] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:40:18.533903 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b0509574-bc83-4efc-83b5-8cbc0653c940 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.287683 Jul 28 10:40:18.534983 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 520/1057] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Jul 28 10:40:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 291 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 28 10:40:18.540876 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-53522169-2032-4272-843d-5fe372e1e219 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:18.541670 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-53522169-2032-4272-843d-5fe372e1e219 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: cb0c1f5b-6980-4921-b837-f2613a6185c4] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:18.549278 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-53522169-2032-4272-843d-5fe372e1e219 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:18.549966 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-53522169-2032-4272-843d-5fe372e1e219 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:18.551772 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-53522169-2032-4272-843d-5fe372e1e219 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:18.551895 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-53522169-2032-4272-843d-5fe372e1e219 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:18.598033 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-4065dfce-ebcc-4a89-8ce7-6c337874819b tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] [instance: 908d4ce8-6e3f-4acc-81d3-67ef243287b3] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:40:18.606412 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-53522169-2032-4272-843d-5fe372e1e219 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:18.610022 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-4065dfce-ebcc-4a89-8ce7-6c337874819b tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] [instance: 908d4ce8-6e3f-4acc-81d3-67ef243287b3] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:40:18.612783 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-53522169-2032-4272-843d-5fe372e1e219 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:18.617144 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-53522169-2032-4272-843d-5fe372e1e219 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lazy-loading 'fault' on Instance uuid cb0c1f5b-6980-4921-b837-f2613a6185c4 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:40:18.795016 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-53522169-2032-4272-843d-5fe372e1e219 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6c51373c8946fcb1b9215635314bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec19e33656204aba8f69bb49d4c16d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:18.824600 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-53522169-2032-4272-843d-5fe372e1e219 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0c1f5b-6980-4921-b837-f2613a6185c4" status: 200 len: 1315 microversion: 2.1 time: 0.288245 Jul 28 10:40:18.829819 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 521/1058] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:18 2022] GET /compute/v2.1/servers/cb0c1f5b-6980-4921-b837-f2613a6185c4 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:18.835635 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5c9d087e-2ed5-4196-b785-71a659a0543a tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:40:18.838903 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-5c9d087e-2ed5-4196-b785-71a659a0543a tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: 74d0ab03-7e65-4963-8406-01b17499d5be] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:18.878564 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5c9d087e-2ed5-4196-b785-71a659a0543a tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:18.880124 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5c9d087e-2ed5-4196-b785-71a659a0543a tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:18.882885 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5c9d087e-2ed5-4196-b785-71a659a0543a tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:18.883565 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5c9d087e-2ed5-4196-b785-71a659a0543a tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:18.957299 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-4065dfce-ebcc-4a89-8ce7-6c337874819b tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] 10.222.0.46 "DELETE /compute/v2.1/servers/908d4ce8-6e3f-4acc-81d3-67ef243287b3" status: 204 len: 0 microversion: 2.54 time: 0.748500 Jul 28 10:40:18.958848 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 538/1059] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:40:18 2022] DELETE /compute/v2.1/servers/908d4ce8-6e3f-4acc-81d3-67ef243287b3 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:40:18.964376 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-5c9d087e-2ed5-4196-b785-71a659a0543a tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] 10.222.0.46 "PUT /compute/v2.1/servers/74d0ab03-7e65-4963-8406-01b17499d5be" status: 200 len: 992 microversion: 2.47 time: 0.133316 Jul 28 10:40:18.972056 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-687b84ac-2c48-48c4-bea8-a3c2fa4e3b78 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:18.972811 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-687b84ac-2c48-48c4-bea8-a3c2fa4e3b78 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: cb0c1f5b-6980-4921-b837-f2613a6185c4] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:18.977844 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 522/1060] 10.222.0.46 () {62 vars in 1297 bytes} [Thu Jul 28 10:40:18 2022] PUT /compute/v2.1/servers/74d0ab03-7e65-4963-8406-01b17499d5be => generated 992 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:40:18.986313 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-585edbc5-480c-4ce2-baeb-497ae2f72070 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:18.987908 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-585edbc5-480c-4ce2-baeb-497ae2f72070 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] [instance: 908d4ce8-6e3f-4acc-81d3-67ef243287b3] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:18.990177 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-687b84ac-2c48-48c4-bea8-a3c2fa4e3b78 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:18.992327 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-687b84ac-2c48-48c4-bea8-a3c2fa4e3b78 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:18.993469 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-687b84ac-2c48-48c4-bea8-a3c2fa4e3b78 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:18.993953 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-687b84ac-2c48-48c4-bea8-a3c2fa4e3b78 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:18.995622 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-585edbc5-480c-4ce2-baeb-497ae2f72070 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:18.996344 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-585edbc5-480c-4ce2-baeb-497ae2f72070 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:18.997447 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-585edbc5-480c-4ce2-baeb-497ae2f72070 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:18.998254 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-585edbc5-480c-4ce2-baeb-497ae2f72070 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:19.019077 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-585edbc5-480c-4ce2-baeb-497ae2f72070 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] HTTP exception thrown: Instance 908d4ce8-6e3f-4acc-81d3-67ef243287b3 could not be found. Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-585edbc5-480c-4ce2-baeb-497ae2f72070 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Request method failure captured: Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/908d4ce8-6e3f-4acc-81d3-67ef243287b3 HTTP/1.1 Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mePJQM6wki1gIq3JpVE-Qi2jPdEOA-mCi-fe73R7kS6cc5ursz-baaCychAHy2Zji9Ktydnl0NtHwnX4HKkd_fF-kh8JrsKfXVlqdFPlmCOROyEL3hmQHKFrDxyoMngTcFAnB2IH9U2UvCnRLwS6uvY-eq5qI4H74t9E1NjAs9YFmE Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: X-Openstack-Nova-Api-Version: 2.54 Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 44d45b70b77c4f0f87f36c85fa956300 Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServerShowV254Test-1169122266 Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/44d45b70b77c4f0f87f36c85fa956300"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/44d45b70b77c4f0f87f36c85fa956300"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/44d45b70b77c4f0f87f36c85fa956300"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_44d45b70b77c4f0f87f36c85fa956300", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServerShowV254Test-1169122266 Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 44d45b70b77c4f0f87f36c85fa956300 Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServerShowV254Test-1169122266 Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServerShowV254Test-1169122266-project Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 4bb76dec6f214fa98282fe4cd8738618 Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServerShowV254Test-1169122266-project Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 908d4ce8-6e3f-4acc-81d3-67ef243287b3 could not be found. Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '908d4ce8-6e3f-4acc-81d3-67ef243287b3'} Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 908d4ce8-6e3f-4acc-81d3-67ef243287b3 could not be found. Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 908d4ce8-6e3f-4acc-81d3-67ef243287b3 could not be found. Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:19.021729 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:19.025634 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:19.025634 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:19.025634 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:19.025634 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:40:19.025634 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:40:19.025634 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 908d4ce8-6e3f-4acc-81d3-67ef243287b3 could not be found. Jul 28 10:40:19.025634 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:19.027573 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-585edbc5-480c-4ce2-baeb-497ae2f72070 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] Returning 404 to user: Instance 908d4ce8-6e3f-4acc-81d3-67ef243287b3 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:40:19.028715 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-585edbc5-480c-4ce2-baeb-497ae2f72070 tempest-ServerShowV254Test-1169122266 tempest-ServerShowV254Test-1169122266-project] 10.222.0.46 "GET /compute/v2.1/servers/908d4ce8-6e3f-4acc-81d3-67ef243287b3" status: 404 len: 111 microversion: 2.54 time: 0.049657 Jul 28 10:40:19.036217 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 523/1061] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:40:18 2022] GET /compute/v2.1/servers/908d4ce8-6e3f-4acc-81d3-67ef243287b3 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:40:19.042319 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-9902b1fe-a2d3-4351-8abf-498ea9029f73 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:19.043186 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-9902b1fe-a2d3-4351-8abf-498ea9029f73 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: 74d0ab03-7e65-4963-8406-01b17499d5be] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:19.050615 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9902b1fe-a2d3-4351-8abf-498ea9029f73 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:19.051455 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9902b1fe-a2d3-4351-8abf-498ea9029f73 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:19.052496 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9902b1fe-a2d3-4351-8abf-498ea9029f73 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:19.053148 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9902b1fe-a2d3-4351-8abf-498ea9029f73 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:19.073812 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-687b84ac-2c48-48c4-bea8-a3c2fa4e3b78 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: cb0c1f5b-6980-4921-b837-f2613a6185c4] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:40:19.096902 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9902b1fe-a2d3-4351-8abf-498ea9029f73 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:19.097621 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9902b1fe-a2d3-4351-8abf-498ea9029f73 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:19.098385 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-9902b1fe-a2d3-4351-8abf-498ea9029f73 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lazy-loading 'fault' on Instance uuid 74d0ab03-7e65-4963-8406-01b17499d5be {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:40:19.255500 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-687b84ac-2c48-48c4-bea8-a3c2fa4e3b78 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: cb0c1f5b-6980-4921-b837-f2613a6185c4] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:40:19.258568 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-687b84ac-2c48-48c4-bea8-a3c2fa4e3b78 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:19.270087 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-687b84ac-2c48-48c4-bea8-a3c2fa4e3b78 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:19.271950 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-687b84ac-2c48-48c4-bea8-a3c2fa4e3b78 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: cb0c1f5b-6980-4921-b837-f2613a6185c4] instance's host None is down, deleting from database Jul 28 10:40:19.278579 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-687b84ac-2c48-48c4-bea8-a3c2fa4e3b78 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: cb0c1f5b-6980-4921-b837-f2613a6185c4] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:40:19.380898 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-687b84ac-2c48-48c4-bea8-a3c2fa4e3b78 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: cb0c1f5b-6980-4921-b837-f2613a6185c4] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:40:19.388929 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-687b84ac-2c48-48c4-bea8-a3c2fa4e3b78 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: cb0c1f5b-6980-4921-b837-f2613a6185c4] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:40:19.587578 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-9902b1fe-a2d3-4351-8abf-498ea9029f73 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ffba5d8a5544b68f5c120707ccc725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528c459192e849e1ac08d567486e339c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:19.606579 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-9902b1fe-a2d3-4351-8abf-498ea9029f73 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71ffba5d8a5544b68f5c120707ccc725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528c459192e849e1ac08d567486e339c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:19.609851 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-9902b1fe-a2d3-4351-8abf-498ea9029f73 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71ffba5d8a5544b68f5c120707ccc725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528c459192e849e1ac08d567486e339c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:19.611692 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-9902b1fe-a2d3-4351-8abf-498ea9029f73 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] 10.222.0.46 "GET /compute/v2.1/servers/74d0ab03-7e65-4963-8406-01b17499d5be" status: 200 len: 1351 microversion: 2.47 time: 0.573648 Jul 28 10:40:19.631665 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 524/1062] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:40:19 2022] GET /compute/v2.1/servers/74d0ab03-7e65-4963-8406-01b17499d5be => generated 1351 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:19.722402 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-687b84ac-2c48-48c4-bea8-a3c2fa4e3b78 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cb0c1f5b-6980-4921-b837-f2613a6185c4" status: 204 len: 0 microversion: 2.1 time: 0.761805 Jul 28 10:40:19.726924 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 539/1063] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:40:18 2022] DELETE /compute/v2.1/servers/cb0c1f5b-6980-4921-b837-f2613a6185c4 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:40:19.736136 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-353a8f2d-2380-4b19-812e-c3f7f329bf7f tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:19.736768 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-353a8f2d-2380-4b19-812e-c3f7f329bf7f tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: cb0c1f5b-6980-4921-b837-f2613a6185c4] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:19.746818 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-353a8f2d-2380-4b19-812e-c3f7f329bf7f tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:19.747310 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-353a8f2d-2380-4b19-812e-c3f7f329bf7f tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:19.748082 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-353a8f2d-2380-4b19-812e-c3f7f329bf7f tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:19.748936 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-353a8f2d-2380-4b19-812e-c3f7f329bf7f tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:19.776038 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-353a8f2d-2380-4b19-812e-c3f7f329bf7f tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] HTTP exception thrown: Instance cb0c1f5b-6980-4921-b837-f2613a6185c4 could not be found. Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-353a8f2d-2380-4b19-812e-c3f7f329bf7f tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Request method failure captured: Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/cb0c1f5b-6980-4921-b837-f2613a6185c4 HTTP/1.1 Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4meHklHsp9GhWT9pRTBb3LPYR9AD6sbN_J9isrXjjy6UkUhlG9Q6U9jLW2dl9Wi5Btj6_dlph2Gu-n0KwRYbedXdXt2Mbtkz2ciBcJ9NVf3WdYRPO3G6rS-8AqFoUsYA27aMLnYe0djOO6nPjzR6cANdQLQcfHDT6-XWhCFSf0HNZ14 Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: ec19e33656204aba8f69bb49d4c16d4a Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-AttachVolumeNegativeTest-748584556 Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ec19e33656204aba8f69bb49d4c16d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec19e33656204aba8f69bb49d4c16d4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec19e33656204aba8f69bb49d4c16d4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ec19e33656204aba8f69bb49d4c16d4a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-AttachVolumeNegativeTest-748584556 Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: ec19e33656204aba8f69bb49d4c16d4a Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-748584556 Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-AttachVolumeNegativeTest-748584556-project Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 2c6c51373c8946fcb1b9215635314bfd Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-AttachVolumeNegativeTest-748584556-project Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance cb0c1f5b-6980-4921-b837-f2613a6185c4 could not be found. Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'cb0c1f5b-6980-4921-b837-f2613a6185c4'} Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb0c1f5b-6980-4921-b837-f2613a6185c4 could not be found. Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb0c1f5b-6980-4921-b837-f2613a6185c4 could not be found. Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:19.778120 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:19.783330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:19.783330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:19.783330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:19.783330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:40:19.783330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:40:19.783330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb0c1f5b-6980-4921-b837-f2613a6185c4 could not be found. Jul 28 10:40:19.783330 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:19.786241 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-353a8f2d-2380-4b19-812e-c3f7f329bf7f tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Returning 404 to user: Instance cb0c1f5b-6980-4921-b837-f2613a6185c4 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:40:19.787582 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-353a8f2d-2380-4b19-812e-c3f7f329bf7f tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0c1f5b-6980-4921-b837-f2613a6185c4" status: 404 len: 111 microversion: 2.1 time: 0.058244 Jul 28 10:40:19.788901 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 525/1064] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:19 2022] GET /compute/v2.1/servers/cb0c1f5b-6980-4921-b837-f2613a6185c4 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:40:19.800644 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-202fe80a-3ff2-4d29-b9e3-833c929986f2 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Calling method '.version_select at 0x7fa94b8e7af0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:19.830506 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-202fe80a-3ff2-4d29-b9e3-833c929986f2 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1658990391" status: 202 len: 0 microversion: 2.1 time: 0.035294 Jul 28 10:40:19.831876 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 540/1065] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Jul 28 10:40:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1658990391 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:40:20.642785 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e4c54e24-1ff7-4fb2-a357-ea91b49a709b tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:20.644309 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-e4c54e24-1ff7-4fb2-a357-ea91b49a709b tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: 74d0ab03-7e65-4963-8406-01b17499d5be] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:20.661372 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e4c54e24-1ff7-4fb2-a357-ea91b49a709b tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:20.663585 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e4c54e24-1ff7-4fb2-a357-ea91b49a709b tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:20.665905 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e4c54e24-1ff7-4fb2-a357-ea91b49a709b tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:20.667589 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e4c54e24-1ff7-4fb2-a357-ea91b49a709b tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:20.735353 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e4c54e24-1ff7-4fb2-a357-ea91b49a709b tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:20.736214 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e4c54e24-1ff7-4fb2-a357-ea91b49a709b tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:20.736933 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-e4c54e24-1ff7-4fb2-a357-ea91b49a709b tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lazy-loading 'fault' on Instance uuid 74d0ab03-7e65-4963-8406-01b17499d5be {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:40:20.789747 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-e4c54e24-1ff7-4fb2-a357-ea91b49a709b tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ffba5d8a5544b68f5c120707ccc725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528c459192e849e1ac08d567486e339c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:20.799102 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-e4c54e24-1ff7-4fb2-a357-ea91b49a709b tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71ffba5d8a5544b68f5c120707ccc725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528c459192e849e1ac08d567486e339c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:20.800612 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-e4c54e24-1ff7-4fb2-a357-ea91b49a709b tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71ffba5d8a5544b68f5c120707ccc725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528c459192e849e1ac08d567486e339c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:20.801793 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e4c54e24-1ff7-4fb2-a357-ea91b49a709b tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] 10.222.0.46 "GET /compute/v2.1/servers/74d0ab03-7e65-4963-8406-01b17499d5be" status: 200 len: 1351 microversion: 2.47 time: 0.165201 Jul 28 10:40:20.833042 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-97ca2a57-f379-416d-9d4a-93c53ac46b10 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:20.833638 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-97ca2a57-f379-416d-9d4a-93c53ac46b10 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: 74d0ab03-7e65-4963-8406-01b17499d5be] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:20.837305 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 526/1066] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:40:20 2022] GET /compute/v2.1/servers/74d0ab03-7e65-4963-8406-01b17499d5be => generated 1351 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:20.840957 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-97ca2a57-f379-416d-9d4a-93c53ac46b10 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:20.841607 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-97ca2a57-f379-416d-9d4a-93c53ac46b10 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:20.843200 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-97ca2a57-f379-416d-9d4a-93c53ac46b10 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:20.843908 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-97ca2a57-f379-416d-9d4a-93c53ac46b10 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:20.882192 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-97ca2a57-f379-416d-9d4a-93c53ac46b10 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: 74d0ab03-7e65-4963-8406-01b17499d5be] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:40:20.943881 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=62,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:20.963940 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-97ca2a57-f379-416d-9d4a-93c53ac46b10 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: 74d0ab03-7e65-4963-8406-01b17499d5be] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:40:20.965613 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-97ca2a57-f379-416d-9d4a-93c53ac46b10 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:20.966477 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-97ca2a57-f379-416d-9d4a-93c53ac46b10 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:20.967346 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-97ca2a57-f379-416d-9d4a-93c53ac46b10 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: 74d0ab03-7e65-4963-8406-01b17499d5be] instance's host None is down, deleting from database Jul 28 10:40:20.974411 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-97ca2a57-f379-416d-9d4a-93c53ac46b10 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: 74d0ab03-7e65-4963-8406-01b17499d5be] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:40:21.116265 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-97ca2a57-f379-416d-9d4a-93c53ac46b10 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: 74d0ab03-7e65-4963-8406-01b17499d5be] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:40:21.127826 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-97ca2a57-f379-416d-9d4a-93c53ac46b10 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: 74d0ab03-7e65-4963-8406-01b17499d5be] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:40:21.457736 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-97ca2a57-f379-416d-9d4a-93c53ac46b10 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] 10.222.0.46 "DELETE /compute/v2.1/servers/74d0ab03-7e65-4963-8406-01b17499d5be" status: 204 len: 0 microversion: 2.47 time: 0.627911 Jul 28 10:40:21.459037 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 541/1067] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:40:20 2022] DELETE /compute/v2.1/servers/74d0ab03-7e65-4963-8406-01b17499d5be => generated 0 bytes in 631 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 28 10:40:21.467947 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b44ed359-e3d1-4ded-8272-8b16b937289f tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:21.469261 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b44ed359-e3d1-4ded-8272-8b16b937289f tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: 74d0ab03-7e65-4963-8406-01b17499d5be] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:21.489588 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b44ed359-e3d1-4ded-8272-8b16b937289f tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:21.490287 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b44ed359-e3d1-4ded-8272-8b16b937289f tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:21.491309 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b44ed359-e3d1-4ded-8272-8b16b937289f tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:21.491900 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b44ed359-e3d1-4ded-8272-8b16b937289f tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:21.521621 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-b44ed359-e3d1-4ded-8272-8b16b937289f tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] HTTP exception thrown: Instance 74d0ab03-7e65-4963-8406-01b17499d5be could not be found. Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b44ed359-e3d1-4ded-8272-8b16b937289f tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Request method failure captured: Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/74d0ab03-7e65-4963-8406-01b17499d5be HTTP/1.1 Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4meQGxnmALNhlQiTnvthymKsMcWc5hmIfAqd22kcfPKyISRRMDClsIaFLPtp2AROnZQ8RS0bo645-LP849-k-101DStW0JAY31WsxRuslyldvtaNFBxTzi9W8GQmvTNhY29uL0ZxmoztDcS3_1uPio7_taEksBhi-ZGRh6UbhvuJXYI Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: X-Openstack-Nova-Api-Version: 2.47 Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 528c459192e849e1ac08d567486e339c Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServerShowV247Test-715883578 Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/528c459192e849e1ac08d567486e339c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/528c459192e849e1ac08d567486e339c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/528c459192e849e1ac08d567486e339c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_528c459192e849e1ac08d567486e339c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServerShowV247Test-715883578 Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 528c459192e849e1ac08d567486e339c Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServerShowV247Test-715883578 Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServerShowV247Test-715883578-project Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 71ffba5d8a5544b68f5c120707ccc725 Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServerShowV247Test-715883578-project Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 74d0ab03-7e65-4963-8406-01b17499d5be could not be found. Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '74d0ab03-7e65-4963-8406-01b17499d5be'} Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74d0ab03-7e65-4963-8406-01b17499d5be could not be found. Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74d0ab03-7e65-4963-8406-01b17499d5be could not be found. Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:21.529405 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:21.534602 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:21.534602 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:21.534602 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:21.534602 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:40:21.534602 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:40:21.534602 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74d0ab03-7e65-4963-8406-01b17499d5be could not be found. Jul 28 10:40:21.534602 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:21.534602 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b44ed359-e3d1-4ded-8272-8b16b937289f tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Returning 404 to user: Instance 74d0ab03-7e65-4963-8406-01b17499d5be could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:40:21.536767 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b44ed359-e3d1-4ded-8272-8b16b937289f tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] 10.222.0.46 "GET /compute/v2.1/servers/74d0ab03-7e65-4963-8406-01b17499d5be" status: 404 len: 111 microversion: 2.47 time: 0.072853 Jul 28 10:40:21.536767 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 527/1068] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:40:21 2022] GET /compute/v2.1/servers/74d0ab03-7e65-4963-8406-01b17499d5be => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:40:21.547789 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c0ef32de-4a7b-4218-b45c-d2d2549c09d8 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:21.548857 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c0ef32de-4a7b-4218-b45c-d2d2549c09d8 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: c68019e4-968f-4447-9366-0ce8149f94f6] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:21.569565 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c0ef32de-4a7b-4218-b45c-d2d2549c09d8 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:21.569565 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c0ef32de-4a7b-4218-b45c-d2d2549c09d8 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:21.571368 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c0ef32de-4a7b-4218-b45c-d2d2549c09d8 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:21.571753 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c0ef32de-4a7b-4218-b45c-d2d2549c09d8 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:21.621581 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c0ef32de-4a7b-4218-b45c-d2d2549c09d8 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: c68019e4-968f-4447-9366-0ce8149f94f6] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:40:21.708684 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c0ef32de-4a7b-4218-b45c-d2d2549c09d8 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: c68019e4-968f-4447-9366-0ce8149f94f6] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:40:21.710919 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c0ef32de-4a7b-4218-b45c-d2d2549c09d8 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:21.711620 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c0ef32de-4a7b-4218-b45c-d2d2549c09d8 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:21.712119 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-c0ef32de-4a7b-4218-b45c-d2d2549c09d8 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: c68019e4-968f-4447-9366-0ce8149f94f6] instance's host None is down, deleting from database Jul 28 10:40:21.716342 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-c0ef32de-4a7b-4218-b45c-d2d2549c09d8 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: c68019e4-968f-4447-9366-0ce8149f94f6] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:40:22.092692 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-c0ef32de-4a7b-4218-b45c-d2d2549c09d8 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: c68019e4-968f-4447-9366-0ce8149f94f6] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:40:22.098499 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-c0ef32de-4a7b-4218-b45c-d2d2549c09d8 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: c68019e4-968f-4447-9366-0ce8149f94f6] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:40:22.206018 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b8ac9254-c132-4c14-952a-8874976d0003 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Action: 'create', calling method: .version_select at 0x7fa94ba22af0>, body: {"keypair": {"name": "tempest-keypair-1529949842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOz2UTiUpdQAGpvCzwZZCAZehJaFwc353nVgPjVBvkEgxX/57HvfbGlsBsWB3tINyUONyuPo7qs187m3Sae+cBhWRUbAy9+UDyp6qbryLwDg2OtPcVYCsrKVo2PL3PMd1w=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:40:22.250605 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-b8ac9254-c132-4c14-952a-8874976d0003 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Getting quotas for project ec19e33656204aba8f69bb49d4c16d4a. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:40:22.264515 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-b8ac9254-c132-4c14-952a-8874976d0003 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Getting quotas for user 2c6c51373c8946fcb1b9215635314bfd and project ec19e33656204aba8f69bb49d4c16d4a. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:40:22.319281 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b8ac9254-c132-4c14-952a-8874976d0003 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.119109 Jul 28 10:40:22.320426 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 528/1069] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:40:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:40:22.396985 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c0ef32de-4a7b-4218-b45c-d2d2549c09d8 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c68019e4-968f-4447-9366-0ce8149f94f6" status: 204 len: 0 microversion: 2.47 time: 0.854990 Jul 28 10:40:22.402125 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 542/1070] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:40:21 2022] DELETE /compute/v2.1/servers/c68019e4-968f-4447-9366-0ce8149f94f6 => generated 0 bytes in 857 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:40:22.409193 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-88a8076a-f147-4f2f-90b2-a839638e59a9 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:22.409823 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-88a8076a-f147-4f2f-90b2-a839638e59a9 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] [instance: c68019e4-968f-4447-9366-0ce8149f94f6] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:22.420645 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-88a8076a-f147-4f2f-90b2-a839638e59a9 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:22.425417 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-88a8076a-f147-4f2f-90b2-a839638e59a9 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:22.430516 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-88a8076a-f147-4f2f-90b2-a839638e59a9 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:22.431265 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-88a8076a-f147-4f2f-90b2-a839638e59a9 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:22.453775 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-88a8076a-f147-4f2f-90b2-a839638e59a9 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] HTTP exception thrown: Instance c68019e4-968f-4447-9366-0ce8149f94f6 could not be found. Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-88a8076a-f147-4f2f-90b2-a839638e59a9 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Request method failure captured: Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/c68019e4-968f-4447-9366-0ce8149f94f6 HTTP/1.1 Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4meQGxnmALNhlQiTnvthymKsMcWc5hmIfAqd22kcfPKyISRRMDClsIaFLPtp2AROnZQ8RS0bo645-LP849-k-101DStW0JAY31WsxRuslyldvtaNFBxTzi9W8GQmvTNhY29uL0ZxmoztDcS3_1uPio7_taEksBhi-ZGRh6UbhvuJXYI Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: X-Openstack-Nova-Api-Version: 2.47 Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 528c459192e849e1ac08d567486e339c Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServerShowV247Test-715883578 Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/528c459192e849e1ac08d567486e339c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/528c459192e849e1ac08d567486e339c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/528c459192e849e1ac08d567486e339c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_528c459192e849e1ac08d567486e339c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServerShowV247Test-715883578 Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 528c459192e849e1ac08d567486e339c Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServerShowV247Test-715883578 Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServerShowV247Test-715883578-project Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 71ffba5d8a5544b68f5c120707ccc725 Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServerShowV247Test-715883578-project Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance c68019e4-968f-4447-9366-0ce8149f94f6 could not be found. Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'c68019e4-968f-4447-9366-0ce8149f94f6'} Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c68019e4-968f-4447-9366-0ce8149f94f6 could not be found. Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c68019e4-968f-4447-9366-0ce8149f94f6 could not be found. Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:22.461811 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:22.465652 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:22.465652 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:22.465652 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:22.465652 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:40:22.465652 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:40:22.465652 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c68019e4-968f-4447-9366-0ce8149f94f6 could not be found. Jul 28 10:40:22.465652 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:22.469348 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-88a8076a-f147-4f2f-90b2-a839638e59a9 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] Returning 404 to user: Instance c68019e4-968f-4447-9366-0ce8149f94f6 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:40:22.470264 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-88a8076a-f147-4f2f-90b2-a839638e59a9 tempest-ServerShowV247Test-715883578 tempest-ServerShowV247Test-715883578-project] 10.222.0.46 "GET /compute/v2.1/servers/c68019e4-968f-4447-9366-0ce8149f94f6" status: 404 len: 111 microversion: 2.47 time: 0.067006 Jul 28 10:40:22.471154 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 529/1071] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:40:22 2022] GET /compute/v2.1/servers/c68019e4-968f-4447-9366-0ce8149f94f6 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 10:40:25.276235 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1448874879", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "372a43c0-b145-47bb-b735-e65fe29e096f"}], "security_groups": [{"name": "tempest-securitygroup--801051692"}], "key_name": "tempest-keypair-1529949842", "user_data": "}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:40:25.533073 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] validate_networks() for [('372a43c0-b145-47bb-b735-e65fe29e096f', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:40:25.863413 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:26.182143 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:40:26.182805 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:40:26.183429 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:40:26.184021 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:40:26.184581 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:40:26.199201 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:26.199945 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:26.202664 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:26.203320 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:26.250725 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Getting quotas for project ec19e33656204aba8f69bb49d4c16d4a. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:40:26.263472 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Getting quotas for user 2c6c51373c8946fcb1b9215635314bfd and project ec19e33656204aba8f69bb49d4c16d4a. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:40:26.304965 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:40:26.312684 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 55a5bcb6-20ad-4920-ab33-5bac5759c7db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:40:26.474016 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a472c08f-d471-4837-afd0-e74dffabc7a8 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.201269 Jul 28 10:40:26.482006 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 543/1072] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:40:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 10:40:26.487066 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-9dbb70b6-7764-4f7f-9c03-a82c982aea7b tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:26.488514 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-9dbb70b6-7764-4f7f-9c03-a82c982aea7b tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 55a5bcb6-20ad-4920-ab33-5bac5759c7db] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:26.660217 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-9dbb70b6-7764-4f7f-9c03-a82c982aea7b tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6c51373c8946fcb1b9215635314bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec19e33656204aba8f69bb49d4c16d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:26.668345 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-9dbb70b6-7764-4f7f-9c03-a82c982aea7b tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] 10.222.0.46 "GET /compute/v2.1/servers/55a5bcb6-20ad-4920-ab33-5bac5759c7db" status: 200 len: 1242 microversion: 2.1 time: 0.186490 Jul 28 10:40:26.678522 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 530/1073] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:26 2022] GET /compute/v2.1/servers/55a5bcb6-20ad-4920-ab33-5bac5759c7db => generated 1242 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:40:27.697357 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b081c644-581a-4686-82d9-8b4a525e42fb tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:27.698831 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b081c644-581a-4686-82d9-8b4a525e42fb tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 55a5bcb6-20ad-4920-ab33-5bac5759c7db] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:27.712931 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b081c644-581a-4686-82d9-8b4a525e42fb tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:27.714280 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b081c644-581a-4686-82d9-8b4a525e42fb tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:27.720116 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b081c644-581a-4686-82d9-8b4a525e42fb tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:27.722220 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b081c644-581a-4686-82d9-8b4a525e42fb tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:27.811264 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b081c644-581a-4686-82d9-8b4a525e42fb tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:27.812046 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b081c644-581a-4686-82d9-8b4a525e42fb tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:27.812757 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-b081c644-581a-4686-82d9-8b4a525e42fb tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lazy-loading 'fault' on Instance uuid 55a5bcb6-20ad-4920-ab33-5bac5759c7db {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:40:27.957133 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-b081c644-581a-4686-82d9-8b4a525e42fb tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6c51373c8946fcb1b9215635314bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec19e33656204aba8f69bb49d4c16d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:27.970663 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b081c644-581a-4686-82d9-8b4a525e42fb tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] 10.222.0.46 "GET /compute/v2.1/servers/55a5bcb6-20ad-4920-ab33-5bac5759c7db" status: 200 len: 1315 microversion: 2.1 time: 0.276597 Jul 28 10:40:27.970663 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 544/1074] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:27 2022] GET /compute/v2.1/servers/55a5bcb6-20ad-4920-ab33-5bac5759c7db => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:27.989716 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0df6af66-5fb0-4092-b424-6cdd4013ef3e tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:27.990999 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-0df6af66-5fb0-4092-b424-6cdd4013ef3e tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 55a5bcb6-20ad-4920-ab33-5bac5759c7db] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:28.003296 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0df6af66-5fb0-4092-b424-6cdd4013ef3e tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:28.005400 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0df6af66-5fb0-4092-b424-6cdd4013ef3e tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:28.006661 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0df6af66-5fb0-4092-b424-6cdd4013ef3e tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:28.012153 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0df6af66-5fb0-4092-b424-6cdd4013ef3e tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:28.071206 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-0df6af66-5fb0-4092-b424-6cdd4013ef3e tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 55a5bcb6-20ad-4920-ab33-5bac5759c7db] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:40:28.175321 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-0df6af66-5fb0-4092-b424-6cdd4013ef3e tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 55a5bcb6-20ad-4920-ab33-5bac5759c7db] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:40:28.176077 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0df6af66-5fb0-4092-b424-6cdd4013ef3e tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:28.176533 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0df6af66-5fb0-4092-b424-6cdd4013ef3e tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:28.176981 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-0df6af66-5fb0-4092-b424-6cdd4013ef3e tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 55a5bcb6-20ad-4920-ab33-5bac5759c7db] instance's host None is down, deleting from database Jul 28 10:40:28.189838 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-0df6af66-5fb0-4092-b424-6cdd4013ef3e tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 55a5bcb6-20ad-4920-ab33-5bac5759c7db] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:40:28.267418 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-0df6af66-5fb0-4092-b424-6cdd4013ef3e tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 55a5bcb6-20ad-4920-ab33-5bac5759c7db] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:40:28.273619 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-0df6af66-5fb0-4092-b424-6cdd4013ef3e tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 55a5bcb6-20ad-4920-ab33-5bac5759c7db] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:40:28.394328 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:28.994717 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1123240050", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "de534e9f-20e0-4594-9c69-3a8521b239aa"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:40:29.104246 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-0df6af66-5fb0-4092-b424-6cdd4013ef3e tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] 10.222.0.46 "DELETE /compute/v2.1/servers/55a5bcb6-20ad-4920-ab33-5bac5759c7db" status: 204 len: 0 microversion: 2.1 time: 1.118344 Jul 28 10:40:29.119489 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 531/1075] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:40:27 2022] DELETE /compute/v2.1/servers/55a5bcb6-20ad-4920-ab33-5bac5759c7db => generated 0 bytes in 1131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:40:29.130981 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e99a7d20-dc20-421b-847f-9484a8baaa22 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:29.134106 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-e99a7d20-dc20-421b-847f-9484a8baaa22 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 55a5bcb6-20ad-4920-ab33-5bac5759c7db] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:29.150766 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] validate_networks() for [('de534e9f-20e0-4594-9c69-3a8521b239aa', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:40:29.152136 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e99a7d20-dc20-421b-847f-9484a8baaa22 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:29.156505 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e99a7d20-dc20-421b-847f-9484a8baaa22 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:29.160036 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e99a7d20-dc20-421b-847f-9484a8baaa22 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:29.161934 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e99a7d20-dc20-421b-847f-9484a8baaa22 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:29.201921 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-e99a7d20-dc20-421b-847f-9484a8baaa22 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] HTTP exception thrown: Instance 55a5bcb6-20ad-4920-ab33-5bac5759c7db could not be found. Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e99a7d20-dc20-421b-847f-9484a8baaa22 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Request method failure captured: Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/55a5bcb6-20ad-4920-ab33-5bac5759c7db HTTP/1.1 Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4meHklHsp9GhWT9pRTBb3LPYR9AD6sbN_J9isrXjjy6UkUhlG9Q6U9jLW2dl9Wi5Btj6_dlph2Gu-n0KwRYbedXdXt2Mbtkz2ciBcJ9NVf3WdYRPO3G6rS-8AqFoUsYA27aMLnYe0djOO6nPjzR6cANdQLQcfHDT6-XWhCFSf0HNZ14 Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: ec19e33656204aba8f69bb49d4c16d4a Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-AttachVolumeNegativeTest-748584556 Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ec19e33656204aba8f69bb49d4c16d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec19e33656204aba8f69bb49d4c16d4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec19e33656204aba8f69bb49d4c16d4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ec19e33656204aba8f69bb49d4c16d4a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-AttachVolumeNegativeTest-748584556 Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: ec19e33656204aba8f69bb49d4c16d4a Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-748584556 Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-AttachVolumeNegativeTest-748584556-project Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 2c6c51373c8946fcb1b9215635314bfd Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-AttachVolumeNegativeTest-748584556-project Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 55a5bcb6-20ad-4920-ab33-5bac5759c7db could not be found. Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '55a5bcb6-20ad-4920-ab33-5bac5759c7db'} Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55a5bcb6-20ad-4920-ab33-5bac5759c7db could not be found. Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55a5bcb6-20ad-4920-ab33-5bac5759c7db could not be found. Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:29.212277 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:29.220318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:29.220318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:29.220318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:29.220318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:40:29.220318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:40:29.220318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55a5bcb6-20ad-4920-ab33-5bac5759c7db could not be found. Jul 28 10:40:29.220318 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:29.220318 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e99a7d20-dc20-421b-847f-9484a8baaa22 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Returning 404 to user: Instance 55a5bcb6-20ad-4920-ab33-5bac5759c7db could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:40:29.220318 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e99a7d20-dc20-421b-847f-9484a8baaa22 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] 10.222.0.46 "GET /compute/v2.1/servers/55a5bcb6-20ad-4920-ab33-5bac5759c7db" status: 404 len: 111 microversion: 2.1 time: 0.092969 Jul 28 10:40:29.223351 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 532/1076] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:29 2022] GET /compute/v2.1/servers/55a5bcb6-20ad-4920-ab33-5bac5759c7db => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:40:29.237505 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-fc1ce005-bd3f-44aa-8bba-7d60de0fb86b tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Calling method '.version_select at 0x7fa94bd32a60>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:29.286375 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-fc1ce005-bd3f-44aa-8bba-7d60de0fb86b tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1529949842" status: 202 len: 0 microversion: 2.1 time: 0.061719 Jul 28 10:40:29.290417 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 533/1077] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Jul 28 10:40:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1529949842 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:40:30.156126 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-213d5393-661e-434d-8406-52d45239d36c tempest-QuotasTestJSON-659356742 tempest-QuotasTestJSON-659356742-project] Calling method '.version_select at 0x7fa94ba61dc0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:30.422318 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:40:30.422839 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:40:30.423411 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:40:30.424295 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:40:30.424919 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:40:30.453267 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:30.454133 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:30.455314 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:30.455890 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:30.518794 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Getting quotas for project 794d085f90504260907001dece2a9a30. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:40:30.526002 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Getting quotas for user f61034f4f0124130a96769efea58b2a9 and project 794d085f90504260907001dece2a9a30. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:40:30.557636 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:40:30.567809 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: ff44a096-7593-4cd5-98cd-47122cc71bc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:40:30.674460 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-55a2b3de-7965-496a-a475-86de751f5cbc tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.102882 Jul 28 10:40:30.675679 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 545/1078] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:40:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:40:30.693599 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-66db76a2-291b-45e7-9ba9-c48a9a08733e tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:30.703796 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-66db76a2-291b-45e7-9ba9-c48a9a08733e tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: ff44a096-7593-4cd5-98cd-47122cc71bc1] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:31.061066 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-66db76a2-291b-45e7-9ba9-c48a9a08733e tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61034f4f0124130a96769efea58b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794d085f90504260907001dece2a9a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:31.077519 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-66db76a2-291b-45e7-9ba9-c48a9a08733e tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute/v2.1/servers/ff44a096-7593-4cd5-98cd-47122cc71bc1" status: 200 len: 1215 microversion: 2.1 time: 0.394190 Jul 28 10:40:31.088108 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 546/1079] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:30 2022] GET /compute/v2.1/servers/ff44a096-7593-4cd5-98cd-47122cc71bc1 => generated 1215 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:31.284982 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-213d5393-661e-434d-8406-52d45239d36c tempest-QuotasTestJSON-659356742 tempest-QuotasTestJSON-659356742-project] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/b3062ab9df7c4a2cadcf71aecd73dc23/defaults" status: 200 len: 371 microversion: 2.1 time: 1.865603 Jul 28 10:40:31.287473 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 534/1080] 10.222.0.46 () {58 vars in 1269 bytes} [Thu Jul 28 10:40:29 2022] GET /compute/v2.1/os-quota-sets/b3062ab9df7c4a2cadcf71aecd73dc23/defaults => generated 371 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:40:31.299471 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-93511ec3-679c-496b-95af-f3d485fcdad8 tempest-QuotasTestJSON-659356742 tempest-QuotasTestJSON-659356742-project] Calling method '.version_select at 0x7fa94b8e74c0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:31.547769 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-95370198-aea6-43b5-956f-bb06b04bcd87 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Action: 'create', calling method: .version_select at 0x7fa94bda03a0>, body: {"keypair": {"name": "tempest-keypair-635317399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLS5Z8AZ0u29FN2VXLd4oZOfr/fUd+L9+5S9aI2PGNTpoyMa9YV2Yvim/LNSk21PNmZTXYkdTUGzQAX3c8wjbTTCmcnTB7gechuyZdr6HAVgntVG1I4C1JW67DfwwjGulA=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:40:31.561900 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:31.616173 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-95370198-aea6-43b5-956f-bb06b04bcd87 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Getting quotas for project ec19e33656204aba8f69bb49d4c16d4a. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:40:31.662946 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-95370198-aea6-43b5-956f-bb06b04bcd87 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Getting quotas for user 2c6c51373c8946fcb1b9215635314bfd and project ec19e33656204aba8f69bb49d4c16d4a. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:40:31.736645 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-95370198-aea6-43b5-956f-bb06b04bcd87 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.191991 Jul 28 10:40:31.739350 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 535/1081] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:40:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:40:32.103811 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-961de23f-d35d-4405-b318-6e3b92907101 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:32.105034 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-961de23f-d35d-4405-b318-6e3b92907101 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: ff44a096-7593-4cd5-98cd-47122cc71bc1] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:32.127658 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-961de23f-d35d-4405-b318-6e3b92907101 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:32.128170 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-961de23f-d35d-4405-b318-6e3b92907101 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:32.134293 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-961de23f-d35d-4405-b318-6e3b92907101 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:32.136191 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-961de23f-d35d-4405-b318-6e3b92907101 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:32.258380 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-961de23f-d35d-4405-b318-6e3b92907101 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:32.258852 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-961de23f-d35d-4405-b318-6e3b92907101 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:32.261110 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-961de23f-d35d-4405-b318-6e3b92907101 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lazy-loading 'fault' on Instance uuid ff44a096-7593-4cd5-98cd-47122cc71bc1 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:40:32.310277 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-93511ec3-679c-496b-95af-f3d485fcdad8 tempest-QuotasTestJSON-659356742 tempest-QuotasTestJSON-659356742-project] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/b3062ab9df7c4a2cadcf71aecd73dc23" status: 200 len: 371 microversion: 2.1 time: 1.016089 Jul 28 10:40:32.321515 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 547/1082] 10.222.0.46 () {58 vars in 1242 bytes} [Thu Jul 28 10:40:31 2022] GET /compute/v2.1/os-quota-sets/b3062ab9df7c4a2cadcf71aecd73dc23 => generated 371 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:40:32.328144 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-10ec8ae3-85fd-431b-a241-a3738eb5a431 tempest-QuotasTestJSON-659356742 tempest-QuotasTestJSON-659356742-project] Calling method '.version_select at 0x7fa94b937550>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:32.370430 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-961de23f-d35d-4405-b318-6e3b92907101 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61034f4f0124130a96769efea58b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794d085f90504260907001dece2a9a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:32.378710 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=81,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:32.390594 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-961de23f-d35d-4405-b318-6e3b92907101 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute/v2.1/servers/ff44a096-7593-4cd5-98cd-47122cc71bc1" status: 200 len: 1288 microversion: 2.1 time: 0.291555 Jul 28 10:40:32.406667 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 536/1083] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:32 2022] GET /compute/v2.1/servers/ff44a096-7593-4cd5-98cd-47122cc71bc1 => generated 1288 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:32.412912 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1c380684-2f08-4aa5-8feb-74a433bebb58 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:32.414015 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1c380684-2f08-4aa5-8feb-74a433bebb58 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: ff44a096-7593-4cd5-98cd-47122cc71bc1] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:32.422584 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1c380684-2f08-4aa5-8feb-74a433bebb58 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:32.423434 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1c380684-2f08-4aa5-8feb-74a433bebb58 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:32.424509 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1c380684-2f08-4aa5-8feb-74a433bebb58 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:32.425558 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1c380684-2f08-4aa5-8feb-74a433bebb58 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:32.456459 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1c380684-2f08-4aa5-8feb-74a433bebb58 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: ff44a096-7593-4cd5-98cd-47122cc71bc1] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:40:32.533718 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-10ec8ae3-85fd-431b-a241-a3738eb5a431 tempest-QuotasTestJSON-659356742 tempest-QuotasTestJSON-659356742-project] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/b3062ab9df7c4a2cadcf71aecd73dc23/defaults" status: 200 len: 371 microversion: 2.1 time: 0.210033 Jul 28 10:40:32.536904 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 548/1084] 10.222.0.46 () {58 vars in 1269 bytes} [Thu Jul 28 10:40:32 2022] GET /compute/v2.1/os-quota-sets/b3062ab9df7c4a2cadcf71aecd73dc23/defaults => generated 371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:40:32.544038 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1c380684-2f08-4aa5-8feb-74a433bebb58 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: ff44a096-7593-4cd5-98cd-47122cc71bc1] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:40:32.551895 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1c380684-2f08-4aa5-8feb-74a433bebb58 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:32.553983 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1c380684-2f08-4aa5-8feb-74a433bebb58 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:32.554976 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0764cb26-e735-48a7-8840-4019865d4ee5 tempest-QuotasTestJSON-659356742 tempest-QuotasTestJSON-659356742-project] Calling method '.version_select at 0x7fa94b9e7940>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:32.555924 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-1c380684-2f08-4aa5-8feb-74a433bebb58 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: ff44a096-7593-4cd5-98cd-47122cc71bc1] instance's host None is down, deleting from database Jul 28 10:40:32.563551 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-1c380684-2f08-4aa5-8feb-74a433bebb58 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: ff44a096-7593-4cd5-98cd-47122cc71bc1] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:40:32.617916 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-1c380684-2f08-4aa5-8feb-74a433bebb58 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: ff44a096-7593-4cd5-98cd-47122cc71bc1] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:40:32.628442 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-1c380684-2f08-4aa5-8feb-74a433bebb58 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: ff44a096-7593-4cd5-98cd-47122cc71bc1] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:40:32.724601 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0764cb26-e735-48a7-8840-4019865d4ee5 tempest-QuotasTestJSON-659356742 tempest-QuotasTestJSON-659356742-project] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/b3062ab9df7c4a2cadcf71aecd73dc23" status: 200 len: 371 microversion: 2.1 time: 0.175304 Jul 28 10:40:32.727039 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 549/1085] 10.222.0.46 () {58 vars in 1242 bytes} [Thu Jul 28 10:40:32 2022] GET /compute/v2.1/os-quota-sets/b3062ab9df7c4a2cadcf71aecd73dc23 => generated 371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:40:32.741430 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9c124d60-86f2-43c5-9c2c-45e804382a35 tempest-QuotasTestJSON-659356742 tempest-QuotasTestJSON-659356742-project] Calling method '.version_select at 0x7fa94b87da60>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:32.919603 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9c124d60-86f2-43c5-9c2c-45e804382a35 tempest-QuotasTestJSON-659356742 tempest-QuotasTestJSON-659356742-project] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/b3062ab9df7c4a2cadcf71aecd73dc23?user_id=d680971e45ec452fa3915a2df08c1228" status: 200 len: 371 microversion: 2.1 time: 0.183818 Jul 28 10:40:32.920233 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 550/1086] 10.222.0.46 () {58 vars in 1323 bytes} [Thu Jul 28 10:40:32 2022] GET /compute/v2.1/os-quota-sets/b3062ab9df7c4a2cadcf71aecd73dc23?user_id=d680971e45ec452fa3915a2df08c1228 => generated 371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:40:33.007542 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-1c380684-2f08-4aa5-8feb-74a433bebb58 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ff44a096-7593-4cd5-98cd-47122cc71bc1" status: 204 len: 0 microversion: 2.1 time: 0.598833 Jul 28 10:40:33.008147 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 537/1087] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:40:32 2022] DELETE /compute/v2.1/servers/ff44a096-7593-4cd5-98cd-47122cc71bc1 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:40:33.019886 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9ce9864f-d6bb-4bf0-a99f-c86e9452fdd4 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:33.020667 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-9ce9864f-d6bb-4bf0-a99f-c86e9452fdd4 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: ff44a096-7593-4cd5-98cd-47122cc71bc1] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:33.028571 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9ce9864f-d6bb-4bf0-a99f-c86e9452fdd4 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:33.029039 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9ce9864f-d6bb-4bf0-a99f-c86e9452fdd4 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:33.036087 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9ce9864f-d6bb-4bf0-a99f-c86e9452fdd4 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:33.036511 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9ce9864f-d6bb-4bf0-a99f-c86e9452fdd4 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:33.077226 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-9ce9864f-d6bb-4bf0-a99f-c86e9452fdd4 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] HTTP exception thrown: Instance ff44a096-7593-4cd5-98cd-47122cc71bc1 could not be found. Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9ce9864f-d6bb-4bf0-a99f-c86e9452fdd4 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Request method failure captured: Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/ff44a096-7593-4cd5-98cd-47122cc71bc1 HTTP/1.1 Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mec8hLqMVihMClpSRkIHbuYQJoqEsjZKw7TxQ6JZdHfbdH89o5o084yukauDFgSpiI3SR-dRNQqBZyizcG2GEDxhptB7-83zk8WxcE1vmiYFGI0vCe8CsAeR0tmE1CuGW9i1K_Vi6y-tuVV9vJQgzMF9XH9APpX5GBRH3f0-VHoBH8 Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 794d085f90504260907001dece2a9a30 Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-DeleteServersTestJSON-709615766 Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/794d085f90504260907001dece2a9a30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/794d085f90504260907001dece2a9a30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/794d085f90504260907001dece2a9a30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_794d085f90504260907001dece2a9a30", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-DeleteServersTestJSON-709615766 Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 794d085f90504260907001dece2a9a30 Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-DeleteServersTestJSON-709615766 Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-DeleteServersTestJSON-709615766-project Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: f61034f4f0124130a96769efea58b2a9 Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-DeleteServersTestJSON-709615766-project Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance ff44a096-7593-4cd5-98cd-47122cc71bc1 could not be found. Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'ff44a096-7593-4cd5-98cd-47122cc71bc1'} Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff44a096-7593-4cd5-98cd-47122cc71bc1 could not be found. Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff44a096-7593-4cd5-98cd-47122cc71bc1 could not be found. Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:33.078966 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:40:33.085105 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:33.085105 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:33.085105 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:33.085105 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:40:33.085105 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:40:33.085105 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff44a096-7593-4cd5-98cd-47122cc71bc1 could not be found. Jul 28 10:40:33.085105 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:40:33.085105 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9ce9864f-d6bb-4bf0-a99f-c86e9452fdd4 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Returning 404 to user: Instance ff44a096-7593-4cd5-98cd-47122cc71bc1 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:40:33.085105 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9ce9864f-d6bb-4bf0-a99f-c86e9452fdd4 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute/v2.1/servers/ff44a096-7593-4cd5-98cd-47122cc71bc1" status: 404 len: 111 microversion: 2.1 time: 0.065654 Jul 28 10:40:33.085105 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 551/1088] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:33 2022] GET /compute/v2.1/servers/ff44a096-7593-4cd5-98cd-47122cc71bc1 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:40:33.315818 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1041525049", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "de534e9f-20e0-4594-9c69-3a8521b239aa"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:40:33.485796 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] validate_networks() for [('de534e9f-20e0-4594-9c69-3a8521b239aa', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:40:35.364835 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:40:35.365417 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:40:35.365808 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:40:35.366260 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:40:35.375221 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:40:35.415235 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:35.415235 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:35.421853 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:35.422752 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:35.455274 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Getting quotas for project 794d085f90504260907001dece2a9a30. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:40:35.463602 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Getting quotas for user f61034f4f0124130a96769efea58b2a9 and project 794d085f90504260907001dece2a9a30. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:40:35.486021 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:40:35.495534 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56502eca-951f-4f50-b6be-3e2de0205abc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:40:35.619187 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3eafafe0-cf6c-4ed1-b3f8-2113b18ea927 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.307691 Jul 28 10:40:35.628114 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 538/1089] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:40:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:40:35.632219 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d7153983-4c3d-475e-ba13-7b11b3a427d4 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:35.632941 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-d7153983-4c3d-475e-ba13-7b11b3a427d4 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56502eca-951f-4f50-b6be-3e2de0205abc] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:35.766685 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-d7153983-4c3d-475e-ba13-7b11b3a427d4 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61034f4f0124130a96769efea58b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794d085f90504260907001dece2a9a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:35.784701 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-d7153983-4c3d-475e-ba13-7b11b3a427d4 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute/v2.1/servers/56502eca-951f-4f50-b6be-3e2de0205abc" status: 200 len: 1215 microversion: 2.1 time: 0.156234 Jul 28 10:40:35.789222 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 552/1090] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:35 2022] GET /compute/v2.1/servers/56502eca-951f-4f50-b6be-3e2de0205abc => generated 1215 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:36.812320 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-143795ed-b769-495b-a259-a5dc2b82a5cb tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:36.813236 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-143795ed-b769-495b-a259-a5dc2b82a5cb tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56502eca-951f-4f50-b6be-3e2de0205abc] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:36.830714 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-143795ed-b769-495b-a259-a5dc2b82a5cb tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:36.831433 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-143795ed-b769-495b-a259-a5dc2b82a5cb tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:36.837401 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-143795ed-b769-495b-a259-a5dc2b82a5cb tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:36.838602 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-143795ed-b769-495b-a259-a5dc2b82a5cb tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:36.908746 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-143795ed-b769-495b-a259-a5dc2b82a5cb tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:36.909511 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-143795ed-b769-495b-a259-a5dc2b82a5cb tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:36.910452 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-143795ed-b769-495b-a259-a5dc2b82a5cb tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lazy-loading 'fault' on Instance uuid 56502eca-951f-4f50-b6be-3e2de0205abc {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:40:36.998245 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-143795ed-b769-495b-a259-a5dc2b82a5cb tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61034f4f0124130a96769efea58b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794d085f90504260907001dece2a9a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:37.009266 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-143795ed-b769-495b-a259-a5dc2b82a5cb tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute/v2.1/servers/56502eca-951f-4f50-b6be-3e2de0205abc" status: 200 len: 1288 microversion: 2.1 time: 0.202917 Jul 28 10:40:37.009897 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 539/1091] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:36 2022] GET /compute/v2.1/servers/56502eca-951f-4f50-b6be-3e2de0205abc => generated 1288 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:37.032447 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9b53d89b-422f-4d54-9771-29eb4a59ef5a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:37.032884 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-9b53d89b-422f-4d54-9771-29eb4a59ef5a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56502eca-951f-4f50-b6be-3e2de0205abc] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:37.038919 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9b53d89b-422f-4d54-9771-29eb4a59ef5a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:37.039646 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9b53d89b-422f-4d54-9771-29eb4a59ef5a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:37.040705 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9b53d89b-422f-4d54-9771-29eb4a59ef5a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:37.041544 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9b53d89b-422f-4d54-9771-29eb4a59ef5a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:37.098113 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-9b53d89b-422f-4d54-9771-29eb4a59ef5a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56502eca-951f-4f50-b6be-3e2de0205abc] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:40:37.168395 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:UPDATE=30,nova_cell0:SELECT=62,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:37.175336 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-580839509", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "372a43c0-b145-47bb-b735-e65fe29e096f"}], "security_groups": [{"name": "tempest-securitygroup--684051516"}], "key_name": "tempest-keypair-635317399", "user_data": "}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:40:37.238337 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-9b53d89b-422f-4d54-9771-29eb4a59ef5a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56502eca-951f-4f50-b6be-3e2de0205abc] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:40:37.238337 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9b53d89b-422f-4d54-9771-29eb4a59ef5a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:37.238337 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9b53d89b-422f-4d54-9771-29eb4a59ef5a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:37.238337 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-9b53d89b-422f-4d54-9771-29eb4a59ef5a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56502eca-951f-4f50-b6be-3e2de0205abc] instance's host None is down, deleting from database Jul 28 10:40:37.255997 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-9b53d89b-422f-4d54-9771-29eb4a59ef5a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56502eca-951f-4f50-b6be-3e2de0205abc] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:40:37.348298 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-9b53d89b-422f-4d54-9771-29eb4a59ef5a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56502eca-951f-4f50-b6be-3e2de0205abc] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:40:37.356390 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-9b53d89b-422f-4d54-9771-29eb4a59ef5a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56502eca-951f-4f50-b6be-3e2de0205abc] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:40:37.361477 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] validate_networks() for [('372a43c0-b145-47bb-b735-e65fe29e096f', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:40:37.661205 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9b53d89b-422f-4d54-9771-29eb4a59ef5a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "DELETE /compute/v2.1/servers/56502eca-951f-4f50-b6be-3e2de0205abc" status: 204 len: 0 microversion: 2.1 time: 0.633814 Jul 28 10:40:37.662198 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 553/1092] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:40:37 2022] DELETE /compute/v2.1/servers/56502eca-951f-4f50-b6be-3e2de0205abc => generated 0 bytes in 637 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:40:37.665616 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9b53d89b-422f-4d54-9771-29eb4a59ef5a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:37.667115 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9b53d89b-422f-4d54-9771-29eb4a59ef5a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002218 Jul 28 10:40:37.668615 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 554/1093] 10.222.0.46 () {56 vars in 886 bytes} [Thu Jul 28 10:40:37 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 28 10:40:37.682678 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-43065caf-7f3e-4854-939e-55fbddb402c0 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:37.683594 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-43065caf-7f3e-4854-939e-55fbddb402c0 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56502eca-951f-4f50-b6be-3e2de0205abc] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:37.696794 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-43065caf-7f3e-4854-939e-55fbddb402c0 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:37.697450 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-43065caf-7f3e-4854-939e-55fbddb402c0 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:37.698857 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-43065caf-7f3e-4854-939e-55fbddb402c0 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:37.699613 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-43065caf-7f3e-4854-939e-55fbddb402c0 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:37.717957 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-43065caf-7f3e-4854-939e-55fbddb402c0 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] HTTP exception thrown: Instance 56502eca-951f-4f50-b6be-3e2de0205abc could not be found. Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-43065caf-7f3e-4854-939e-55fbddb402c0 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Request method failure captured: Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/56502eca-951f-4f50-b6be-3e2de0205abc HTTP/1.1 Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mec8hLqMVihMClpSRkIHbuYQJoqEsjZKw7TxQ6JZdHfbdH89o5o084yukauDFgSpiI3SR-dRNQqBZyizcG2GEDxhptB7-83zk8WxcE1vmiYFGI0vCe8CsAeR0tmE1CuGW9i1K_Vi6y-tuVV9vJQgzMF9XH9APpX5GBRH3f0-VHoBH8 Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 794d085f90504260907001dece2a9a30 Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-DeleteServersTestJSON-709615766 Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/794d085f90504260907001dece2a9a30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/794d085f90504260907001dece2a9a30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/794d085f90504260907001dece2a9a30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_794d085f90504260907001dece2a9a30", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-DeleteServersTestJSON-709615766 Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 794d085f90504260907001dece2a9a30 Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-DeleteServersTestJSON-709615766 Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-DeleteServersTestJSON-709615766-project Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: f61034f4f0124130a96769efea58b2a9 Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-DeleteServersTestJSON-709615766-project Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 56502eca-951f-4f50-b6be-3e2de0205abc could not be found. Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '56502eca-951f-4f50-b6be-3e2de0205abc'} Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56502eca-951f-4f50-b6be-3e2de0205abc could not be found. Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56502eca-951f-4f50-b6be-3e2de0205abc could not be found. Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:37.723681 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:40:37.731037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:37.731037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:37.731037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:37.731037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:40:37.731037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:40:37.731037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56502eca-951f-4f50-b6be-3e2de0205abc could not be found. Jul 28 10:40:37.731037 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:40:37.731037 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-43065caf-7f3e-4854-939e-55fbddb402c0 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Returning 404 to user: Instance 56502eca-951f-4f50-b6be-3e2de0205abc could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:40:37.731037 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-43065caf-7f3e-4854-939e-55fbddb402c0 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute/v2.1/servers/56502eca-951f-4f50-b6be-3e2de0205abc" status: 404 len: 111 microversion: 2.1 time: 0.047227 Jul 28 10:40:37.733811 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 555/1094] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:37 2022] GET /compute/v2.1/servers/56502eca-951f-4f50-b6be-3e2de0205abc => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:40:37.735513 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-43065caf-7f3e-4854-939e-55fbddb402c0 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:37.742942 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-43065caf-7f3e-4854-939e-55fbddb402c0 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001763 Jul 28 10:40:37.744045 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 556/1095] 10.222.0.46 () {54 vars in 1035 bytes} [Thu Jul 28 10:40:37 2022] GET /compute/v2/ => generated 379 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jul 28 10:40:37.746153 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-43065caf-7f3e-4854-939e-55fbddb402c0 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:37.747331 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-43065caf-7f3e-4854-939e-55fbddb402c0 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002179 Jul 28 10:40:37.756896 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 557/1096] 10.222.0.46 () {54 vars in 1041 bytes} [Thu Jul 28 10:40:37 2022] GET /compute/v2.1/ => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:40:37.757675 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-43065caf-7f3e-4854-939e-55fbddb402c0 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:37.759023 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-43065caf-7f3e-4854-939e-55fbddb402c0 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001688 Jul 28 10:40:37.767179 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 558/1097] 10.222.0.46 () {56 vars in 886 bytes} [Thu Jul 28 10:40:37 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 28 10:40:37.986629 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1492632701", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "de534e9f-20e0-4594-9c69-3a8521b239aa"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:40:38.089508 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] validate_networks() for [('de534e9f-20e0-4594-9c69-3a8521b239aa', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:40:38.462100 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:40:38.463324 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:40:38.464241 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:40:38.464800 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:40:38.466126 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:40:38.488763 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:38.490734 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:38.491826 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:38.493217 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:38.516652 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Getting quotas for project ec19e33656204aba8f69bb49d4c16d4a. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:40:38.522985 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Getting quotas for user 2c6c51373c8946fcb1b9215635314bfd and project ec19e33656204aba8f69bb49d4c16d4a. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:40:38.538210 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:40:38.551310 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 7fad1e75-acd5-4f7a-a3c7-28050492ebcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:40:38.620960 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-26deb579-ab86-4231-98be-24ba9228ecea tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.450973 Jul 28 10:40:38.622354 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 540/1098] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:40:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 10:40:38.658446 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2fb6a15c-b8cd-4028-806e-e0a4d4af15ac tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:38.659286 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-2fb6a15c-b8cd-4028-806e-e0a4d4af15ac tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 7fad1e75-acd5-4f7a-a3c7-28050492ebcf] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:38.759026 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-2fb6a15c-b8cd-4028-806e-e0a4d4af15ac tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6c51373c8946fcb1b9215635314bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec19e33656204aba8f69bb49d4c16d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:38.768034 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-2fb6a15c-b8cd-4028-806e-e0a4d4af15ac tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] 10.222.0.46 "GET /compute/v2.1/servers/7fad1e75-acd5-4f7a-a3c7-28050492ebcf" status: 200 len: 1240 microversion: 2.1 time: 0.137292 Jul 28 10:40:38.768918 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 541/1099] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:38 2022] GET /compute/v2.1/servers/7fad1e75-acd5-4f7a-a3c7-28050492ebcf => generated 1240 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:38.979734 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:40:38.980256 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:40:38.980735 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:40:38.981484 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:40:38.982363 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:40:39.011230 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=45 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:39.016566 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:39.017043 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:39.019635 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:39.021791 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:39.047186 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=9 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:39.077150 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Getting quotas for project 794d085f90504260907001dece2a9a30. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:40:39.093890 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Getting quotas for user f61034f4f0124130a96769efea58b2a9 and project 794d085f90504260907001dece2a9a30. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:40:39.134336 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:40:39.136403 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 5b1d6d0e-deb1-4029-9c03-9aace5e9704f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:40:39.253492 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-52976a36-a992-460a-93cc-6c913b19e38a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.273019 Jul 28 10:40:39.254650 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 559/1100] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:40:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:40:39.265880 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-fc3d6839-3432-4912-abf3-fe213cdf3b48 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:39.266509 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-fc3d6839-3432-4912-abf3-fe213cdf3b48 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 5b1d6d0e-deb1-4029-9c03-9aace5e9704f] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:39.417648 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-fc3d6839-3432-4912-abf3-fe213cdf3b48 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61034f4f0124130a96769efea58b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794d085f90504260907001dece2a9a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:39.447827 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-fc3d6839-3432-4912-abf3-fe213cdf3b48 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1d6d0e-deb1-4029-9c03-9aace5e9704f" status: 200 len: 1215 microversion: 2.1 time: 0.186027 Jul 28 10:40:39.448621 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 542/1101] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:39 2022] GET /compute/v2.1/servers/5b1d6d0e-deb1-4029-9c03-9aace5e9704f => generated 1215 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:39.477118 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0da1315e-374b-49a0-b8b3-adaad698c00a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:39.479434 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0da1315e-374b-49a0-b8b3-adaad698c00a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 5b1d6d0e-deb1-4029-9c03-9aace5e9704f] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:39.505931 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0da1315e-374b-49a0-b8b3-adaad698c00a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 5b1d6d0e-deb1-4029-9c03-9aace5e9704f] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:40:39.792534 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d918504a-26dc-4686-b4c8-ec35a23bab77 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:39.793146 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-d918504a-26dc-4686-b4c8-ec35a23bab77 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 7fad1e75-acd5-4f7a-a3c7-28050492ebcf] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:39.821690 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d918504a-26dc-4686-b4c8-ec35a23bab77 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:39.823121 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d918504a-26dc-4686-b4c8-ec35a23bab77 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:39.824189 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d918504a-26dc-4686-b4c8-ec35a23bab77 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:39.824997 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d918504a-26dc-4686-b4c8-ec35a23bab77 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:39.862885 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d918504a-26dc-4686-b4c8-ec35a23bab77 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:39.863702 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d918504a-26dc-4686-b4c8-ec35a23bab77 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:39.864371 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-d918504a-26dc-4686-b4c8-ec35a23bab77 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lazy-loading 'fault' on Instance uuid 7fad1e75-acd5-4f7a-a3c7-28050492ebcf {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:40:40.070294 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-d918504a-26dc-4686-b4c8-ec35a23bab77 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6c51373c8946fcb1b9215635314bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec19e33656204aba8f69bb49d4c16d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:40.082469 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d918504a-26dc-4686-b4c8-ec35a23bab77 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] 10.222.0.46 "GET /compute/v2.1/servers/7fad1e75-acd5-4f7a-a3c7-28050492ebcf" status: 200 len: 1313 microversion: 2.1 time: 0.293625 Jul 28 10:40:40.100891 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 543/1102] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:39 2022] GET /compute/v2.1/servers/7fad1e75-acd5-4f7a-a3c7-28050492ebcf => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:40.102377 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:40.111369 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e6e4c13a-e726-4250-8e69-e141977c0762 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:40.112154 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-e6e4c13a-e726-4250-8e69-e141977c0762 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 7fad1e75-acd5-4f7a-a3c7-28050492ebcf] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:40.118070 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0da1315e-374b-49a0-b8b3-adaad698c00a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:40.121654 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e6e4c13a-e726-4250-8e69-e141977c0762 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:40.122475 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0da1315e-374b-49a0-b8b3-adaad698c00a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:40.134578 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e6e4c13a-e726-4250-8e69-e141977c0762 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:40.135802 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e6e4c13a-e726-4250-8e69-e141977c0762 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:40.136971 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e6e4c13a-e726-4250-8e69-e141977c0762 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:40.187928 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-e6e4c13a-e726-4250-8e69-e141977c0762 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 7fad1e75-acd5-4f7a-a3c7-28050492ebcf] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:40:40.291110 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-e6e4c13a-e726-4250-8e69-e141977c0762 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 7fad1e75-acd5-4f7a-a3c7-28050492ebcf] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:40:40.292421 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e6e4c13a-e726-4250-8e69-e141977c0762 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:40.293176 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e6e4c13a-e726-4250-8e69-e141977c0762 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:40.294180 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-e6e4c13a-e726-4250-8e69-e141977c0762 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 7fad1e75-acd5-4f7a-a3c7-28050492ebcf] instance's host None is down, deleting from database Jul 28 10:40:40.299408 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-e6e4c13a-e726-4250-8e69-e141977c0762 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 7fad1e75-acd5-4f7a-a3c7-28050492ebcf] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:40:40.358040 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-e6e4c13a-e726-4250-8e69-e141977c0762 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 7fad1e75-acd5-4f7a-a3c7-28050492ebcf] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:40:40.370107 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-e6e4c13a-e726-4250-8e69-e141977c0762 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 7fad1e75-acd5-4f7a-a3c7-28050492ebcf] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:40:40.613320 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=69,nova_cell0:UPDATE=25,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:40.658461 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e6e4c13a-e726-4250-8e69-e141977c0762 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7fad1e75-acd5-4f7a-a3c7-28050492ebcf" status: 204 len: 0 microversion: 2.1 time: 0.552211 Jul 28 10:40:40.662448 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 544/1103] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:40:40 2022] DELETE /compute/v2.1/servers/7fad1e75-acd5-4f7a-a3c7-28050492ebcf => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 10:40:40.670624 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6ae053e4-b11e-43b7-a593-939eff147dbe tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:40.671543 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-6ae053e4-b11e-43b7-a593-939eff147dbe tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] [instance: 7fad1e75-acd5-4f7a-a3c7-28050492ebcf] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:40.681006 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6ae053e4-b11e-43b7-a593-939eff147dbe tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:40.681935 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6ae053e4-b11e-43b7-a593-939eff147dbe tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:40.683874 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6ae053e4-b11e-43b7-a593-939eff147dbe tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:40.686479 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6ae053e4-b11e-43b7-a593-939eff147dbe tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:40.693241 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0da1315e-374b-49a0-b8b3-adaad698c00a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5b1d6d0e-deb1-4029-9c03-9aace5e9704f" status: 204 len: 0 microversion: 2.1 time: 1.226278 Jul 28 10:40:40.696212 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 560/1104] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:40:39 2022] DELETE /compute/v2.1/servers/5b1d6d0e-deb1-4029-9c03-9aace5e9704f => generated 0 bytes in 1230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:40:40.712166 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-05594c31-e262-4173-84cd-0bd43565393f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:40.713043 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-05594c31-e262-4173-84cd-0bd43565393f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 5b1d6d0e-deb1-4029-9c03-9aace5e9704f] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:40.717011 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-6ae053e4-b11e-43b7-a593-939eff147dbe tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] HTTP exception thrown: Instance 7fad1e75-acd5-4f7a-a3c7-28050492ebcf could not be found. Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6ae053e4-b11e-43b7-a593-939eff147dbe tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Request method failure captured: Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/7fad1e75-acd5-4f7a-a3c7-28050492ebcf HTTP/1.1 Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4meHklHsp9GhWT9pRTBb3LPYR9AD6sbN_J9isrXjjy6UkUhlG9Q6U9jLW2dl9Wi5Btj6_dlph2Gu-n0KwRYbedXdXt2Mbtkz2ciBcJ9NVf3WdYRPO3G6rS-8AqFoUsYA27aMLnYe0djOO6nPjzR6cANdQLQcfHDT6-XWhCFSf0HNZ14 Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: ec19e33656204aba8f69bb49d4c16d4a Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-AttachVolumeNegativeTest-748584556 Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ec19e33656204aba8f69bb49d4c16d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec19e33656204aba8f69bb49d4c16d4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec19e33656204aba8f69bb49d4c16d4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ec19e33656204aba8f69bb49d4c16d4a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-AttachVolumeNegativeTest-748584556 Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: ec19e33656204aba8f69bb49d4c16d4a Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-748584556 Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-AttachVolumeNegativeTest-748584556-project Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 2c6c51373c8946fcb1b9215635314bfd Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-AttachVolumeNegativeTest-748584556-project Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 7fad1e75-acd5-4f7a-a3c7-28050492ebcf could not be found. Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '7fad1e75-acd5-4f7a-a3c7-28050492ebcf'} Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fad1e75-acd5-4f7a-a3c7-28050492ebcf could not be found. Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fad1e75-acd5-4f7a-a3c7-28050492ebcf could not be found. Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:40.718758 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:40.723309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:40.723309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:40.723309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:40.723309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:40:40.723309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:40:40.723309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fad1e75-acd5-4f7a-a3c7-28050492ebcf could not be found. Jul 28 10:40:40.723309 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:40.725311 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6ae053e4-b11e-43b7-a593-939eff147dbe tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Returning 404 to user: Instance 7fad1e75-acd5-4f7a-a3c7-28050492ebcf could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:40:40.726769 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6ae053e4-b11e-43b7-a593-939eff147dbe tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] 10.222.0.46 "GET /compute/v2.1/servers/7fad1e75-acd5-4f7a-a3c7-28050492ebcf" status: 404 len: 111 microversion: 2.1 time: 0.062444 Jul 28 10:40:40.734090 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 545/1105] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:40 2022] GET /compute/v2.1/servers/7fad1e75-acd5-4f7a-a3c7-28050492ebcf => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:40:40.740145 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-658068f2-8b6e-4ea4-91a2-b47d798f6835 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] Calling method '.version_select at 0x7fa94bc2a310>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:40.742777 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-05594c31-e262-4173-84cd-0bd43565393f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:40.743563 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-05594c31-e262-4173-84cd-0bd43565393f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:40.746039 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-05594c31-e262-4173-84cd-0bd43565393f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:40.748904 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-05594c31-e262-4173-84cd-0bd43565393f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:40.785009 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-05594c31-e262-4173-84cd-0bd43565393f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] HTTP exception thrown: Instance 5b1d6d0e-deb1-4029-9c03-9aace5e9704f could not be found. Jul 28 10:40:40.785496 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-658068f2-8b6e-4ea4-91a2-b47d798f6835 tempest-AttachVolumeNegativeTest-748584556 tempest-AttachVolumeNegativeTest-748584556-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-635317399" status: 202 len: 0 microversion: 2.1 time: 0.049886 Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-05594c31-e262-4173-84cd-0bd43565393f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Request method failure captured: Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/5b1d6d0e-deb1-4029-9c03-9aace5e9704f HTTP/1.1 Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mec8hLqMVihMClpSRkIHbuYQJoqEsjZKw7TxQ6JZdHfbdH89o5o084yukauDFgSpiI3SR-dRNQqBZyizcG2GEDxhptB7-83zk8WxcE1vmiYFGI0vCe8CsAeR0tmE1CuGW9i1K_Vi6y-tuVV9vJQgzMF9XH9APpX5GBRH3f0-VHoBH8 Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 794d085f90504260907001dece2a9a30 Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-DeleteServersTestJSON-709615766 Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/794d085f90504260907001dece2a9a30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/794d085f90504260907001dece2a9a30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/794d085f90504260907001dece2a9a30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_794d085f90504260907001dece2a9a30", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-DeleteServersTestJSON-709615766 Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 794d085f90504260907001dece2a9a30 Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-DeleteServersTestJSON-709615766 Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-DeleteServersTestJSON-709615766-project Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: f61034f4f0124130a96769efea58b2a9 Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-DeleteServersTestJSON-709615766-project Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 5b1d6d0e-deb1-4029-9c03-9aace5e9704f could not be found. Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '5b1d6d0e-deb1-4029-9c03-9aace5e9704f'} Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b1d6d0e-deb1-4029-9c03-9aace5e9704f could not be found. Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b1d6d0e-deb1-4029-9c03-9aace5e9704f could not be found. Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:40.788963 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:40:40.793525 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:40.793525 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:40.793525 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:40.793525 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:40:40.793525 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:40:40.793525 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b1d6d0e-deb1-4029-9c03-9aace5e9704f could not be found. Jul 28 10:40:40.793525 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:40:40.795307 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 546/1106] 10.222.0.46 () {58 vars in 1218 bytes} [Thu Jul 28 10:40:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-635317399 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:40:40.797899 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-05594c31-e262-4173-84cd-0bd43565393f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Returning 404 to user: Instance 5b1d6d0e-deb1-4029-9c03-9aace5e9704f could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:40:40.799560 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-05594c31-e262-4173-84cd-0bd43565393f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1d6d0e-deb1-4029-9c03-9aace5e9704f" status: 404 len: 111 microversion: 2.1 time: 0.099193 Jul 28 10:40:40.800923 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 561/1107] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:40 2022] GET /compute/v2.1/servers/5b1d6d0e-deb1-4029-9c03-9aace5e9704f => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:40:41.197955 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1275767271", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "de534e9f-20e0-4594-9c69-3a8521b239aa"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:40:41.309518 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] validate_networks() for [('de534e9f-20e0-4594-9c69-3a8521b239aa', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:40:41.977081 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:40:41.978345 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:40:41.979014 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:40:41.979646 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:40:41.980205 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:40:42.002142 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:42.002614 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:42.003436 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:42.007687 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:42.075186 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Getting quotas for project 794d085f90504260907001dece2a9a30. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:40:42.093394 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Getting quotas for user f61034f4f0124130a96769efea58b2a9 and project 794d085f90504260907001dece2a9a30. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:40:42.099752 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:42.126309 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:40:42.128954 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 57479647-3ae9-415f-a82b-d824130ff246] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:40:42.217668 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-34a9b041-dd0d-49fa-b490-0f6cd051a81f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.024753 Jul 28 10:40:42.220527 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 547/1108] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:40:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:40:42.233772 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-785ba6c8-2788-4832-b376-768a62f5c97c tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:42.235065 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-785ba6c8-2788-4832-b376-768a62f5c97c tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 57479647-3ae9-415f-a82b-d824130ff246] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:42.500794 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-785ba6c8-2788-4832-b376-768a62f5c97c tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61034f4f0124130a96769efea58b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794d085f90504260907001dece2a9a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:42.509154 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-785ba6c8-2788-4832-b376-768a62f5c97c tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute/v2.1/servers/57479647-3ae9-415f-a82b-d824130ff246" status: 200 len: 1215 microversion: 2.1 time: 0.281164 Jul 28 10:40:42.516024 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 562/1109] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:42 2022] GET /compute/v2.1/servers/57479647-3ae9-415f-a82b-d824130ff246 => generated 1215 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:43.537044 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-74176ef3-29db-48fb-a75f-69157bfdc339 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:43.537666 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-74176ef3-29db-48fb-a75f-69157bfdc339 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 57479647-3ae9-415f-a82b-d824130ff246] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:43.545605 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-74176ef3-29db-48fb-a75f-69157bfdc339 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:43.546098 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-74176ef3-29db-48fb-a75f-69157bfdc339 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:43.546910 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-74176ef3-29db-48fb-a75f-69157bfdc339 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:43.547311 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-74176ef3-29db-48fb-a75f-69157bfdc339 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:43.702232 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-74176ef3-29db-48fb-a75f-69157bfdc339 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:43.703014 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-74176ef3-29db-48fb-a75f-69157bfdc339 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:43.703480 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-74176ef3-29db-48fb-a75f-69157bfdc339 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lazy-loading 'fault' on Instance uuid 57479647-3ae9-415f-a82b-d824130ff246 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:40:43.934737 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-74176ef3-29db-48fb-a75f-69157bfdc339 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61034f4f0124130a96769efea58b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794d085f90504260907001dece2a9a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:43.958210 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-74176ef3-29db-48fb-a75f-69157bfdc339 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute/v2.1/servers/57479647-3ae9-415f-a82b-d824130ff246" status: 200 len: 1288 microversion: 2.1 time: 0.424874 Jul 28 10:40:43.984474 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 548/1110] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:43 2022] GET /compute/v2.1/servers/57479647-3ae9-415f-a82b-d824130ff246 => generated 1288 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:43.993896 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-3ae5b7d7-79a9-4603-a6a6-044b8b026c1f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:43.995698 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-3ae5b7d7-79a9-4603-a6a6-044b8b026c1f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 57479647-3ae9-415f-a82b-d824130ff246] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:44.015871 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3ae5b7d7-79a9-4603-a6a6-044b8b026c1f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:44.016464 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3ae5b7d7-79a9-4603-a6a6-044b8b026c1f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:44.017319 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3ae5b7d7-79a9-4603-a6a6-044b8b026c1f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:44.017749 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3ae5b7d7-79a9-4603-a6a6-044b8b026c1f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:44.092159 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-3ae5b7d7-79a9-4603-a6a6-044b8b026c1f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 57479647-3ae9-415f-a82b-d824130ff246] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:40:44.204758 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-3ae5b7d7-79a9-4603-a6a6-044b8b026c1f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 57479647-3ae9-415f-a82b-d824130ff246] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:40:44.206082 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3ae5b7d7-79a9-4603-a6a6-044b8b026c1f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:44.207026 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3ae5b7d7-79a9-4603-a6a6-044b8b026c1f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:44.207858 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-3ae5b7d7-79a9-4603-a6a6-044b8b026c1f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 57479647-3ae9-415f-a82b-d824130ff246] instance's host None is down, deleting from database Jul 28 10:40:44.212867 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-3ae5b7d7-79a9-4603-a6a6-044b8b026c1f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 57479647-3ae9-415f-a82b-d824130ff246] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:40:44.475656 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-3ae5b7d7-79a9-4603-a6a6-044b8b026c1f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 57479647-3ae9-415f-a82b-d824130ff246] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:40:44.483060 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-3ae5b7d7-79a9-4603-a6a6-044b8b026c1f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 57479647-3ae9-415f-a82b-d824130ff246] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:40:44.917913 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-3ae5b7d7-79a9-4603-a6a6-044b8b026c1f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "DELETE /compute/v2.1/servers/57479647-3ae9-415f-a82b-d824130ff246" status: 204 len: 0 microversion: 2.1 time: 0.927822 Jul 28 10:40:44.919957 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 563/1111] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:40:43 2022] DELETE /compute/v2.1/servers/57479647-3ae9-415f-a82b-d824130ff246 => generated 0 bytes in 931 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:40:44.931008 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d87ccd4d-4ad8-40f5-8595-c3e7b13b2fb1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:44.932570 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-d87ccd4d-4ad8-40f5-8595-c3e7b13b2fb1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 57479647-3ae9-415f-a82b-d824130ff246] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:44.949138 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d87ccd4d-4ad8-40f5-8595-c3e7b13b2fb1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:44.949627 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d87ccd4d-4ad8-40f5-8595-c3e7b13b2fb1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:44.954491 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d87ccd4d-4ad8-40f5-8595-c3e7b13b2fb1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:44.955670 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d87ccd4d-4ad8-40f5-8595-c3e7b13b2fb1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:45.017387 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-d87ccd4d-4ad8-40f5-8595-c3e7b13b2fb1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] HTTP exception thrown: Instance 57479647-3ae9-415f-a82b-d824130ff246 could not be found. Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d87ccd4d-4ad8-40f5-8595-c3e7b13b2fb1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Request method failure captured: Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/57479647-3ae9-415f-a82b-d824130ff246 HTTP/1.1 Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mec8hLqMVihMClpSRkIHbuYQJoqEsjZKw7TxQ6JZdHfbdH89o5o084yukauDFgSpiI3SR-dRNQqBZyizcG2GEDxhptB7-83zk8WxcE1vmiYFGI0vCe8CsAeR0tmE1CuGW9i1K_Vi6y-tuVV9vJQgzMF9XH9APpX5GBRH3f0-VHoBH8 Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 794d085f90504260907001dece2a9a30 Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-DeleteServersTestJSON-709615766 Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/794d085f90504260907001dece2a9a30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/794d085f90504260907001dece2a9a30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/794d085f90504260907001dece2a9a30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_794d085f90504260907001dece2a9a30", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-DeleteServersTestJSON-709615766 Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 794d085f90504260907001dece2a9a30 Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-DeleteServersTestJSON-709615766 Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-DeleteServersTestJSON-709615766-project Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: f61034f4f0124130a96769efea58b2a9 Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-DeleteServersTestJSON-709615766-project Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 57479647-3ae9-415f-a82b-d824130ff246 could not be found. Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '57479647-3ae9-415f-a82b-d824130ff246'} Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57479647-3ae9-415f-a82b-d824130ff246 could not be found. Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57479647-3ae9-415f-a82b-d824130ff246 could not be found. Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:45.020954 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:45.026694 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:45.026694 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:45.026694 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:45.026694 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:40:45.026694 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:40:45.026694 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57479647-3ae9-415f-a82b-d824130ff246 could not be found. Jul 28 10:40:45.026694 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:45.026694 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d87ccd4d-4ad8-40f5-8595-c3e7b13b2fb1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Returning 404 to user: Instance 57479647-3ae9-415f-a82b-d824130ff246 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:40:45.034913 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d87ccd4d-4ad8-40f5-8595-c3e7b13b2fb1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute/v2.1/servers/57479647-3ae9-415f-a82b-d824130ff246" status: 404 len: 111 microversion: 2.1 time: 0.108917 Jul 28 10:40:45.046368 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 549/1112] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:44 2022] GET /compute/v2.1/servers/57479647-3ae9-415f-a82b-d824130ff246 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:40:45.236687 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1930179653", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "de534e9f-20e0-4594-9c69-3a8521b239aa"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:40:45.338858 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] validate_networks() for [('de534e9f-20e0-4594-9c69-3a8521b239aa', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:40:47.308042 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:40:47.308722 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:40:47.309165 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:40:47.309678 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:40:47.310824 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:40:47.329726 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:47.330574 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:47.341329 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:47.343452 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:47.367351 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Getting quotas for project 794d085f90504260907001dece2a9a30. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:40:47.373283 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Getting quotas for user f61034f4f0124130a96769efea58b2a9 and project 794d085f90504260907001dece2a9a30. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:40:47.387482 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:40:47.391221 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 1a54cb89-4148-4b5b-9d4a-447c7af6172f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:40:47.462034 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0acee38f-1ec0-49b9-a64b-e256fc4c42f7 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.229728 Jul 28 10:40:47.463314 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 564/1113] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:40:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:40:47.485435 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-26aa6b9d-d1ee-4eed-95eb-70102918fdc9 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:47.487130 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-26aa6b9d-d1ee-4eed-95eb-70102918fdc9 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 1a54cb89-4148-4b5b-9d4a-447c7af6172f] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:47.820441 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-26aa6b9d-d1ee-4eed-95eb-70102918fdc9 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61034f4f0124130a96769efea58b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794d085f90504260907001dece2a9a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:47.829567 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=47 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:47.836993 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-26aa6b9d-d1ee-4eed-95eb-70102918fdc9 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute/v2.1/servers/1a54cb89-4148-4b5b-9d4a-447c7af6172f" status: 200 len: 1215 microversion: 2.1 time: 0.364952 Jul 28 10:40:47.855240 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 550/1114] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:47 2022] GET /compute/v2.1/servers/1a54cb89-4148-4b5b-9d4a-447c7af6172f => generated 1215 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:48.866649 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e2d08b9b-161d-43e9-8f21-86130467947d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:48.868200 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-e2d08b9b-161d-43e9-8f21-86130467947d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 1a54cb89-4148-4b5b-9d4a-447c7af6172f] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:48.886664 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e2d08b9b-161d-43e9-8f21-86130467947d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:48.887438 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e2d08b9b-161d-43e9-8f21-86130467947d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:48.890754 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e2d08b9b-161d-43e9-8f21-86130467947d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:48.892511 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e2d08b9b-161d-43e9-8f21-86130467947d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:48.978116 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e2d08b9b-161d-43e9-8f21-86130467947d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:48.979797 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e2d08b9b-161d-43e9-8f21-86130467947d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:48.980786 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-e2d08b9b-161d-43e9-8f21-86130467947d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lazy-loading 'fault' on Instance uuid 1a54cb89-4148-4b5b-9d4a-447c7af6172f {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:40:49.068811 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-e2d08b9b-161d-43e9-8f21-86130467947d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61034f4f0124130a96769efea58b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794d085f90504260907001dece2a9a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:49.082105 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e2d08b9b-161d-43e9-8f21-86130467947d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute/v2.1/servers/1a54cb89-4148-4b5b-9d4a-447c7af6172f" status: 200 len: 1288 microversion: 2.1 time: 0.225147 Jul 28 10:40:49.084057 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 565/1115] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:48 2022] GET /compute/v2.1/servers/1a54cb89-4148-4b5b-9d4a-447c7af6172f => generated 1288 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:49.104581 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3132ef6d-528e-466c-a8de-3c31010b2597 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:49.105709 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3132ef6d-528e-466c-a8de-3c31010b2597 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 1a54cb89-4148-4b5b-9d4a-447c7af6172f] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:49.115133 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3132ef6d-528e-466c-a8de-3c31010b2597 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:49.115874 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3132ef6d-528e-466c-a8de-3c31010b2597 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:49.116829 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3132ef6d-528e-466c-a8de-3c31010b2597 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:49.117448 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3132ef6d-528e-466c-a8de-3c31010b2597 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:49.146376 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3132ef6d-528e-466c-a8de-3c31010b2597 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 1a54cb89-4148-4b5b-9d4a-447c7af6172f] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:40:49.276277 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3132ef6d-528e-466c-a8de-3c31010b2597 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 1a54cb89-4148-4b5b-9d4a-447c7af6172f] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:40:49.277448 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3132ef6d-528e-466c-a8de-3c31010b2597 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:49.283134 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3132ef6d-528e-466c-a8de-3c31010b2597 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:49.283847 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-3132ef6d-528e-466c-a8de-3c31010b2597 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 1a54cb89-4148-4b5b-9d4a-447c7af6172f] instance's host None is down, deleting from database Jul 28 10:40:49.300135 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-3132ef6d-528e-466c-a8de-3c31010b2597 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 1a54cb89-4148-4b5b-9d4a-447c7af6172f] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:40:49.384297 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-3132ef6d-528e-466c-a8de-3c31010b2597 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 1a54cb89-4148-4b5b-9d4a-447c7af6172f] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:40:49.395859 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-3132ef6d-528e-466c-a8de-3c31010b2597 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 1a54cb89-4148-4b5b-9d4a-447c7af6172f] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:40:49.705494 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3132ef6d-528e-466c-a8de-3c31010b2597 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1a54cb89-4148-4b5b-9d4a-447c7af6172f" status: 204 len: 0 microversion: 2.1 time: 0.604837 Jul 28 10:40:49.706399 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 551/1116] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:40:49 2022] DELETE /compute/v2.1/servers/1a54cb89-4148-4b5b-9d4a-447c7af6172f => generated 0 bytes in 606 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:40:49.718780 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1816a3d1-f02a-43fa-ac23-500f153b95e1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:49.719722 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-1816a3d1-f02a-43fa-ac23-500f153b95e1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 1a54cb89-4148-4b5b-9d4a-447c7af6172f] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:49.735475 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1816a3d1-f02a-43fa-ac23-500f153b95e1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:49.735854 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1816a3d1-f02a-43fa-ac23-500f153b95e1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:49.746520 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1816a3d1-f02a-43fa-ac23-500f153b95e1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:49.746991 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1816a3d1-f02a-43fa-ac23-500f153b95e1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:49.822037 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-1816a3d1-f02a-43fa-ac23-500f153b95e1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] HTTP exception thrown: Instance 1a54cb89-4148-4b5b-9d4a-447c7af6172f could not be found. Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1816a3d1-f02a-43fa-ac23-500f153b95e1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Request method failure captured: Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/1a54cb89-4148-4b5b-9d4a-447c7af6172f HTTP/1.1 Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mec8hLqMVihMClpSRkIHbuYQJoqEsjZKw7TxQ6JZdHfbdH89o5o084yukauDFgSpiI3SR-dRNQqBZyizcG2GEDxhptB7-83zk8WxcE1vmiYFGI0vCe8CsAeR0tmE1CuGW9i1K_Vi6y-tuVV9vJQgzMF9XH9APpX5GBRH3f0-VHoBH8 Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 794d085f90504260907001dece2a9a30 Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-DeleteServersTestJSON-709615766 Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/794d085f90504260907001dece2a9a30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/794d085f90504260907001dece2a9a30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/794d085f90504260907001dece2a9a30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_794d085f90504260907001dece2a9a30", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-DeleteServersTestJSON-709615766 Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 794d085f90504260907001dece2a9a30 Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-DeleteServersTestJSON-709615766 Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-DeleteServersTestJSON-709615766-project Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: f61034f4f0124130a96769efea58b2a9 Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-DeleteServersTestJSON-709615766-project Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 1a54cb89-4148-4b5b-9d4a-447c7af6172f could not be found. Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '1a54cb89-4148-4b5b-9d4a-447c7af6172f'} Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a54cb89-4148-4b5b-9d4a-447c7af6172f could not be found. Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a54cb89-4148-4b5b-9d4a-447c7af6172f could not be found. Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:49.829911 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:40:49.834330 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:49.834330 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:49.834330 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:49.834330 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:40:49.834330 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:40:49.834330 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a54cb89-4148-4b5b-9d4a-447c7af6172f could not be found. Jul 28 10:40:49.834330 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:40:49.840114 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1816a3d1-f02a-43fa-ac23-500f153b95e1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Returning 404 to user: Instance 1a54cb89-4148-4b5b-9d4a-447c7af6172f could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:40:49.841364 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1816a3d1-f02a-43fa-ac23-500f153b95e1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute/v2.1/servers/1a54cb89-4148-4b5b-9d4a-447c7af6172f" status: 404 len: 111 microversion: 2.1 time: 0.128019 Jul 28 10:40:49.843357 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 566/1117] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:49 2022] GET /compute/v2.1/servers/1a54cb89-4148-4b5b-9d4a-447c7af6172f => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:40:50.176804 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-133356505", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "de534e9f-20e0-4594-9c69-3a8521b239aa"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:40:50.291785 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] validate_networks() for [('de534e9f-20e0-4594-9c69-3a8521b239aa', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:40:52.036106 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=6 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:52.546793 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:40:52.547523 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:40:52.548192 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:40:52.548749 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:40:52.549437 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:40:52.597173 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:52.599366 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:52.602450 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:52.603110 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:52.677029 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Getting quotas for project 794d085f90504260907001dece2a9a30. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:40:52.698443 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Getting quotas for user f61034f4f0124130a96769efea58b2a9 and project 794d085f90504260907001dece2a9a30. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:40:52.772979 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:40:52.783311 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56e56a41-3376-4afe-a6f7-2b7a91cb5908] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:40:52.933234 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-50f9f740-df34-4e46-a85c-b55f6afc2251 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.766305 Jul 28 10:40:52.934294 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 552/1118] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:40:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:40:52.947426 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-40216df4-8611-4e0f-b536-3a339748435a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:52.948828 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-40216df4-8611-4e0f-b536-3a339748435a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56e56a41-3376-4afe-a6f7-2b7a91cb5908] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:54.013640 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-40216df4-8611-4e0f-b536-3a339748435a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61034f4f0124130a96769efea58b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794d085f90504260907001dece2a9a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:54.023801 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-40216df4-8611-4e0f-b536-3a339748435a tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute/v2.1/servers/56e56a41-3376-4afe-a6f7-2b7a91cb5908" status: 200 len: 1214 microversion: 2.1 time: 1.081785 Jul 28 10:40:54.050518 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 567/1119] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:52 2022] GET /compute/v2.1/servers/56e56a41-3376-4afe-a6f7-2b7a91cb5908 => generated 1214 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:55.047206 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c7313565-633e-46f9-9501-38813ad09fee tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:55.048040 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c7313565-633e-46f9-9501-38813ad09fee tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56e56a41-3376-4afe-a6f7-2b7a91cb5908] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:55.085017 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c7313565-633e-46f9-9501-38813ad09fee tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:55.090683 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c7313565-633e-46f9-9501-38813ad09fee tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:55.098637 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c7313565-633e-46f9-9501-38813ad09fee tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:55.099584 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c7313565-633e-46f9-9501-38813ad09fee tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:55.160696 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c7313565-633e-46f9-9501-38813ad09fee tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:55.161227 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c7313565-633e-46f9-9501-38813ad09fee tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:55.161760 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-c7313565-633e-46f9-9501-38813ad09fee tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lazy-loading 'fault' on Instance uuid 56e56a41-3376-4afe-a6f7-2b7a91cb5908 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:40:55.269493 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-c7313565-633e-46f9-9501-38813ad09fee tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61034f4f0124130a96769efea58b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794d085f90504260907001dece2a9a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:55.283597 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c7313565-633e-46f9-9501-38813ad09fee tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute/v2.1/servers/56e56a41-3376-4afe-a6f7-2b7a91cb5908" status: 200 len: 1287 microversion: 2.1 time: 0.242020 Jul 28 10:40:55.284456 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 553/1120] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:55 2022] GET /compute/v2.1/servers/56e56a41-3376-4afe-a6f7-2b7a91cb5908 => generated 1287 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:55.310477 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0aaf626f-891c-4a7f-abd9-972638af257e tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:55.312179 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0aaf626f-891c-4a7f-abd9-972638af257e tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56e56a41-3376-4afe-a6f7-2b7a91cb5908] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:55.329119 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0aaf626f-891c-4a7f-abd9-972638af257e tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:55.332987 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0aaf626f-891c-4a7f-abd9-972638af257e tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:55.338051 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0aaf626f-891c-4a7f-abd9-972638af257e tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:55.338740 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0aaf626f-891c-4a7f-abd9-972638af257e tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:55.401165 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:UPDATE=30,nova_cell0:SELECT=62,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:55.415835 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0aaf626f-891c-4a7f-abd9-972638af257e tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56e56a41-3376-4afe-a6f7-2b7a91cb5908] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:40:55.555761 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0aaf626f-891c-4a7f-abd9-972638af257e tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56e56a41-3376-4afe-a6f7-2b7a91cb5908] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:40:55.557795 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0aaf626f-891c-4a7f-abd9-972638af257e tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:55.558655 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0aaf626f-891c-4a7f-abd9-972638af257e tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:55.559296 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-0aaf626f-891c-4a7f-abd9-972638af257e tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56e56a41-3376-4afe-a6f7-2b7a91cb5908] instance's host None is down, deleting from database Jul 28 10:40:55.564538 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0aaf626f-891c-4a7f-abd9-972638af257e tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56e56a41-3376-4afe-a6f7-2b7a91cb5908] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:40:55.879470 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0aaf626f-891c-4a7f-abd9-972638af257e tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56e56a41-3376-4afe-a6f7-2b7a91cb5908] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:40:55.887353 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0aaf626f-891c-4a7f-abd9-972638af257e tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56e56a41-3376-4afe-a6f7-2b7a91cb5908] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:40:56.226954 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0aaf626f-891c-4a7f-abd9-972638af257e tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "DELETE /compute/v2.1/servers/56e56a41-3376-4afe-a6f7-2b7a91cb5908" status: 204 len: 0 microversion: 2.1 time: 0.921611 Jul 28 10:40:56.228185 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 568/1121] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:40:55 2022] DELETE /compute/v2.1/servers/56e56a41-3376-4afe-a6f7-2b7a91cb5908 => generated 0 bytes in 924 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:40:56.237556 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2d4c4813-5391-4c5d-9ed3-e65b711ff0fe tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:56.239692 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-2d4c4813-5391-4c5d-9ed3-e65b711ff0fe tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 56e56a41-3376-4afe-a6f7-2b7a91cb5908] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:56.255427 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2d4c4813-5391-4c5d-9ed3-e65b711ff0fe tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:56.256529 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2d4c4813-5391-4c5d-9ed3-e65b711ff0fe tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:56.257644 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2d4c4813-5391-4c5d-9ed3-e65b711ff0fe tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:56.261307 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2d4c4813-5391-4c5d-9ed3-e65b711ff0fe tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:56.286614 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-2d4c4813-5391-4c5d-9ed3-e65b711ff0fe tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] HTTP exception thrown: Instance 56e56a41-3376-4afe-a6f7-2b7a91cb5908 could not be found. Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2d4c4813-5391-4c5d-9ed3-e65b711ff0fe tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Request method failure captured: Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/56e56a41-3376-4afe-a6f7-2b7a91cb5908 HTTP/1.1 Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mec8hLqMVihMClpSRkIHbuYQJoqEsjZKw7TxQ6JZdHfbdH89o5o084yukauDFgSpiI3SR-dRNQqBZyizcG2GEDxhptB7-83zk8WxcE1vmiYFGI0vCe8CsAeR0tmE1CuGW9i1K_Vi6y-tuVV9vJQgzMF9XH9APpX5GBRH3f0-VHoBH8 Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 794d085f90504260907001dece2a9a30 Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-DeleteServersTestJSON-709615766 Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/794d085f90504260907001dece2a9a30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/794d085f90504260907001dece2a9a30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/794d085f90504260907001dece2a9a30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_794d085f90504260907001dece2a9a30", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-DeleteServersTestJSON-709615766 Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 794d085f90504260907001dece2a9a30 Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-DeleteServersTestJSON-709615766 Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-DeleteServersTestJSON-709615766-project Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: f61034f4f0124130a96769efea58b2a9 Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-DeleteServersTestJSON-709615766-project Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 56e56a41-3376-4afe-a6f7-2b7a91cb5908 could not be found. Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '56e56a41-3376-4afe-a6f7-2b7a91cb5908'} Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56e56a41-3376-4afe-a6f7-2b7a91cb5908 could not be found. Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56e56a41-3376-4afe-a6f7-2b7a91cb5908 could not be found. Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:40:56.289000 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:56.293122 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:40:56.293122 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:40:56.293122 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:40:56.293122 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:40:56.293122 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:40:56.293122 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56e56a41-3376-4afe-a6f7-2b7a91cb5908 could not be found. Jul 28 10:40:56.293122 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:40:56.296455 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2d4c4813-5391-4c5d-9ed3-e65b711ff0fe tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Returning 404 to user: Instance 56e56a41-3376-4afe-a6f7-2b7a91cb5908 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:40:56.297605 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-2d4c4813-5391-4c5d-9ed3-e65b711ff0fe tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute/v2.1/servers/56e56a41-3376-4afe-a6f7-2b7a91cb5908" status: 404 len: 111 microversion: 2.1 time: 0.064248 Jul 28 10:40:56.298729 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 554/1122] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:56 2022] GET /compute/v2.1/servers/56e56a41-3376-4afe-a6f7-2b7a91cb5908 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:40:56.483956 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1226467958", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "de534e9f-20e0-4594-9c69-3a8521b239aa"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:40:56.648929 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] validate_networks() for [('de534e9f-20e0-4594-9c69-3a8521b239aa', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:40:57.358107 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=3 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:40:57.977060 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:40:57.978126 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:40:57.979292 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:40:57.979973 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:40:57.980623 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:40:58.001065 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:58.002045 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:58.003247 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:58.006028 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:58.051903 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Getting quotas for project 794d085f90504260907001dece2a9a30. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:40:58.063863 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Getting quotas for user f61034f4f0124130a96769efea58b2a9 and project 794d085f90504260907001dece2a9a30. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:40:58.098670 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:40:58.104634 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: aa4c3239-2aa3-44a1-a37f-63b815d4cba6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:40:58.197105 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b97c20e8-de67-45b6-8610-dca0d5f723c1 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.725408 Jul 28 10:40:58.199304 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 569/1123] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:40:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:40:58.213317 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-548b0030-85f7-4355-9f82-d7b47246b18d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:58.214748 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-548b0030-85f7-4355-9f82-d7b47246b18d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: aa4c3239-2aa3-44a1-a37f-63b815d4cba6] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:58.583550 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-548b0030-85f7-4355-9f82-d7b47246b18d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61034f4f0124130a96769efea58b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794d085f90504260907001dece2a9a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:58.597160 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-548b0030-85f7-4355-9f82-d7b47246b18d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute/v2.1/servers/aa4c3239-2aa3-44a1-a37f-63b815d4cba6" status: 200 len: 1215 microversion: 2.1 time: 0.390342 Jul 28 10:40:58.598104 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 555/1124] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:58 2022] GET /compute/v2.1/servers/aa4c3239-2aa3-44a1-a37f-63b815d4cba6 => generated 1215 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:40:59.630203 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-75f49fbc-b93c-40c6-82a6-7ff50f1b01ae tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:59.631965 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-75f49fbc-b93c-40c6-82a6-7ff50f1b01ae tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: aa4c3239-2aa3-44a1-a37f-63b815d4cba6] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:40:59.649383 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-75f49fbc-b93c-40c6-82a6-7ff50f1b01ae tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:59.650075 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-75f49fbc-b93c-40c6-82a6-7ff50f1b01ae tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:59.654544 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-75f49fbc-b93c-40c6-82a6-7ff50f1b01ae tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:59.655197 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-75f49fbc-b93c-40c6-82a6-7ff50f1b01ae tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:59.756572 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-75f49fbc-b93c-40c6-82a6-7ff50f1b01ae tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:40:59.758085 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-75f49fbc-b93c-40c6-82a6-7ff50f1b01ae tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:40:59.758388 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-75f49fbc-b93c-40c6-82a6-7ff50f1b01ae tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lazy-loading 'fault' on Instance uuid aa4c3239-2aa3-44a1-a37f-63b815d4cba6 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:40:59.885610 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-75f49fbc-b93c-40c6-82a6-7ff50f1b01ae tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61034f4f0124130a96769efea58b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794d085f90504260907001dece2a9a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:59.897485 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-75f49fbc-b93c-40c6-82a6-7ff50f1b01ae tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute/v2.1/servers/aa4c3239-2aa3-44a1-a37f-63b815d4cba6" status: 200 len: 1288 microversion: 2.1 time: 0.271295 Jul 28 10:40:59.898663 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 570/1125] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:40:59 2022] GET /compute/v2.1/servers/aa4c3239-2aa3-44a1-a37f-63b815d4cba6 => generated 1288 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:00.538185 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-90f4f525-9ce2-4578-9135-798c1fef2ac0 tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] Action: 'create', calling method: .version_select at 0x7fa94bc73550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1805901790", "metadata": {"Type": "work"}}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:00.556467 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e3e100fd-8e5f-4a8b-bdee-63cd76fbeb5c tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Action: 'create', calling method: .version_select at 0x7fa94bc00e50>, body: {"keypair": {"name": "tempest-keypair-1325086009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkpNeHLGV1ujXPmff18wsd2CKCqdnld6gSsKCITL5PdC4NpQPgeO+qCqBgi82fYRodhmvIFGv6/dFCK8Omx4JWKORnsw7xNQR4fQzGUw2WTGU956ieSxW84k6uCTfVOlA=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:00.608704 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-e3e100fd-8e5f-4a8b-bdee-63cd76fbeb5c tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Getting quotas for project 837d8bf564654ede973e1598e0fca3d6. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:41:00.631090 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-e3e100fd-8e5f-4a8b-bdee-63cd76fbeb5c tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Getting quotas for user f20c3590b80a44549ae5c05d1c86feb6 and project 837d8bf564654ede973e1598e0fca3d6. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:41:00.745621 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e3e100fd-8e5f-4a8b-bdee-63cd76fbeb5c tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.844875 Jul 28 10:41:00.746260 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 571/1126] 10.222.0.46 () {62 vars in 1200 bytes} [Thu Jul 28 10:40:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 846 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 10:41:00.758218 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c70cf66f-c8f1-43fd-a77b-649eb25b5f7f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:00.758816 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c70cf66f-c8f1-43fd-a77b-649eb25b5f7f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: aa4c3239-2aa3-44a1-a37f-63b815d4cba6] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:41:00.789907 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c70cf66f-c8f1-43fd-a77b-649eb25b5f7f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:00.792774 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c70cf66f-c8f1-43fd-a77b-649eb25b5f7f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:00.795518 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c70cf66f-c8f1-43fd-a77b-649eb25b5f7f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:00.800991 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c70cf66f-c8f1-43fd-a77b-649eb25b5f7f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:00.890755 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c70cf66f-c8f1-43fd-a77b-649eb25b5f7f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: aa4c3239-2aa3-44a1-a37f-63b815d4cba6] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:41:01.030004 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c70cf66f-c8f1-43fd-a77b-649eb25b5f7f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: aa4c3239-2aa3-44a1-a37f-63b815d4cba6] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:41:01.032518 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c70cf66f-c8f1-43fd-a77b-649eb25b5f7f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:01.033166 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c70cf66f-c8f1-43fd-a77b-649eb25b5f7f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:01.033952 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-c70cf66f-c8f1-43fd-a77b-649eb25b5f7f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: aa4c3239-2aa3-44a1-a37f-63b815d4cba6] instance's host None is down, deleting from database Jul 28 10:41:01.041247 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-c70cf66f-c8f1-43fd-a77b-649eb25b5f7f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: aa4c3239-2aa3-44a1-a37f-63b815d4cba6] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:41:01.165377 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-c70cf66f-c8f1-43fd-a77b-649eb25b5f7f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: aa4c3239-2aa3-44a1-a37f-63b815d4cba6] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:41:01.173043 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-c70cf66f-c8f1-43fd-a77b-649eb25b5f7f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: aa4c3239-2aa3-44a1-a37f-63b815d4cba6] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:41:01.452240 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=4,nova_api:INSERT=7 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:01.538295 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-90f4f525-9ce2-4578-9135-798c1fef2ac0 tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.722388 Jul 28 10:41:01.538929 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 556/1127] 10.222.0.46 () {60 vars in 1156 bytes} [Thu Jul 28 10:40:59 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1724 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 10:41:01.554119 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6c15b813-ed1a-46f6-a596-c8c1d87021a0 tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] Calling method '.version_select at 0x7fa94bebc040>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:01.704419 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c70cf66f-c8f1-43fd-a77b-649eb25b5f7f tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "DELETE /compute/v2.1/servers/aa4c3239-2aa3-44a1-a37f-63b815d4cba6" status: 204 len: 0 microversion: 2.1 time: 0.956389 Jul 28 10:41:01.706270 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 572/1128] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:41:00 2022] DELETE /compute/v2.1/servers/aa4c3239-2aa3-44a1-a37f-63b815d4cba6 => generated 0 bytes in 959 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:41:01.740083 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-54477bc8-d88a-45f0-8b2b-d1fba947827d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:01.743018 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-54477bc8-d88a-45f0-8b2b-d1fba947827d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: aa4c3239-2aa3-44a1-a37f-63b815d4cba6] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:41:01.756225 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6c15b813-ed1a-46f6-a596-c8c1d87021a0 tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/938dcc56-f23b-4050-8131-232817d42455" status: 200 len: 353 microversion: 2.1 time: 0.207721 Jul 28 10:41:01.756760 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 557/1129] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:41:01 2022] GET /compute/v2.1/os-volumes/938dcc56-f23b-4050-8131-232817d42455 => generated 353 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:41:01.773241 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-54477bc8-d88a-45f0-8b2b-d1fba947827d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:01.773707 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-54477bc8-d88a-45f0-8b2b-d1fba947827d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:01.777057 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-54477bc8-d88a-45f0-8b2b-d1fba947827d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:01.780637 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-54477bc8-d88a-45f0-8b2b-d1fba947827d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:01.829432 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-54477bc8-d88a-45f0-8b2b-d1fba947827d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] HTTP exception thrown: Instance aa4c3239-2aa3-44a1-a37f-63b815d4cba6 could not be found. Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-54477bc8-d88a-45f0-8b2b-d1fba947827d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Request method failure captured: Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/aa4c3239-2aa3-44a1-a37f-63b815d4cba6 HTTP/1.1 Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mec8hLqMVihMClpSRkIHbuYQJoqEsjZKw7TxQ6JZdHfbdH89o5o084yukauDFgSpiI3SR-dRNQqBZyizcG2GEDxhptB7-83zk8WxcE1vmiYFGI0vCe8CsAeR0tmE1CuGW9i1K_Vi6y-tuVV9vJQgzMF9XH9APpX5GBRH3f0-VHoBH8 Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 794d085f90504260907001dece2a9a30 Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-DeleteServersTestJSON-709615766 Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/794d085f90504260907001dece2a9a30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/794d085f90504260907001dece2a9a30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/794d085f90504260907001dece2a9a30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_794d085f90504260907001dece2a9a30", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-DeleteServersTestJSON-709615766 Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 794d085f90504260907001dece2a9a30 Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-DeleteServersTestJSON-709615766 Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-DeleteServersTestJSON-709615766-project Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: f61034f4f0124130a96769efea58b2a9 Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-DeleteServersTestJSON-709615766-project Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance aa4c3239-2aa3-44a1-a37f-63b815d4cba6 could not be found. Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'aa4c3239-2aa3-44a1-a37f-63b815d4cba6'} Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa4c3239-2aa3-44a1-a37f-63b815d4cba6 could not be found. Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa4c3239-2aa3-44a1-a37f-63b815d4cba6 could not be found. Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:01.832369 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:01.837733 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:01.837733 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:01.837733 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:01.837733 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:41:01.837733 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:41:01.837733 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa4c3239-2aa3-44a1-a37f-63b815d4cba6 could not be found. Jul 28 10:41:01.837733 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:01.843539 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-54477bc8-d88a-45f0-8b2b-d1fba947827d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Returning 404 to user: Instance aa4c3239-2aa3-44a1-a37f-63b815d4cba6 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:41:01.844978 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-54477bc8-d88a-45f0-8b2b-d1fba947827d tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute/v2.1/servers/aa4c3239-2aa3-44a1-a37f-63b815d4cba6" status: 404 len: 111 microversion: 2.1 time: 0.134353 Jul 28 10:41:01.853774 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 573/1130] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:41:01 2022] GET /compute/v2.1/servers/aa4c3239-2aa3-44a1-a37f-63b815d4cba6 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:41:01.860770 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7f381f69-8b1c-448c-923f-23be96ce8203 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:01.861075 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-7f381f69-8b1c-448c-923f-23be96ce8203 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 5b1d6d0e-deb1-4029-9c03-9aace5e9704f] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:41:01.875624 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7f381f69-8b1c-448c-923f-23be96ce8203 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:01.876731 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7f381f69-8b1c-448c-923f-23be96ce8203 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:01.878358 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7f381f69-8b1c-448c-923f-23be96ce8203 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:01.878920 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7f381f69-8b1c-448c-923f-23be96ce8203 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:01.911174 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-7f381f69-8b1c-448c-923f-23be96ce8203 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] HTTP exception thrown: Instance 5b1d6d0e-deb1-4029-9c03-9aace5e9704f could not be found. Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7f381f69-8b1c-448c-923f-23be96ce8203 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Request method failure captured: Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: request: DELETE /compute/v2.1/servers/5b1d6d0e-deb1-4029-9c03-9aace5e9704f HTTP/1.1 Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mec8hLqMVihMClpSRkIHbuYQJoqEsjZKw7TxQ6JZdHfbdH89o5o084yukauDFgSpiI3SR-dRNQqBZyizcG2GEDxhptB7-83zk8WxcE1vmiYFGI0vCe8CsAeR0tmE1CuGW9i1K_Vi6y-tuVV9vJQgzMF9XH9APpX5GBRH3f0-VHoBH8 Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 794d085f90504260907001dece2a9a30 Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-DeleteServersTestJSON-709615766 Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/794d085f90504260907001dece2a9a30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/794d085f90504260907001dece2a9a30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/794d085f90504260907001dece2a9a30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_794d085f90504260907001dece2a9a30", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-DeleteServersTestJSON-709615766 Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 794d085f90504260907001dece2a9a30 Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-DeleteServersTestJSON-709615766 Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-DeleteServersTestJSON-709615766-project Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: f61034f4f0124130a96769efea58b2a9 Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-DeleteServersTestJSON-709615766-project Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 5b1d6d0e-deb1-4029-9c03-9aace5e9704f could not be found. Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '5b1d6d0e-deb1-4029-9c03-9aace5e9704f'} Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b1d6d0e-deb1-4029-9c03-9aace5e9704f could not be found. Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:41:01.913167 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:41:01.917007 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b1d6d0e-deb1-4029-9c03-9aace5e9704f could not be found. Jul 28 10:41:01.917007 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:01.917007 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:01.917007 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:01.917007 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:01.917007 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:01.917007 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:01.917007 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:41:01.917007 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:41:01.917007 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b1d6d0e-deb1-4029-9c03-9aace5e9704f could not be found. Jul 28 10:41:01.917007 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:01.917007 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7f381f69-8b1c-448c-923f-23be96ce8203 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Returning 404 to user: Instance 5b1d6d0e-deb1-4029-9c03-9aace5e9704f could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:41:01.917007 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-7f381f69-8b1c-448c-923f-23be96ce8203 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5b1d6d0e-deb1-4029-9c03-9aace5e9704f" status: 404 len: 111 microversion: 2.1 time: 0.060318 Jul 28 10:41:01.921735 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 558/1131] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:41:01 2022] DELETE /compute/v2.1/servers/5b1d6d0e-deb1-4029-9c03-9aace5e9704f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:41:01.926060 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-226f144e-b104-4cf6-a04b-5ecec5060b87 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:01.926952 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-226f144e-b104-4cf6-a04b-5ecec5060b87 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] [instance: 5b1d6d0e-deb1-4029-9c03-9aace5e9704f] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:41:01.933913 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-226f144e-b104-4cf6-a04b-5ecec5060b87 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:01.940718 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-226f144e-b104-4cf6-a04b-5ecec5060b87 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:01.943430 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-226f144e-b104-4cf6-a04b-5ecec5060b87 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:01.944181 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-226f144e-b104-4cf6-a04b-5ecec5060b87 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:01.978353 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-226f144e-b104-4cf6-a04b-5ecec5060b87 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] HTTP exception thrown: Instance 5b1d6d0e-deb1-4029-9c03-9aace5e9704f could not be found. Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-226f144e-b104-4cf6-a04b-5ecec5060b87 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Request method failure captured: Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/5b1d6d0e-deb1-4029-9c03-9aace5e9704f HTTP/1.1 Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mec8hLqMVihMClpSRkIHbuYQJoqEsjZKw7TxQ6JZdHfbdH89o5o084yukauDFgSpiI3SR-dRNQqBZyizcG2GEDxhptB7-83zk8WxcE1vmiYFGI0vCe8CsAeR0tmE1CuGW9i1K_Vi6y-tuVV9vJQgzMF9XH9APpX5GBRH3f0-VHoBH8 Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 794d085f90504260907001dece2a9a30 Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-DeleteServersTestJSON-709615766 Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/794d085f90504260907001dece2a9a30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/794d085f90504260907001dece2a9a30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/794d085f90504260907001dece2a9a30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_794d085f90504260907001dece2a9a30", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-DeleteServersTestJSON-709615766 Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 794d085f90504260907001dece2a9a30 Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-DeleteServersTestJSON-709615766 Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-DeleteServersTestJSON-709615766-project Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: f61034f4f0124130a96769efea58b2a9 Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-DeleteServersTestJSON-709615766-project Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 5b1d6d0e-deb1-4029-9c03-9aace5e9704f could not be found. Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '5b1d6d0e-deb1-4029-9c03-9aace5e9704f'} Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b1d6d0e-deb1-4029-9c03-9aace5e9704f could not be found. Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b1d6d0e-deb1-4029-9c03-9aace5e9704f could not be found. Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:01.984751 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:01.988515 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:01.988515 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:01.988515 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:01.988515 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:41:01.988515 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:41:01.988515 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b1d6d0e-deb1-4029-9c03-9aace5e9704f could not be found. Jul 28 10:41:01.988515 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:01.990571 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-226f144e-b104-4cf6-a04b-5ecec5060b87 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] Returning 404 to user: Instance 5b1d6d0e-deb1-4029-9c03-9aace5e9704f could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:41:01.991682 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-226f144e-b104-4cf6-a04b-5ecec5060b87 tempest-DeleteServersTestJSON-709615766 tempest-DeleteServersTestJSON-709615766-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1d6d0e-deb1-4029-9c03-9aace5e9704f" status: 404 len: 111 microversion: 2.1 time: 0.069871 Jul 28 10:41:01.994625 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 574/1132] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:41:01 2022] GET /compute/v2.1/servers/5b1d6d0e-deb1-4029-9c03-9aace5e9704f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:41:02.773642 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-950d80c7-2b90-4753-a779-335ccec95d5f tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] Calling method '.version_select at 0x7fa94bde13a0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:02.835443 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:02.948617 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-950d80c7-2b90-4753-a779-335ccec95d5f tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/938dcc56-f23b-4050-8131-232817d42455" status: 200 len: 353 microversion: 2.1 time: 0.181543 Jul 28 10:41:02.949721 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 559/1133] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:41:02 2022] GET /compute/v2.1/os-volumes/938dcc56-f23b-4050-8131-232817d42455 => generated 353 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:41:03.965791 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fb83e074-6cf8-4eab-a29f-2258e98b2c0f tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] Calling method '.version_select at 0x7fa94b90d4c0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:04.089897 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-fb83e074-6cf8-4eab-a29f-2258e98b2c0f tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/938dcc56-f23b-4050-8131-232817d42455" status: 200 len: 353 microversion: 2.1 time: 0.128736 Jul 28 10:41:04.096884 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 575/1134] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:41:03 2022] GET /compute/v2.1/os-volumes/938dcc56-f23b-4050-8131-232817d42455 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:41:05.116263 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-193baa4e-d34f-4315-80a5-6e43742fb27f tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] Calling method '.version_select at 0x7fa94bc73af0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:05.287158 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-193baa4e-d34f-4315-80a5-6e43742fb27f tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/938dcc56-f23b-4050-8131-232817d42455" status: 200 len: 354 microversion: 2.1 time: 0.186370 Jul 28 10:41:05.288928 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 560/1135] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:41:05 2022] GET /compute/v2.1/os-volumes/938dcc56-f23b-4050-8131-232817d42455 => generated 354 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:41:05.302450 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ac9034f0-3423-4cd1-92dc-4eac0dd79eb6 tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] Calling method '.version_select at 0x7fa94bc39b80>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:05.505074 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ac9034f0-3423-4cd1-92dc-4eac0dd79eb6 tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/938dcc56-f23b-4050-8131-232817d42455" status: 200 len: 354 microversion: 2.1 time: 0.206382 Jul 28 10:41:05.505870 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 576/1136] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:41:05 2022] GET /compute/v2.1/os-volumes/938dcc56-f23b-4050-8131-232817d42455 => generated 354 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:41:05.520920 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-19b57713-d470-4982-9f85-9350f2fd113b tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] Calling method '.version_select at 0x7fa94ba618b0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:06.087835 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-19b57713-d470-4982-9f85-9350f2fd113b tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/938dcc56-f23b-4050-8131-232817d42455" status: 202 len: 0 microversion: 2.1 time: 0.571454 Jul 28 10:41:06.088421 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 561/1137] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Jul 28 10:41:05 2022] DELETE /compute/v2.1/os-volumes/938dcc56-f23b-4050-8131-232817d42455 => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:41:06.099246 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ac5c68d2-dadd-4418-9264-87c5f64c41d5 tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] Calling method '.version_select at 0x7fa94b9d8160>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:06.206564 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ac5c68d2-dadd-4418-9264-87c5f64c41d5 tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/938dcc56-f23b-4050-8131-232817d42455" status: 200 len: 353 microversion: 2.1 time: 0.113304 Jul 28 10:41:06.208426 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 577/1138] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:41:06 2022] GET /compute/v2.1/os-volumes/938dcc56-f23b-4050-8131-232817d42455 => generated 353 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:41:07.229371 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a9689123-18aa-4fd8-8456-c64de94de227 tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] Calling method '.version_select at 0x7fa9582b2280>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:07.343448 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a9689123-18aa-4fd8-8456-c64de94de227 tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/938dcc56-f23b-4050-8131-232817d42455" status: 200 len: 353 microversion: 2.1 time: 0.125530 Jul 28 10:41:07.344403 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 562/1139] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:41:07 2022] GET /compute/v2.1/os-volumes/938dcc56-f23b-4050-8131-232817d42455 => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:41:07.778718 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-244001236", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c2cbf7b7-6945-4278-9e95-210df42bf84c"}], "security_groups": [{"name": "tempest-securitygroup--967093856"}], "key_name": "tempest-keypair-1325086009", "user_data": "}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:08.026208 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:08.155154 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] validate_networks() for [('c2cbf7b7-6945-4278-9e95-210df42bf84c', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:41:08.358071 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0c5ade87-f2b5-44f2-a951-4bc2bcaae193 tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] Calling method '.version_select at 0x7fa94bda0670>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:08.520736 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-0c5ade87-f2b5-44f2-a951-4bc2bcaae193 tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/938dcc56-f23b-4050-8131-232817d42455" status: 200 len: 353 microversion: 2.1 time: 0.167792 Jul 28 10:41:08.526798 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 563/1140] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:41:08 2022] GET /compute/v2.1/os-volumes/938dcc56-f23b-4050-8131-232817d42455 => generated 353 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:41:09.535696 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5d8e2154-9c83-45d9-8206-875378ce4dda tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] Calling method '.version_select at 0x7fa94bda0f70>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:09.541840 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=9 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:09.713448 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-5d8e2154-9c83-45d9-8206-875378ce4dda tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/938dcc56-f23b-4050-8131-232817d42455" status: 200 len: 353 microversion: 2.1 time: 0.182154 Jul 28 10:41:09.714402 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 564/1141] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:41:09 2022] GET /compute/v2.1/os-volumes/938dcc56-f23b-4050-8131-232817d42455 => generated 353 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:41:09.785151 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:41:09.786627 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:41:09.787214 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:41:09.787780 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:41:09.788534 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:41:09.803568 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=35,nova_cell0:UPDATE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:09.818151 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:09.818812 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:09.819817 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:09.822793 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:09.868075 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Getting quotas for project 837d8bf564654ede973e1598e0fca3d6. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:41:09.875633 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Getting quotas for user f20c3590b80a44549ae5c05d1c86feb6 and project 837d8bf564654ede973e1598e0fca3d6. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:41:09.912727 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:41:09.922562 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 48f79788-755b-4d86-8832-776e3a820a63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:41:10.004995 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-6301f8e3-96cb-4a48-a7bc-aa8612934625 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.230655 Jul 28 10:41:10.012166 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 578/1142] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Jul 28 10:41:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 2233 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 10:41:10.019382 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-50f66235-bd87-4538-8564-9695d7067b25 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:10.020011 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-50f66235-bd87-4538-8564-9695d7067b25 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 48f79788-755b-4d86-8832-776e3a820a63] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:41:10.167542 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-50f66235-bd87-4538-8564-9695d7067b25 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20c3590b80a44549ae5c05d1c86feb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837d8bf564654ede973e1598e0fca3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:10.182793 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-50f66235-bd87-4538-8564-9695d7067b25 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f20c3590b80a44549ae5c05d1c86feb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837d8bf564654ede973e1598e0fca3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:10.184714 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-50f66235-bd87-4538-8564-9695d7067b25 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f20c3590b80a44549ae5c05d1c86feb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837d8bf564654ede973e1598e0fca3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:10.196455 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-50f66235-bd87-4538-8564-9695d7067b25 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] 10.222.0.46 "GET /compute/v2.1/servers/48f79788-755b-4d86-8832-776e3a820a63" status: 200 len: 1281 microversion: 2.20 time: 0.182300 Jul 28 10:41:10.199450 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 565/1143] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:41:10 2022] GET /compute/v2.1/servers/48f79788-755b-4d86-8832-776e3a820a63 => generated 1281 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:41:10.730749 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d142fd45-8f82-4a6b-82a2-acb59d3fe61b tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] Calling method '.version_select at 0x7fa94bc73c10>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:10.786856 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-d142fd45-8f82-4a6b-82a2-acb59d3fe61b tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] HTTP exception thrown: Volume 938dcc56-f23b-4050-8131-232817d42455 could not be found. Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d142fd45-8f82-4a6b-82a2-acb59d3fe61b tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] Request method failure captured: Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/os-volumes/938dcc56-f23b-4050-8131-232817d42455 HTTP/1.1 Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4me7XIfq7-siAxs-51vcpbF2k2pnkxNYeHHJ9Rg0f8WdwcGxOVP25l9uRfVk9zja3TBD769504iBaRxSSX_QXZz2JY_-apSkgGjOgrQKZGn2ar6TXvCTdXbuptAyxOTtqqfBn_wr-g6zyzO5MlZuLeJ9RLo_jZocOJ8bwL-ynB-DVjM Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: e374fd18421b40c1862927a0dda4c09d Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-VolumesGetTestJSON-1132653810 Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e374fd18421b40c1862927a0dda4c09d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e374fd18421b40c1862927a0dda4c09d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e374fd18421b40c1862927a0dda4c09d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e374fd18421b40c1862927a0dda4c09d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-VolumesGetTestJSON-1132653810 Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: e374fd18421b40c1862927a0dda4c09d Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-VolumesGetTestJSON-1132653810 Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-VolumesGetTestJSON-1132653810-project Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: aeb390ebcc194100a2d2440dfa91f252 Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-VolumesGetTestJSON-1132653810-project Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: exception: Volume 938dcc56-f23b-4050-8131-232817d42455 could not be found. Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '938dcc56-f23b-4050-8131-232817d42455'} Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 938dcc56-f23b-4050-8131-232817d42455 could not be found. (HTTP 404) (Request-ID: req-00ed9d93-de01-41f4-baf2-ba9f17810c2a) Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 10:41:10.802716 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 938dcc56-f23b-4050-8131-232817d42455 could not be found. Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 938dcc56-f23b-4050-8131-232817d42455 could not be found. Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 938dcc56-f23b-4050-8131-232817d42455 could not be found. Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d142fd45-8f82-4a6b-82a2-acb59d3fe61b tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] Returning 404 to user: Volume 938dcc56-f23b-4050-8131-232817d42455 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-d142fd45-8f82-4a6b-82a2-acb59d3fe61b tempest-VolumesGetTestJSON-1132653810 tempest-VolumesGetTestJSON-1132653810-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/938dcc56-f23b-4050-8131-232817d42455" status: 404 len: 109 microversion: 2.1 time: 0.080261 Jul 28 10:41:10.808180 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 579/1144] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:41:10 2022] GET /compute/v2.1/os-volumes/938dcc56-f23b-4050-8131-232817d42455 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:41:11.220777 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f09d5002-c671-4241-be87-48965d2bd9e2 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:11.221568 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f09d5002-c671-4241-be87-48965d2bd9e2 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 48f79788-755b-4d86-8832-776e3a820a63] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:41:11.251025 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f09d5002-c671-4241-be87-48965d2bd9e2 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:11.253179 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f09d5002-c671-4241-be87-48965d2bd9e2 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:11.256354 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f09d5002-c671-4241-be87-48965d2bd9e2 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:11.263907 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f09d5002-c671-4241-be87-48965d2bd9e2 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:11.327411 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:UPDATE=20,nova_cell0:DELETE=4,nova_cell0:SELECT=53,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:11.369808 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f09d5002-c671-4241-be87-48965d2bd9e2 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:11.371068 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f09d5002-c671-4241-be87-48965d2bd9e2 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:11.371560 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-f09d5002-c671-4241-be87-48965d2bd9e2 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lazy-loading 'fault' on Instance uuid 48f79788-755b-4d86-8832-776e3a820a63 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:41:11.540331 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-f09d5002-c671-4241-be87-48965d2bd9e2 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20c3590b80a44549ae5c05d1c86feb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837d8bf564654ede973e1598e0fca3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:11.574987 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-f09d5002-c671-4241-be87-48965d2bd9e2 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f20c3590b80a44549ae5c05d1c86feb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837d8bf564654ede973e1598e0fca3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:11.583721 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-f09d5002-c671-4241-be87-48965d2bd9e2 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f20c3590b80a44549ae5c05d1c86feb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837d8bf564654ede973e1598e0fca3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:11.585312 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f09d5002-c671-4241-be87-48965d2bd9e2 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] 10.222.0.46 "GET /compute/v2.1/servers/48f79788-755b-4d86-8832-776e3a820a63" status: 200 len: 1354 microversion: 2.20 time: 0.369730 Jul 28 10:41:11.610633 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 566/1145] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:41:11 2022] GET /compute/v2.1/servers/48f79788-755b-4d86-8832-776e3a820a63 => generated 1354 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:41:11.625059 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-33f94106-9bc5-4097-807f-3d0354dfdfda tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:11.640914 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-33f94106-9bc5-4097-807f-3d0354dfdfda tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 48f79788-755b-4d86-8832-776e3a820a63] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:41:11.651168 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-33f94106-9bc5-4097-807f-3d0354dfdfda tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:11.652480 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-33f94106-9bc5-4097-807f-3d0354dfdfda tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:11.653732 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-33f94106-9bc5-4097-807f-3d0354dfdfda tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:11.654511 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-33f94106-9bc5-4097-807f-3d0354dfdfda tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:11.660471 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=62,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:11.707436 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-33f94106-9bc5-4097-807f-3d0354dfdfda tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 48f79788-755b-4d86-8832-776e3a820a63] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:41:11.839920 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-33f94106-9bc5-4097-807f-3d0354dfdfda tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 48f79788-755b-4d86-8832-776e3a820a63] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:41:11.844331 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-33f94106-9bc5-4097-807f-3d0354dfdfda tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:11.844793 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-33f94106-9bc5-4097-807f-3d0354dfdfda tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:11.845604 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-33f94106-9bc5-4097-807f-3d0354dfdfda tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 48f79788-755b-4d86-8832-776e3a820a63] instance's host None is down, deleting from database Jul 28 10:41:11.853058 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-33f94106-9bc5-4097-807f-3d0354dfdfda tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 48f79788-755b-4d86-8832-776e3a820a63] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:41:12.111129 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-33f94106-9bc5-4097-807f-3d0354dfdfda tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 48f79788-755b-4d86-8832-776e3a820a63] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:41:12.123653 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-33f94106-9bc5-4097-807f-3d0354dfdfda tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 48f79788-755b-4d86-8832-776e3a820a63] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:41:12.461490 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-33f94106-9bc5-4097-807f-3d0354dfdfda tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] 10.222.0.46 "DELETE /compute/v2.1/servers/48f79788-755b-4d86-8832-776e3a820a63" status: 204 len: 0 microversion: 2.20 time: 0.849780 Jul 28 10:41:12.462711 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 580/1146] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:41:11 2022] DELETE /compute/v2.1/servers/48f79788-755b-4d86-8832-776e3a820a63 => generated 0 bytes in 855 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:41:12.472638 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-90ea7f19-67fc-4534-9633-569c845984a7 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:12.473260 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-90ea7f19-67fc-4534-9633-569c845984a7 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 48f79788-755b-4d86-8832-776e3a820a63] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:41:12.486983 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-90ea7f19-67fc-4534-9633-569c845984a7 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:12.487689 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-90ea7f19-67fc-4534-9633-569c845984a7 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:12.506500 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-90ea7f19-67fc-4534-9633-569c845984a7 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:12.506991 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-90ea7f19-67fc-4534-9633-569c845984a7 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:12.559366 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-90ea7f19-67fc-4534-9633-569c845984a7 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] HTTP exception thrown: Instance 48f79788-755b-4d86-8832-776e3a820a63 could not be found. Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-90ea7f19-67fc-4534-9633-569c845984a7 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Request method failure captured: Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/48f79788-755b-4d86-8832-776e3a820a63 HTTP/1.1 Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4me7WweCcu8DT6hLtBnMwv9RGfRagW4tSIZFku4G1URrlcsuM8__xyABOUpKB7hMRd2y_anODtpb4Tzw-10UTr8FW1Qer6EEwhxTJyK-AqSd6X536wqwqNESeql8lkPZ9zegUu8gsMKHfXUfC05Ct_kiczJplXbfb-0J15awAf85OjM Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 837d8bf564654ede973e1598e0fca3d6 Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1763370157 Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/837d8bf564654ede973e1598e0fca3d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/837d8bf564654ede973e1598e0fca3d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/837d8bf564654ede973e1598e0fca3d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_837d8bf564654ede973e1598e0fca3d6", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1763370157 Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 837d8bf564654ede973e1598e0fca3d6 Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1763370157 Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-AttachVolumeShelveTestJSON-1763370157-project Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: f20c3590b80a44549ae5c05d1c86feb6 Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1763370157-project Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 48f79788-755b-4d86-8832-776e3a820a63 could not be found. Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '48f79788-755b-4d86-8832-776e3a820a63'} Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f79788-755b-4d86-8832-776e3a820a63 could not be found. Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f79788-755b-4d86-8832-776e3a820a63 could not be found. Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:12.562196 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:12.567072 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:12.567072 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:12.567072 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:12.567072 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:12.567072 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:41:12.567072 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:41:12.567072 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f79788-755b-4d86-8832-776e3a820a63 could not be found. Jul 28 10:41:12.567072 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:12.567072 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-90ea7f19-67fc-4534-9633-569c845984a7 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Returning 404 to user: Instance 48f79788-755b-4d86-8832-776e3a820a63 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:41:12.567072 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-90ea7f19-67fc-4534-9633-569c845984a7 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] 10.222.0.46 "GET /compute/v2.1/servers/48f79788-755b-4d86-8832-776e3a820a63" status: 404 len: 111 microversion: 2.20 time: 0.096926 Jul 28 10:41:12.567072 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 567/1147] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:41:12 2022] GET /compute/v2.1/servers/48f79788-755b-4d86-8832-776e3a820a63 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:41:12.577394 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-72e2a974-efce-4cf8-881c-215ccc84a9b4 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Calling method '.version_select at 0x7fa94bde2040>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:12.625207 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-72e2a974-efce-4cf8-881c-215ccc84a9b4 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1325086009" status: 204 len: 0 microversion: 2.20 time: 0.052787 Jul 28 10:41:12.626885 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 581/1148] 10.222.0.46 () {60 vars in 1262 bytes} [Thu Jul 28 10:41:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1325086009 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:41:14.062013 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-cc8426b8-2045-480a-932a-de341bc8b099 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Action: 'create', calling method: .version_select at 0x7fa94bc73e50>, body: {"keypair": {"name": "tempest-keypair-547571998", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhw0AG+INKpGNuUkcmQcqvclaBSWyDs8zAftryCK+xFyliV9ZnDANAVEHomEACrcorAa8wlWAVFqE8vcko61c4YiVSkRtb5lx5AX4Yd6x6cpLj9lE9daA/rFzdwXZX0/w=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:14.068911 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:14.120962 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-cc8426b8-2045-480a-932a-de341bc8b099 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Getting quotas for project 837d8bf564654ede973e1598e0fca3d6. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:41:14.134044 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-cc8426b8-2045-480a-932a-de341bc8b099 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Getting quotas for user f20c3590b80a44549ae5c05d1c86feb6 and project 837d8bf564654ede973e1598e0fca3d6. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:41:14.195757 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-cc8426b8-2045-480a-932a-de341bc8b099 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.139038 Jul 28 10:41:14.197013 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 568/1149] 10.222.0.46 () {62 vars in 1200 bytes} [Thu Jul 28 10:41:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 141 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 10:41:17.564876 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1260996804", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c2cbf7b7-6945-4278-9e95-210df42bf84c"}], "security_groups": [{"name": "tempest-securitygroup--360504418"}], "key_name": "tempest-keypair-547571998", "user_data": "}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:17.732357 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] validate_networks() for [('c2cbf7b7-6945-4278-9e95-210df42bf84c', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:41:18.469324 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:41:18.470141 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:41:18.470812 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:41:18.471662 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:41:18.472427 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:41:18.491148 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:18.491955 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:18.492884 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:18.493429 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:18.513898 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Getting quotas for project 837d8bf564654ede973e1598e0fca3d6. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:41:18.523211 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Getting quotas for user f20c3590b80a44549ae5c05d1c86feb6 and project 837d8bf564654ede973e1598e0fca3d6. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:41:18.551965 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:41:18.554646 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 3fe19f6d-ef1c-4035-85a7-8a8637cf81d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:41:18.653039 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-52d7af11-bc55-4f5f-b0b0-5f1acc724c19 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.092529 Jul 28 10:41:18.654813 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 582/1150] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Jul 28 10:41:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 10:41:18.671757 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2edb7011-5816-43c2-8041-5583ec1cc3a7 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:18.673442 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-2edb7011-5816-43c2-8041-5583ec1cc3a7 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 3fe19f6d-ef1c-4035-85a7-8a8637cf81d3] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:41:18.838536 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-2edb7011-5816-43c2-8041-5583ec1cc3a7 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20c3590b80a44549ae5c05d1c86feb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837d8bf564654ede973e1598e0fca3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:18.849827 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-2edb7011-5816-43c2-8041-5583ec1cc3a7 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f20c3590b80a44549ae5c05d1c86feb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837d8bf564654ede973e1598e0fca3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:18.854231 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-2edb7011-5816-43c2-8041-5583ec1cc3a7 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f20c3590b80a44549ae5c05d1c86feb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837d8bf564654ede973e1598e0fca3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:18.855666 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-2edb7011-5816-43c2-8041-5583ec1cc3a7 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] 10.222.0.46 "GET /compute/v2.1/servers/3fe19f6d-ef1c-4035-85a7-8a8637cf81d3" status: 200 len: 1281 microversion: 2.20 time: 0.193822 Jul 28 10:41:18.856953 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 569/1151] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:41:18 2022] GET /compute/v2.1/servers/3fe19f6d-ef1c-4035-85a7-8a8637cf81d3 => generated 1281 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:41:19.881159 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a7d05d61-88b6-410d-9bcf-6b10a169e2c3 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:19.881874 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a7d05d61-88b6-410d-9bcf-6b10a169e2c3 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 3fe19f6d-ef1c-4035-85a7-8a8637cf81d3] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:41:19.899088 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a7d05d61-88b6-410d-9bcf-6b10a169e2c3 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:19.906892 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a7d05d61-88b6-410d-9bcf-6b10a169e2c3 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:19.924038 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a7d05d61-88b6-410d-9bcf-6b10a169e2c3 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:19.924514 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a7d05d61-88b6-410d-9bcf-6b10a169e2c3 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:19.976693 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a7d05d61-88b6-410d-9bcf-6b10a169e2c3 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:19.977555 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a7d05d61-88b6-410d-9bcf-6b10a169e2c3 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:19.978457 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-a7d05d61-88b6-410d-9bcf-6b10a169e2c3 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lazy-loading 'fault' on Instance uuid 3fe19f6d-ef1c-4035-85a7-8a8637cf81d3 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:41:20.063426 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-a7d05d61-88b6-410d-9bcf-6b10a169e2c3 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20c3590b80a44549ae5c05d1c86feb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837d8bf564654ede973e1598e0fca3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:20.078687 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-a7d05d61-88b6-410d-9bcf-6b10a169e2c3 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f20c3590b80a44549ae5c05d1c86feb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837d8bf564654ede973e1598e0fca3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:20.080739 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-a7d05d61-88b6-410d-9bcf-6b10a169e2c3 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f20c3590b80a44549ae5c05d1c86feb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837d8bf564654ede973e1598e0fca3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:20.082115 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a7d05d61-88b6-410d-9bcf-6b10a169e2c3 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] 10.222.0.46 "GET /compute/v2.1/servers/3fe19f6d-ef1c-4035-85a7-8a8637cf81d3" status: 200 len: 1354 microversion: 2.20 time: 0.205413 Jul 28 10:41:20.083533 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 583/1152] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:41:19 2022] GET /compute/v2.1/servers/3fe19f6d-ef1c-4035-85a7-8a8637cf81d3 => generated 1354 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:41:20.111503 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2eb961f7-f142-4e5e-b2eb-065e815b4edb tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:20.112618 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-2eb961f7-f142-4e5e-b2eb-065e815b4edb tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 3fe19f6d-ef1c-4035-85a7-8a8637cf81d3] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:41:20.120656 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2eb961f7-f142-4e5e-b2eb-065e815b4edb tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:20.121423 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2eb961f7-f142-4e5e-b2eb-065e815b4edb tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:20.122698 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2eb961f7-f142-4e5e-b2eb-065e815b4edb tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:20.123406 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2eb961f7-f142-4e5e-b2eb-065e815b4edb tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:20.160456 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-2eb961f7-f142-4e5e-b2eb-065e815b4edb tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 3fe19f6d-ef1c-4035-85a7-8a8637cf81d3] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:41:20.229682 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-2eb961f7-f142-4e5e-b2eb-065e815b4edb tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 3fe19f6d-ef1c-4035-85a7-8a8637cf81d3] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:41:20.230908 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2eb961f7-f142-4e5e-b2eb-065e815b4edb tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:20.233221 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2eb961f7-f142-4e5e-b2eb-065e815b4edb tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:20.233886 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-2eb961f7-f142-4e5e-b2eb-065e815b4edb tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 3fe19f6d-ef1c-4035-85a7-8a8637cf81d3] instance's host None is down, deleting from database Jul 28 10:41:20.241394 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-2eb961f7-f142-4e5e-b2eb-065e815b4edb tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 3fe19f6d-ef1c-4035-85a7-8a8637cf81d3] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:41:20.321515 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-2eb961f7-f142-4e5e-b2eb-065e815b4edb tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 3fe19f6d-ef1c-4035-85a7-8a8637cf81d3] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:41:20.334519 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-2eb961f7-f142-4e5e-b2eb-065e815b4edb tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 3fe19f6d-ef1c-4035-85a7-8a8637cf81d3] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:41:20.551938 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-2eb961f7-f142-4e5e-b2eb-065e815b4edb tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3fe19f6d-ef1c-4035-85a7-8a8637cf81d3" status: 204 len: 0 microversion: 2.20 time: 0.450056 Jul 28 10:41:20.554437 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 570/1153] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:41:20 2022] DELETE /compute/v2.1/servers/3fe19f6d-ef1c-4035-85a7-8a8637cf81d3 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:41:20.563741 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a37cd1cf-b308-41ff-ab74-cde83c165fd1 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:20.564489 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a37cd1cf-b308-41ff-ab74-cde83c165fd1 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] [instance: 3fe19f6d-ef1c-4035-85a7-8a8637cf81d3] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:41:20.571328 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a37cd1cf-b308-41ff-ab74-cde83c165fd1 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:20.572129 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a37cd1cf-b308-41ff-ab74-cde83c165fd1 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:20.573154 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a37cd1cf-b308-41ff-ab74-cde83c165fd1 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:41:20.573947 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a37cd1cf-b308-41ff-ab74-cde83c165fd1 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:41:20.592679 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-a37cd1cf-b308-41ff-ab74-cde83c165fd1 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] HTTP exception thrown: Instance 3fe19f6d-ef1c-4035-85a7-8a8637cf81d3 could not be found. Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a37cd1cf-b308-41ff-ab74-cde83c165fd1 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Request method failure captured: Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/3fe19f6d-ef1c-4035-85a7-8a8637cf81d3 HTTP/1.1 Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4me7WweCcu8DT6hLtBnMwv9RGfRagW4tSIZFku4G1URrlcsuM8__xyABOUpKB7hMRd2y_anODtpb4Tzw-10UTr8FW1Qer6EEwhxTJyK-AqSd6X536wqwqNESeql8lkPZ9zegUu8gsMKHfXUfC05Ct_kiczJplXbfb-0J15awAf85OjM Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 837d8bf564654ede973e1598e0fca3d6 Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1763370157 Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/837d8bf564654ede973e1598e0fca3d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/837d8bf564654ede973e1598e0fca3d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/837d8bf564654ede973e1598e0fca3d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_837d8bf564654ede973e1598e0fca3d6", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1763370157 Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 837d8bf564654ede973e1598e0fca3d6 Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1763370157 Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-AttachVolumeShelveTestJSON-1763370157-project Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: f20c3590b80a44549ae5c05d1c86feb6 Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1763370157-project Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 3fe19f6d-ef1c-4035-85a7-8a8637cf81d3 could not be found. Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '3fe19f6d-ef1c-4035-85a7-8a8637cf81d3'} Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fe19f6d-ef1c-4035-85a7-8a8637cf81d3 could not be found. Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fe19f6d-ef1c-4035-85a7-8a8637cf81d3 could not be found. Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:20.594632 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:20.598537 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:20.598537 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:20.598537 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:20.598537 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:20.598537 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:41:20.598537 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:41:20.598537 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fe19f6d-ef1c-4035-85a7-8a8637cf81d3 could not be found. Jul 28 10:41:20.598537 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:20.598537 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a37cd1cf-b308-41ff-ab74-cde83c165fd1 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Returning 404 to user: Instance 3fe19f6d-ef1c-4035-85a7-8a8637cf81d3 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:41:20.598537 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a37cd1cf-b308-41ff-ab74-cde83c165fd1 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] 10.222.0.46 "GET /compute/v2.1/servers/3fe19f6d-ef1c-4035-85a7-8a8637cf81d3" status: 404 len: 111 microversion: 2.20 time: 0.037047 Jul 28 10:41:20.598537 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 584/1154] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:41:20 2022] GET /compute/v2.1/servers/3fe19f6d-ef1c-4035-85a7-8a8637cf81d3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:41:20.605829 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e258607d-3dec-4edd-b170-89fe03b7e538 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] Calling method '.version_select at 0x7fa94b9fbb80>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:20.631072 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e258607d-3dec-4edd-b170-89fe03b7e538 tempest-AttachVolumeShelveTestJSON-1763370157 tempest-AttachVolumeShelveTestJSON-1763370157-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-547571998" status: 204 len: 0 microversion: 2.20 time: 0.029251 Jul 28 10:41:20.632362 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 571/1155] 10.222.0.46 () {60 vars in 1259 bytes} [Thu Jul 28 10:41:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-547571998 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:41:41.089559 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:41.090727 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=11 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:41.093118 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:41.094591 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=34,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:41.672248 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a5c995f7-173e-45d0-ad11-2a8bc224122d tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] Action: 'create', calling method: .version_select at 0x7fa94b87d040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1856002030", "metadata": {"Type": "work"}}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a5c995f7-173e-45d0-ad11-2a8bc224122d tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] Request method failure captured: Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 122 Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mfkPP_XQ6JTLzX5oglmOWaF-HvZ4b6SJ1x5YyO-J-JBj9QxSGWmytktO3FTOs1T4JmFBQFFhZ7XjMo3vMFQKaJeKnVFTIz75uPqaj6PtnGSqs9_bNrA6JAYMOwqzrwE1QeZMTTCvTKvTIScVxhCA9BwDOpmfp6VGmSAzcTw8ypNuj4 Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: a01c438884854a9eacb68ce280853334 Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-VolumesNegativeTest-960729433 Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a01c438884854a9eacb68ce280853334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a01c438884854a9eacb68ce280853334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a01c438884854a9eacb68ce280853334"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a01c438884854a9eacb68ce280853334", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-VolumesNegativeTest-960729433 Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: a01c438884854a9eacb68ce280853334 Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-VolumesNegativeTest-960729433 Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-VolumesNegativeTest-960729433-project Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 7171d6a3c2e54248bd0b8d39a47454c4 Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-VolumesNegativeTest-960729433-project Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1856002030", "metadata": {"Type": "work"}}} Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1856002030', 'metadata': {'Type': 'work'}}}} Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise error Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi '#$%' Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 10:41:41.679164 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 10:41:41.685058 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 10:41:41.685058 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.685058 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:41.685058 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.685058 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:41.685058 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:41.685058 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:41.685058 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 10:41:41.685058 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 10:41:41.685058 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 10:41:41.685058 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.689015 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a5c995f7-173e-45d0-ad11-2a8bc224122d tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:41:41.690192 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a5c995f7-173e-45d0-ad11-2a8bc224122d tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.610312 Jul 28 10:41:41.696196 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 585/1156] 10.222.0.46 () {60 vars in 1156 bytes} [Thu Jul 28 10:41:41 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 618 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:41:41.698220 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=8 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:41.699498 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=33,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:41.701571 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:41:41.707485 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2d5dc745-031f-4955-b3df-95c2bf7f61d3 tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] Action: 'create', calling method: .version_select at 0x7fa9585c7670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-127017820", "metadata": {"Type": "work"}}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2d5dc745-031f-4955-b3df-95c2bf7f61d3 tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] Request method failure captured: Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 119 Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mfkPP_XQ6JTLzX5oglmOWaF-HvZ4b6SJ1x5YyO-J-JBj9QxSGWmytktO3FTOs1T4JmFBQFFhZ7XjMo3vMFQKaJeKnVFTIz75uPqaj6PtnGSqs9_bNrA6JAYMOwqzrwE1QeZMTTCvTKvTIScVxhCA9BwDOpmfp6VGmSAzcTw8ypNuj4 Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: a01c438884854a9eacb68ce280853334 Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-VolumesNegativeTest-960729433 Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a01c438884854a9eacb68ce280853334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a01c438884854a9eacb68ce280853334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a01c438884854a9eacb68ce280853334"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a01c438884854a9eacb68ce280853334", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-VolumesNegativeTest-960729433 Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: a01c438884854a9eacb68ce280853334 Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-VolumesNegativeTest-960729433 Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-VolumesNegativeTest-960729433-project Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 7171d6a3c2e54248bd0b8d39a47454c4 Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-VolumesNegativeTest-960729433-project Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-127017820", "metadata": {"Type": "work"}}} Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-127017820', 'metadata': {'Type': 'work'}}}} Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise error Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi '0' Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 10:41:41.719475 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 10:41:41.724306 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 10:41:41.724306 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.724306 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:41.724306 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.724306 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:41.724306 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:41.724306 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:41.724306 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 10:41:41.724306 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 10:41:41.724306 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 10:41:41.724306 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.726886 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2d5dc745-031f-4955-b3df-95c2bf7f61d3 tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:41:41.729532 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-2d5dc745-031f-4955-b3df-95c2bf7f61d3 tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.032899 Jul 28 10:41:41.732950 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 572/1157] 10.222.0.46 () {60 vars in 1156 bytes} [Thu Jul 28 10:41:41 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 10:41:41.742828 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-434fa329-cc39-49a1-ab58-c7dc60937040 tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] Action: 'create', calling method: .version_select at 0x7fa94b9d8160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1477094636", "metadata": {"Type": "work"}}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-434fa329-cc39-49a1-ab58-c7dc60937040 tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] Request method failure captured: Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 119 Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mfkPP_XQ6JTLzX5oglmOWaF-HvZ4b6SJ1x5YyO-J-JBj9QxSGWmytktO3FTOs1T4JmFBQFFhZ7XjMo3vMFQKaJeKnVFTIz75uPqaj6PtnGSqs9_bNrA6JAYMOwqzrwE1QeZMTTCvTKvTIScVxhCA9BwDOpmfp6VGmSAzcTw8ypNuj4 Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: a01c438884854a9eacb68ce280853334 Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-VolumesNegativeTest-960729433 Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a01c438884854a9eacb68ce280853334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a01c438884854a9eacb68ce280853334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a01c438884854a9eacb68ce280853334"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a01c438884854a9eacb68ce280853334", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-VolumesNegativeTest-960729433 Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: a01c438884854a9eacb68ce280853334 Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-VolumesNegativeTest-960729433 Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-VolumesNegativeTest-960729433-project Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 7171d6a3c2e54248bd0b8d39a47454c4 Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-VolumesNegativeTest-960729433-project Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1477094636", "metadata": {"Type": "work"}}} Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1477094636', 'metadata': {'Type': 'work'}}}} Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise error Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi '' Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 10:41:41.747126 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 10:41:41.751236 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 10:41:41.751236 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.751236 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:41.751236 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.751236 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:41.751236 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:41.751236 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:41.751236 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 10:41:41.751236 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 10:41:41.751236 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 10:41:41.751236 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.754924 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-434fa329-cc39-49a1-ab58-c7dc60937040 tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:41:41.759169 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-434fa329-cc39-49a1-ab58-c7dc60937040 tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019187 Jul 28 10:41:41.762793 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 586/1158] 10.222.0.46 () {60 vars in 1156 bytes} [Thu Jul 28 10:41:41 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:41:41.776977 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f381f8b9-7311-4ed1-a9d4-1219975cdcb2 tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] Calling method '.version_select at 0x7fa94bce8ee0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:41.873960 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-f381f8b9-7311-4ed1-a9d4-1219975cdcb2 tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] HTTP exception thrown: Volume tempest-invalid-1579157514 could not be found. Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f381f8b9-7311-4ed1-a9d4-1219975cdcb2 tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] Request method failure captured: Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1579157514 HTTP/1.1 Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mfkPP_XQ6JTLzX5oglmOWaF-HvZ4b6SJ1x5YyO-J-JBj9QxSGWmytktO3FTOs1T4JmFBQFFhZ7XjMo3vMFQKaJeKnVFTIz75uPqaj6PtnGSqs9_bNrA6JAYMOwqzrwE1QeZMTTCvTKvTIScVxhCA9BwDOpmfp6VGmSAzcTw8ypNuj4 Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: a01c438884854a9eacb68ce280853334 Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-VolumesNegativeTest-960729433 Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a01c438884854a9eacb68ce280853334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a01c438884854a9eacb68ce280853334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a01c438884854a9eacb68ce280853334"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a01c438884854a9eacb68ce280853334", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-VolumesNegativeTest-960729433 Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: a01c438884854a9eacb68ce280853334 Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-VolumesNegativeTest-960729433 Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-VolumesNegativeTest-960729433-project Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 7171d6a3c2e54248bd0b8d39a47454c4 Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-VolumesNegativeTest-960729433-project Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: exception: Volume tempest-invalid-1579157514 could not be found. Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'tempest-invalid-1579157514'} Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1579157514 could not be found. (HTTP 404) (Request-ID: req-e4e93a96-0cd3-4a19-9b4e-4db0d28722ad) Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 10:41:41.877087 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1579157514 could not be found. Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1579157514 could not be found. Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1579157514 could not be found. Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f381f8b9-7311-4ed1-a9d4-1219975cdcb2 tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] Returning 404 to user: Volume tempest-invalid-1579157514 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:41:41.881038 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f381f8b9-7311-4ed1-a9d4-1219975cdcb2 tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1579157514" status: 404 len: 99 microversion: 2.1 time: 0.114310 Jul 28 10:41:41.886520 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 573/1159] 10.222.0.46 () {58 vars in 1218 bytes} [Thu Jul 28 10:41:41 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1579157514 => generated 99 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:41:41.894898 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-74e131cc-91d3-4715-9113-8962d81edfeb tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004544 Jul 28 10:41:41.896169 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 587/1160] 10.222.0.46 () {58 vars in 1140 bytes} [Thu Jul 28 10:41:41 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 10:41:41.909622 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b9a88182-893d-42b5-9a3d-edae16c23457 tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006389 Jul 28 10:41:41.911127 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 574/1161] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 10:41:41 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 10:41:41.923362 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d5c5bc55-5739-451b-ab3f-a2b401017d5c tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] Calling method '.version_select at 0x7fa94bc73d30>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:41.984137 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-d5c5bc55-5739-451b-ab3f-a2b401017d5c tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] HTTP exception thrown: Volume ca4bcef6-572d-4a16-96b8-c27454fb56ee could not be found. Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d5c5bc55-5739-451b-ab3f-a2b401017d5c tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] Request method failure captured: Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: request: DELETE /compute/v2.1/os-volumes/ca4bcef6-572d-4a16-96b8-c27454fb56ee HTTP/1.1 Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mfkPP_XQ6JTLzX5oglmOWaF-HvZ4b6SJ1x5YyO-J-JBj9QxSGWmytktO3FTOs1T4JmFBQFFhZ7XjMo3vMFQKaJeKnVFTIz75uPqaj6PtnGSqs9_bNrA6JAYMOwqzrwE1QeZMTTCvTKvTIScVxhCA9BwDOpmfp6VGmSAzcTw8ypNuj4 Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: a01c438884854a9eacb68ce280853334 Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-VolumesNegativeTest-960729433 Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a01c438884854a9eacb68ce280853334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a01c438884854a9eacb68ce280853334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a01c438884854a9eacb68ce280853334"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a01c438884854a9eacb68ce280853334", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-VolumesNegativeTest-960729433 Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: a01c438884854a9eacb68ce280853334 Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-VolumesNegativeTest-960729433 Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-VolumesNegativeTest-960729433-project Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 7171d6a3c2e54248bd0b8d39a47454c4 Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-VolumesNegativeTest-960729433-project Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: method: Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: exception: Volume ca4bcef6-572d-4a16-96b8-c27454fb56ee could not be found. Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'ca4bcef6-572d-4a16-96b8-c27454fb56ee'} Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca4bcef6-572d-4a16-96b8-c27454fb56ee could not be found. (HTTP 404) (Request-ID: req-9db9bab9-0a95-4c80-8a19-014dab58bd25) Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 10:41:41.986474 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca4bcef6-572d-4a16-96b8-c27454fb56ee could not be found. Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca4bcef6-572d-4a16-96b8-c27454fb56ee could not be found. Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca4bcef6-572d-4a16-96b8-c27454fb56ee could not be found. Jul 28 10:41:41.992002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:41:42.002037 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d5c5bc55-5739-451b-ab3f-a2b401017d5c tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] Returning 404 to user: Volume ca4bcef6-572d-4a16-96b8-c27454fb56ee could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:41:42.002817 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-d5c5bc55-5739-451b-ab3f-a2b401017d5c tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/ca4bcef6-572d-4a16-96b8-c27454fb56ee" status: 404 len: 109 microversion: 2.1 time: 0.084336 Jul 28 10:41:42.003923 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 588/1162] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Jul 28 10:41:41 2022] DELETE /compute/v2.1/os-volumes/ca4bcef6-572d-4a16-96b8-c27454fb56ee => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:41:42.018416 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2a015a3d-38c1-4cce-8177-b8cd3500df0e tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] Calling method '.version_select at 0x7fa94bce8790>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:42.076266 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-2a015a3d-38c1-4cce-8177-b8cd3500df0e tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] HTTP exception thrown: Volume dfd62ce7-a6bb-412f-a5aa-06c73df4d57b could not be found. Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2a015a3d-38c1-4cce-8177-b8cd3500df0e tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] Request method failure captured: Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/os-volumes/dfd62ce7-a6bb-412f-a5aa-06c73df4d57b HTTP/1.1 Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mfkPP_XQ6JTLzX5oglmOWaF-HvZ4b6SJ1x5YyO-J-JBj9QxSGWmytktO3FTOs1T4JmFBQFFhZ7XjMo3vMFQKaJeKnVFTIz75uPqaj6PtnGSqs9_bNrA6JAYMOwqzrwE1QeZMTTCvTKvTIScVxhCA9BwDOpmfp6VGmSAzcTw8ypNuj4 Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: a01c438884854a9eacb68ce280853334 Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-VolumesNegativeTest-960729433 Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a01c438884854a9eacb68ce280853334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a01c438884854a9eacb68ce280853334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a01c438884854a9eacb68ce280853334"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a01c438884854a9eacb68ce280853334", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-VolumesNegativeTest-960729433 Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: a01c438884854a9eacb68ce280853334 Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-VolumesNegativeTest-960729433 Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-VolumesNegativeTest-960729433-project Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 7171d6a3c2e54248bd0b8d39a47454c4 Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-VolumesNegativeTest-960729433-project Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: method: Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: exception: Volume dfd62ce7-a6bb-412f-a5aa-06c73df4d57b could not be found. Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'dfd62ce7-a6bb-412f-a5aa-06c73df4d57b'} Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dfd62ce7-a6bb-412f-a5aa-06c73df4d57b could not be found. (HTTP 404) (Request-ID: req-5a1d925c-f640-4fd7-9f07-273386af4f58) Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 10:41:42.078474 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dfd62ce7-a6bb-412f-a5aa-06c73df4d57b could not be found. Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dfd62ce7-a6bb-412f-a5aa-06c73df4d57b could not be found. Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dfd62ce7-a6bb-412f-a5aa-06c73df4d57b could not be found. Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2a015a3d-38c1-4cce-8177-b8cd3500df0e tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] Returning 404 to user: Volume dfd62ce7-a6bb-412f-a5aa-06c73df4d57b could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-2a015a3d-38c1-4cce-8177-b8cd3500df0e tempest-VolumesNegativeTest-960729433 tempest-VolumesNegativeTest-960729433-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/dfd62ce7-a6bb-412f-a5aa-06c73df4d57b" status: 404 len: 109 microversion: 2.1 time: 0.068750 Jul 28 10:41:42.088321 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 575/1163] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 10:41:42 2022] GET /compute/v2.1/os-volumes/dfd62ce7-a6bb-412f-a5aa-06c73df4d57b => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:42:06.300530 n-d-850468-6 devstack@n-api.service[119463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:42:06.301253 n-d-850468-6 devstack@n-api.service[119463]: Thu Jul 28 10:42:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 10:43:12.234606 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b633ba52-e26e-4aaf-af88-fbdf7602f81f tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Action: 'create', calling method: .version_select at 0x7fa94badfca0>, body: {"keypair": {"name": "tempest-keypair-1871884598", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQaATfHial1/ICcIJNLeQZM9et0neiORhpcrrvbisq4GrVY2F78uHqCvz5a0JgAy5P39ZdGxt5oJxuhjttUZev7NlEZlYrqF/sLF2niqkZMyk3j4CY3gMAq7ocjhu9Plg=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:43:12.313000 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-b633ba52-e26e-4aaf-af88-fbdf7602f81f tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Getting quotas for project b900fee094054e5da82bd4b37b369b0e. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:43:12.326920 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-b633ba52-e26e-4aaf-af88-fbdf7602f81f tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Getting quotas for user 337b74d434dc43a6b3305fb4a2981ad7 and project b900fee094054e5da82bd4b37b369b0e. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:43:12.454716 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b633ba52-e26e-4aaf-af88-fbdf7602f81f tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.229790 Jul 28 10:43:12.464663 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 589/1164] 10.222.0.46 () {62 vars in 1200 bytes} [Thu Jul 28 10:43:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 241 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 10:43:21.170906 n-d-850468-6 devstack@n-api.service[119463]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bf1f78a4-ab1b-4da7-ba61-69c262289c92] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 10:43:21.176533 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-634579997", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "dc378914-a188-495f-9afa-f65a08836123"}, {"port": "4bdb26d1-fc27-4a79-97ed-bcb7b3cb65af", "tag": "port-1"}, {"port": "cb5e65ae-f81f-4c41-83f2-f06c2a363ee9", "tag": "port-2"}, {"uuid": "7fc43303-0936-4b6f-a24f-96a28bd8f2bb", "tag": "net-1"}, {"uuid": "7fc43303-0936-4b6f-a24f-96a28bd8f2bb"}, {"uuid": "cb0e25c5-4b28-48d7-aa14-4fe811202ad2", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "cb0e25c5-4b28-48d7-aa14-4fe811202ad2", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "955f001a-3f58-4db4-827e-0bf0900c07b9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "95263a26-447d-4a19-a671-bf511c5274af", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "269407a8-8b85-4388-bc68-a6a952fec516", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--629824594"}], "key_name": "tempest-keypair-1871884598", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:43:21.891267 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] validate_networks() for [('dc378914-a188-495f-9afa-f65a08836123', None, None, None, None, None), (None, None, '4bdb26d1-fc27-4a79-97ed-bcb7b3cb65af', None, None, None), (None, None, 'cb5e65ae-f81f-4c41-83f2-f06c2a363ee9', None, None, None), ('7fc43303-0936-4b6f-a24f-96a28bd8f2bb', None, None, None, None, None), ('7fc43303-0936-4b6f-a24f-96a28bd8f2bb', None, None, None, None, None), ('cb0e25c5-4b28-48d7-aa14-4fe811202ad2', '10.2.2.100', None, None, None, None), ('cb0e25c5-4b28-48d7-aa14-4fe811202ad2', '10.2.2.200', None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:43:22.180768 n-d-850468-6 devstack@n-api.service[119463]: INFO oslo.messaging._drivers.impl_rabbit [-] [bf1f78a4-ab1b-4da7-ba61-69c262289c92] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 60436. Jul 28 10:43:29.067210 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:43:29.070342 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:43:29.077468 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1651905903", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:43:29.173185 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] validate_networks() for None {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:43:30.076519 n-d-850468-6 devstack@n-api.service[119463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:43:30.077063 n-d-850468-6 devstack@n-api.service[119463]: Thu Jul 28 10:43:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.46) !!! Jul 28 10:43:30.358973 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:43:30.362288 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:43:30.372499 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:43:30.377250 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:43:30.377938 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:43:30.406674 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:30.407124 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:30.410080 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:30.410540 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:30.455424 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Getting quotas for project b900fee094054e5da82bd4b37b369b0e. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:43:30.474782 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Getting quotas for user 337b74d434dc43a6b3305fb4a2981ad7 and project b900fee094054e5da82bd4b37b369b0e. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:43:30.549380 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:43:30.550944 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:43:30.552222 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:43:30.552829 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:43:30.553419 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:43:30.585287 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:30.588572 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:30.589537 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:30.592366 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:30.655747 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Getting quotas for project 5e7225f46bf941348893f87ff5c99096. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:43:30.663751 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Getting quotas for user 78b1c1599a1245498272e42fff474273 and project 5e7225f46bf941348893f87ff5c99096. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:43:30.686400 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:43:30.689358 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] [instance: 0b9149f6-c750-44f6-bc8e-cad99d85089d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:43:30.773680 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:43:30.777109 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] [instance: e25a6ed1-1f55-4201-b1c9-395dbddd1bc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='955f001a-3f58-4db4-827e-0bf0900c07b9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='95263a26-447d-4a19-a671-bf511c5274af',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='269407a8-8b85-4388-bc68-a6a952fec516',volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:43:30.781534 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-5cfec7f1-7a18-4439-9f50-accc1abfe44a tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.714486 Jul 28 10:43:30.782888 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 590/1165] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:43:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:43:30.801597 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-787304875", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:43:30.944271 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] validate_networks() for None {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:43:31.394457 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-dbb96158-36bc-4aa5-8dd7-03db2903fa4b tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 10.221995 Jul 28 10:43:31.397920 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 576/1166] 10.222.0.46 () {62 vars in 1189 bytes} [Thu Jul 28 10:43:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 10229 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 10:43:31.408906 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-30f82109-73cc-4a0d-b06c-da11706cba9e tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:31.418583 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-30f82109-73cc-4a0d-b06c-da11706cba9e tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] [instance: 0b9149f6-c750-44f6-bc8e-cad99d85089d] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:43:31.535133 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-30f82109-73cc-4a0d-b06c-da11706cba9e tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b1c1599a1245498272e42fff474273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7225f46bf941348893f87ff5c99096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:31.546540 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-30f82109-73cc-4a0d-b06c-da11706cba9e tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] 10.222.0.46 "GET /compute/v2.1/servers/0b9149f6-c750-44f6-bc8e-cad99d85089d" status: 200 len: 1214 microversion: 2.1 time: 0.147107 Jul 28 10:43:31.559760 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 577/1167] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:43:31 2022] GET /compute/v2.1/servers/0b9149f6-c750-44f6-bc8e-cad99d85089d => generated 1214 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:43:31.571069 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e230131a-6885-48ae-b83e-ebebfb5741b0 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:31.571982 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-e230131a-6885-48ae-b83e-ebebfb5741b0 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] [instance: e25a6ed1-1f55-4201-b1c9-395dbddd1bc4] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:43:31.681667 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-e230131a-6885-48ae-b83e-ebebfb5741b0 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b74d434dc43a6b3305fb4a2981ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b900fee094054e5da82bd4b37b369b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:31.691145 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-e230131a-6885-48ae-b83e-ebebfb5741b0 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b74d434dc43a6b3305fb4a2981ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b900fee094054e5da82bd4b37b369b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:31.692678 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-e230131a-6885-48ae-b83e-ebebfb5741b0 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b74d434dc43a6b3305fb4a2981ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b900fee094054e5da82bd4b37b369b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:31.694003 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e230131a-6885-48ae-b83e-ebebfb5741b0 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] 10.222.0.46 "GET /compute/v2.1/servers/e25a6ed1-1f55-4201-b1c9-395dbddd1bc4" status: 200 len: 1285 microversion: 2.42 time: 0.128978 Jul 28 10:43:31.700989 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 578/1168] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:43:31 2022] GET /compute/v2.1/servers/e25a6ed1-1f55-4201-b1c9-395dbddd1bc4 => generated 1285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:43:31.970071 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:43:31.971164 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:43:31.971880 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:43:31.972538 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:43:31.973193 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:43:31.983453 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:31.984338 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:31.985413 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:31.986173 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:32.006548 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Getting quotas for project e5338724a49b4a57b54618f29b406f95. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:43:32.013296 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Getting quotas for user b0b132e103464daeb10bc2ad8df1e8a7 and project e5338724a49b4a57b54618f29b406f95. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:43:32.027846 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:43:32.030549 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] [instance: f392c649-a270-416c-857f-371ab7812614] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:43:32.089459 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-41b798ec-8157-4280-82f5-6b53f0c4e526 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.304215 Jul 28 10:43:32.090542 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 591/1169] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:43:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:43:32.103068 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-21efbd45-9ff0-486c-98c9-e5a324e7e3ce tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:32.109738 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-21efbd45-9ff0-486c-98c9-e5a324e7e3ce tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] [instance: f392c649-a270-416c-857f-371ab7812614] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:43:32.570953 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-39724bd9-f32a-4b18-96b3-50ee4d27987c tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:32.571825 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-39724bd9-f32a-4b18-96b3-50ee4d27987c tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] [instance: 0b9149f6-c750-44f6-bc8e-cad99d85089d] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:43:32.730252 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-21efbd45-9ff0-486c-98c9-e5a324e7e3ce tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b132e103464daeb10bc2ad8df1e8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5338724a49b4a57b54618f29b406f95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:32.741556 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-39724bd9-f32a-4b18-96b3-50ee4d27987c tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b1c1599a1245498272e42fff474273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7225f46bf941348893f87ff5c99096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:32.758791 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-21efbd45-9ff0-486c-98c9-e5a324e7e3ce tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] 10.222.0.46 "GET /compute/v2.1/servers/f392c649-a270-416c-857f-371ab7812614" status: 200 len: 1214 microversion: 2.1 time: 0.655621 Jul 28 10:43:32.760106 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 579/1170] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:43:32 2022] GET /compute/v2.1/servers/f392c649-a270-416c-857f-371ab7812614 => generated 1214 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:43:32.768341 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-39724bd9-f32a-4b18-96b3-50ee4d27987c tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] 10.222.0.46 "GET /compute/v2.1/servers/0b9149f6-c750-44f6-bc8e-cad99d85089d" status: 200 len: 1214 microversion: 2.1 time: 0.201165 Jul 28 10:43:32.773154 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 592/1171] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:43:32 2022] GET /compute/v2.1/servers/0b9149f6-c750-44f6-bc8e-cad99d85089d => generated 1214 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:43:32.780410 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-9fd5d3f6-59b4-4472-b9ce-15b789f1e943 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:32.783746 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-9fd5d3f6-59b4-4472-b9ce-15b789f1e943 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] [instance: e25a6ed1-1f55-4201-b1c9-395dbddd1bc4] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:43:32.927120 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-9fd5d3f6-59b4-4472-b9ce-15b789f1e943 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b74d434dc43a6b3305fb4a2981ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b900fee094054e5da82bd4b37b369b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:32.936208 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-9fd5d3f6-59b4-4472-b9ce-15b789f1e943 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b74d434dc43a6b3305fb4a2981ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b900fee094054e5da82bd4b37b369b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:32.939332 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-9fd5d3f6-59b4-4472-b9ce-15b789f1e943 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b74d434dc43a6b3305fb4a2981ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b900fee094054e5da82bd4b37b369b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:32.941313 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-9fd5d3f6-59b4-4472-b9ce-15b789f1e943 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] 10.222.0.46 "GET /compute/v2.1/servers/e25a6ed1-1f55-4201-b1c9-395dbddd1bc4" status: 200 len: 1285 microversion: 2.42 time: 0.176327 Jul 28 10:43:32.942154 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 580/1172] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:43:32 2022] GET /compute/v2.1/servers/e25a6ed1-1f55-4201-b1c9-395dbddd1bc4 => generated 1285 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:43:33.803822 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a8bac2b8-f788-444d-a354-0a11d9788fa2 tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:33.805837 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fa5459fe-7d1f-4e25-ae47-21a31d6fd208 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:33.806654 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-a8bac2b8-f788-444d-a354-0a11d9788fa2 tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] [instance: 0b9149f6-c750-44f6-bc8e-cad99d85089d] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:43:33.807993 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-fa5459fe-7d1f-4e25-ae47-21a31d6fd208 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] [instance: f392c649-a270-416c-857f-371ab7812614] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:43:33.821621 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fa5459fe-7d1f-4e25-ae47-21a31d6fd208 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:33.823516 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a8bac2b8-f788-444d-a354-0a11d9788fa2 tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:33.824100 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fa5459fe-7d1f-4e25-ae47-21a31d6fd208 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:33.825370 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fa5459fe-7d1f-4e25-ae47-21a31d6fd208 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:33.826080 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fa5459fe-7d1f-4e25-ae47-21a31d6fd208 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:33.836120 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a8bac2b8-f788-444d-a354-0a11d9788fa2 tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:33.836977 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a8bac2b8-f788-444d-a354-0a11d9788fa2 tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:33.837429 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a8bac2b8-f788-444d-a354-0a11d9788fa2 tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:33.871209 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fa5459fe-7d1f-4e25-ae47-21a31d6fd208 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:33.872460 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fa5459fe-7d1f-4e25-ae47-21a31d6fd208 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:33.873041 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-fa5459fe-7d1f-4e25-ae47-21a31d6fd208 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lazy-loading 'fault' on Instance uuid f392c649-a270-416c-857f-371ab7812614 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:43:33.919037 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a8bac2b8-f788-444d-a354-0a11d9788fa2 tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:33.919500 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a8bac2b8-f788-444d-a354-0a11d9788fa2 tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:33.920282 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-a8bac2b8-f788-444d-a354-0a11d9788fa2 tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lazy-loading 'fault' on Instance uuid 0b9149f6-c750-44f6-bc8e-cad99d85089d {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:43:34.095977 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-a8bac2b8-f788-444d-a354-0a11d9788fa2 tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b1c1599a1245498272e42fff474273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7225f46bf941348893f87ff5c99096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:34.102509 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-fa5459fe-7d1f-4e25-ae47-21a31d6fd208 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0b132e103464daeb10bc2ad8df1e8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5338724a49b4a57b54618f29b406f95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:34.107187 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a8bac2b8-f788-444d-a354-0a11d9788fa2 tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] 10.222.0.46 "GET /compute/v2.1/servers/0b9149f6-c750-44f6-bc8e-cad99d85089d" status: 200 len: 1287 microversion: 2.1 time: 0.319467 Jul 28 10:43:34.107787 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 581/1173] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:43:33 2022] GET /compute/v2.1/servers/0b9149f6-c750-44f6-bc8e-cad99d85089d => generated 1287 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:43:34.120101 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-fa5459fe-7d1f-4e25-ae47-21a31d6fd208 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] 10.222.0.46 "GET /compute/v2.1/servers/f392c649-a270-416c-857f-371ab7812614" status: 200 len: 1287 microversion: 2.1 time: 0.333205 Jul 28 10:43:34.132244 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 593/1174] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:43:33 2022] GET /compute/v2.1/servers/f392c649-a270-416c-857f-371ab7812614 => generated 1287 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:43:34.138317 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-87d1b701-170b-4f47-a8ce-6fca055d0da1 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:34.138940 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-87d1b701-170b-4f47-a8ce-6fca055d0da1 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] [instance: e25a6ed1-1f55-4201-b1c9-395dbddd1bc4] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:43:34.152745 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-47253606-f177-474c-9ebf-75195f90324c tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:34.156915 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-47253606-f177-474c-9ebf-75195f90324c tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] [instance: 0b9149f6-c750-44f6-bc8e-cad99d85089d] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:43:34.177167 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-47253606-f177-474c-9ebf-75195f90324c tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:34.179148 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-47253606-f177-474c-9ebf-75195f90324c tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:34.180351 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-47253606-f177-474c-9ebf-75195f90324c tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:34.180978 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-47253606-f177-474c-9ebf-75195f90324c tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:34.248946 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-47253606-f177-474c-9ebf-75195f90324c tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] [instance: 0b9149f6-c750-44f6-bc8e-cad99d85089d] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:43:34.267481 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-87d1b701-170b-4f47-a8ce-6fca055d0da1 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b74d434dc43a6b3305fb4a2981ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b900fee094054e5da82bd4b37b369b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:34.285109 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-87d1b701-170b-4f47-a8ce-6fca055d0da1 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b74d434dc43a6b3305fb4a2981ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b900fee094054e5da82bd4b37b369b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:34.286885 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-87d1b701-170b-4f47-a8ce-6fca055d0da1 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b74d434dc43a6b3305fb4a2981ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b900fee094054e5da82bd4b37b369b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:34.288059 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-87d1b701-170b-4f47-a8ce-6fca055d0da1 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] 10.222.0.46 "GET /compute/v2.1/servers/e25a6ed1-1f55-4201-b1c9-395dbddd1bc4" status: 200 len: 1285 microversion: 2.42 time: 0.164899 Jul 28 10:43:34.308791 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 582/1175] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:43:34 2022] GET /compute/v2.1/servers/e25a6ed1-1f55-4201-b1c9-395dbddd1bc4 => generated 1285 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:43:34.314025 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c8311a10-45a1-42ea-b3e6-236e60bfb568 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:34.320313 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c8311a10-45a1-42ea-b3e6-236e60bfb568 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] [instance: f392c649-a270-416c-857f-371ab7812614] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:43:34.336774 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c8311a10-45a1-42ea-b3e6-236e60bfb568 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:34.339311 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c8311a10-45a1-42ea-b3e6-236e60bfb568 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:34.340137 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c8311a10-45a1-42ea-b3e6-236e60bfb568 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:34.340573 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c8311a10-45a1-42ea-b3e6-236e60bfb568 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:34.411832 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-47253606-f177-474c-9ebf-75195f90324c tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] [instance: 0b9149f6-c750-44f6-bc8e-cad99d85089d] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:43:34.416550 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-47253606-f177-474c-9ebf-75195f90324c tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:34.418424 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-47253606-f177-474c-9ebf-75195f90324c tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:34.419113 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-47253606-f177-474c-9ebf-75195f90324c tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] [instance: 0b9149f6-c750-44f6-bc8e-cad99d85089d] instance's host None is down, deleting from database Jul 28 10:43:34.428278 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c8311a10-45a1-42ea-b3e6-236e60bfb568 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] [instance: f392c649-a270-416c-857f-371ab7812614] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:43:34.434735 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-47253606-f177-474c-9ebf-75195f90324c tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] [instance: 0b9149f6-c750-44f6-bc8e-cad99d85089d] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:43:34.530822 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c8311a10-45a1-42ea-b3e6-236e60bfb568 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] [instance: f392c649-a270-416c-857f-371ab7812614] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:43:34.534256 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c8311a10-45a1-42ea-b3e6-236e60bfb568 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:34.534827 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c8311a10-45a1-42ea-b3e6-236e60bfb568 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:34.536686 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-c8311a10-45a1-42ea-b3e6-236e60bfb568 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] [instance: f392c649-a270-416c-857f-371ab7812614] instance's host None is down, deleting from database Jul 28 10:43:34.546990 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-c8311a10-45a1-42ea-b3e6-236e60bfb568 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] [instance: f392c649-a270-416c-857f-371ab7812614] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:43:34.570843 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-47253606-f177-474c-9ebf-75195f90324c tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] [instance: 0b9149f6-c750-44f6-bc8e-cad99d85089d] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:43:34.581806 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-47253606-f177-474c-9ebf-75195f90324c tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] [instance: 0b9149f6-c750-44f6-bc8e-cad99d85089d] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:43:34.640569 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-c8311a10-45a1-42ea-b3e6-236e60bfb568 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] [instance: f392c649-a270-416c-857f-371ab7812614] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:43:34.647506 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-c8311a10-45a1-42ea-b3e6-236e60bfb568 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] [instance: f392c649-a270-416c-857f-371ab7812614] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:43:34.912882 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-47253606-f177-474c-9ebf-75195f90324c tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0b9149f6-c750-44f6-bc8e-cad99d85089d" status: 204 len: 0 microversion: 2.1 time: 0.772029 Jul 28 10:43:34.914980 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 594/1176] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:43:34 2022] DELETE /compute/v2.1/servers/0b9149f6-c750-44f6-bc8e-cad99d85089d => generated 0 bytes in 782 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:43:34.925085 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b1478e76-be06-41ec-bb10-cf4d5db4e6af tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:34.925675 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b1478e76-be06-41ec-bb10-cf4d5db4e6af tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] [instance: 0b9149f6-c750-44f6-bc8e-cad99d85089d] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:43:34.935374 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b1478e76-be06-41ec-bb10-cf4d5db4e6af tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:34.935834 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b1478e76-be06-41ec-bb10-cf4d5db4e6af tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:34.936749 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b1478e76-be06-41ec-bb10-cf4d5db4e6af tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:34.937199 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b1478e76-be06-41ec-bb10-cf4d5db4e6af tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:34.957376 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-b1478e76-be06-41ec-bb10-cf4d5db4e6af tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] HTTP exception thrown: Instance 0b9149f6-c750-44f6-bc8e-cad99d85089d could not be found. Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b1478e76-be06-41ec-bb10-cf4d5db4e6af tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Request method failure captured: Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/0b9149f6-c750-44f6-bc8e-cad99d85089d HTTP/1.1 Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mhNBW_k4DWaL2gsZM5AB6Lh4JXGiUldP9C9mtlBHNMB2Mja33dI5M2fSlCLcBO5e4mHAkTPnJmhtFJ0NDMoUbPiSGTjjoOtB0QSCgfCWNZ_WT3kx-I5zTv8jUfo_a1gKNmH48qhUXKWNpDh4g597_1gi649hjggf23yVAVBHy0Q_iE Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 5e7225f46bf941348893f87ff5c99096 Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-VolumesBackupsTest-1234305305 Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5e7225f46bf941348893f87ff5c99096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5e7225f46bf941348893f87ff5c99096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5e7225f46bf941348893f87ff5c99096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5e7225f46bf941348893f87ff5c99096", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-VolumesBackupsTest-1234305305 Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 5e7225f46bf941348893f87ff5c99096 Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-VolumesBackupsTest-1234305305 Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-VolumesBackupsTest-1234305305-project Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 78b1c1599a1245498272e42fff474273 Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-VolumesBackupsTest-1234305305-project Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 0b9149f6-c750-44f6-bc8e-cad99d85089d could not be found. Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '0b9149f6-c750-44f6-bc8e-cad99d85089d'} Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b9149f6-c750-44f6-bc8e-cad99d85089d could not be found. Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b9149f6-c750-44f6-bc8e-cad99d85089d could not be found. Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:43:34.959615 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:43:34.965577 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:43:34.965577 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:43:34.965577 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:43:34.965577 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:43:34.965577 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:43:34.965577 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b9149f6-c750-44f6-bc8e-cad99d85089d could not be found. Jul 28 10:43:34.965577 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:43:34.965577 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b1478e76-be06-41ec-bb10-cf4d5db4e6af tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] Returning 404 to user: Instance 0b9149f6-c750-44f6-bc8e-cad99d85089d could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:43:34.965577 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b1478e76-be06-41ec-bb10-cf4d5db4e6af tempest-VolumesBackupsTest-1234305305 tempest-VolumesBackupsTest-1234305305-project] 10.222.0.46 "GET /compute/v2.1/servers/0b9149f6-c750-44f6-bc8e-cad99d85089d" status: 404 len: 111 microversion: 2.1 time: 0.042054 Jul 28 10:43:34.965577 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 595/1177] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:43:34 2022] GET /compute/v2.1/servers/0b9149f6-c750-44f6-bc8e-cad99d85089d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:43:34.979908 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c8311a10-45a1-42ea-b3e6-236e60bfb568 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f392c649-a270-416c-857f-371ab7812614" status: 204 len: 0 microversion: 2.1 time: 0.668614 Jul 28 10:43:34.992361 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b0db5859-cb00-407d-a94c-c7995704a673 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:34.993620 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b0db5859-cb00-407d-a94c-c7995704a673 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] [instance: f392c649-a270-416c-857f-371ab7812614] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:43:34.996541 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 583/1178] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:43:34 2022] DELETE /compute/v2.1/servers/f392c649-a270-416c-857f-371ab7812614 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:43:35.004787 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b0db5859-cb00-407d-a94c-c7995704a673 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:35.005711 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b0db5859-cb00-407d-a94c-c7995704a673 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:35.006599 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b0db5859-cb00-407d-a94c-c7995704a673 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:35.007045 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b0db5859-cb00-407d-a94c-c7995704a673 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:35.023541 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-b0db5859-cb00-407d-a94c-c7995704a673 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] HTTP exception thrown: Instance f392c649-a270-416c-857f-371ab7812614 could not be found. Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b0db5859-cb00-407d-a94c-c7995704a673 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Request method failure captured: Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/f392c649-a270-416c-857f-371ab7812614 HTTP/1.1 Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mhO6Mek6pMQ0Z7d-uNErT-EqaoTtL5PuomlpNarYwFATSxV4WicnphnsPHpeqTSiP7vJ5pLKmrhVqX7sgefSTrzBkCG1aAlr2TPMCIPCXbhs5SQJ5g5pZW2x63UUflxz4Nmm_eg5cRuh6Wmm8-kpw6ihCAIvVhNG0ojj1tMB85QHZ0 Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: e5338724a49b4a57b54618f29b406f95 Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-VolumesNegativeTest-961706079 Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e5338724a49b4a57b54618f29b406f95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e5338724a49b4a57b54618f29b406f95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e5338724a49b4a57b54618f29b406f95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e5338724a49b4a57b54618f29b406f95", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-VolumesNegativeTest-961706079 Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: e5338724a49b4a57b54618f29b406f95 Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-VolumesNegativeTest-961706079 Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-VolumesNegativeTest-961706079-project Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: b0b132e103464daeb10bc2ad8df1e8a7 Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-VolumesNegativeTest-961706079-project Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance f392c649-a270-416c-857f-371ab7812614 could not be found. Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'f392c649-a270-416c-857f-371ab7812614'} Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f392c649-a270-416c-857f-371ab7812614 could not be found. Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f392c649-a270-416c-857f-371ab7812614 could not be found. Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:43:35.025094 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:43:35.031858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:43:35.031858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:43:35.031858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:43:35.031858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:43:35.031858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:43:35.031858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f392c649-a270-416c-857f-371ab7812614 could not be found. Jul 28 10:43:35.031858 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:43:35.031858 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b0db5859-cb00-407d-a94c-c7995704a673 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] Returning 404 to user: Instance f392c649-a270-416c-857f-371ab7812614 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:43:35.031858 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b0db5859-cb00-407d-a94c-c7995704a673 tempest-VolumesNegativeTest-961706079 tempest-VolumesNegativeTest-961706079-project] 10.222.0.46 "GET /compute/v2.1/servers/f392c649-a270-416c-857f-371ab7812614" status: 404 len: 111 microversion: 2.1 time: 0.042234 Jul 28 10:43:35.031858 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 596/1179] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:43:34 2022] GET /compute/v2.1/servers/f392c649-a270-416c-857f-371ab7812614 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:43:35.317109 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a6858ac3-4b45-4f30-964e-3c86b7a5fc15 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:35.318079 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-a6858ac3-4b45-4f30-964e-3c86b7a5fc15 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] [instance: e25a6ed1-1f55-4201-b1c9-395dbddd1bc4] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:43:35.344161 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a6858ac3-4b45-4f30-964e-3c86b7a5fc15 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:35.344654 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a6858ac3-4b45-4f30-964e-3c86b7a5fc15 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:35.345492 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a6858ac3-4b45-4f30-964e-3c86b7a5fc15 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:35.345968 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a6858ac3-4b45-4f30-964e-3c86b7a5fc15 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:35.502783 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a6858ac3-4b45-4f30-964e-3c86b7a5fc15 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:35.505752 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a6858ac3-4b45-4f30-964e-3c86b7a5fc15 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:35.507089 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-a6858ac3-4b45-4f30-964e-3c86b7a5fc15 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lazy-loading 'fault' on Instance uuid e25a6ed1-1f55-4201-b1c9-395dbddd1bc4 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:43:35.687940 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-a6858ac3-4b45-4f30-964e-3c86b7a5fc15 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b74d434dc43a6b3305fb4a2981ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b900fee094054e5da82bd4b37b369b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:35.714201 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-a6858ac3-4b45-4f30-964e-3c86b7a5fc15 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b74d434dc43a6b3305fb4a2981ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b900fee094054e5da82bd4b37b369b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:35.720389 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-a6858ac3-4b45-4f30-964e-3c86b7a5fc15 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b74d434dc43a6b3305fb4a2981ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b900fee094054e5da82bd4b37b369b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:35.727780 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a6858ac3-4b45-4f30-964e-3c86b7a5fc15 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] 10.222.0.46 "GET /compute/v2.1/servers/e25a6ed1-1f55-4201-b1c9-395dbddd1bc4" status: 200 len: 1596 microversion: 2.42 time: 0.418071 Jul 28 10:43:35.741883 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 584/1180] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:43:35 2022] GET /compute/v2.1/servers/e25a6ed1-1f55-4201-b1c9-395dbddd1bc4 => generated 1596 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:43:35.757699 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-cd42894d-f338-417e-9c16-4ef84f136e20 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:35.758576 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-cd42894d-f338-417e-9c16-4ef84f136e20 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] [instance: e25a6ed1-1f55-4201-b1c9-395dbddd1bc4] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:43:35.775211 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cd42894d-f338-417e-9c16-4ef84f136e20 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:35.778032 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cd42894d-f338-417e-9c16-4ef84f136e20 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:35.779999 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cd42894d-f338-417e-9c16-4ef84f136e20 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:35.784048 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cd42894d-f338-417e-9c16-4ef84f136e20 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:35.873381 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-cd42894d-f338-417e-9c16-4ef84f136e20 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] [instance: e25a6ed1-1f55-4201-b1c9-395dbddd1bc4] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:43:35.992504 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-cd42894d-f338-417e-9c16-4ef84f136e20 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] [instance: e25a6ed1-1f55-4201-b1c9-395dbddd1bc4] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:43:35.995047 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cd42894d-f338-417e-9c16-4ef84f136e20 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:35.996812 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cd42894d-f338-417e-9c16-4ef84f136e20 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:35.997975 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-cd42894d-f338-417e-9c16-4ef84f136e20 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] [instance: e25a6ed1-1f55-4201-b1c9-395dbddd1bc4] instance's host None is down, deleting from database Jul 28 10:43:36.007125 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-cd42894d-f338-417e-9c16-4ef84f136e20 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] [instance: e25a6ed1-1f55-4201-b1c9-395dbddd1bc4] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:43:36.269322 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-cd42894d-f338-417e-9c16-4ef84f136e20 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] [instance: e25a6ed1-1f55-4201-b1c9-395dbddd1bc4] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:43:36.280579 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-cd42894d-f338-417e-9c16-4ef84f136e20 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] [instance: e25a6ed1-1f55-4201-b1c9-395dbddd1bc4] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:43:37.279243 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=66,nova_cell0:UPDATE=28,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:43:37.308674 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-cd42894d-f338-417e-9c16-4ef84f136e20 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e25a6ed1-1f55-4201-b1c9-395dbddd1bc4" status: 204 len: 0 microversion: 2.42 time: 1.555486 Jul 28 10:43:37.309961 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 597/1181] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:43:35 2022] DELETE /compute/v2.1/servers/e25a6ed1-1f55-4201-b1c9-395dbddd1bc4 => generated 0 bytes in 1557 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:43:37.319042 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-92d35995-4826-4004-a86f-7eecb5165141 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:37.319807 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-92d35995-4826-4004-a86f-7eecb5165141 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] [instance: e25a6ed1-1f55-4201-b1c9-395dbddd1bc4] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:43:37.334556 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-92d35995-4826-4004-a86f-7eecb5165141 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:37.336992 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-92d35995-4826-4004-a86f-7eecb5165141 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:37.341191 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-92d35995-4826-4004-a86f-7eecb5165141 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:43:37.341998 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-92d35995-4826-4004-a86f-7eecb5165141 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:43:37.397163 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-92d35995-4826-4004-a86f-7eecb5165141 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] HTTP exception thrown: Instance e25a6ed1-1f55-4201-b1c9-395dbddd1bc4 could not be found. Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-92d35995-4826-4004-a86f-7eecb5165141 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Request method failure captured: Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/e25a6ed1-1f55-4201-b1c9-395dbddd1bc4 HTTP/1.1 Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mfipbC9xYnJK3Es3z_JrFJmf6GUC-UrYTG6j1GnBTEpA_7iZw3cibbNfgXyGVaBFB-DoGFW8IQI6EKF1RrM_T3eI10yUEkNrziBjmvVlTFgr5YYjMZFb9ICTG3o6aYv2dfJS6RbzZLyZC53Av1bRAKgDGc61daml2r-KRYJnDwC-9M Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: X-Openstack-Nova-Api-Version: 2.42 Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: b900fee094054e5da82bd4b37b369b0e Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-265168643 Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b900fee094054e5da82bd4b37b369b0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b900fee094054e5da82bd4b37b369b0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b900fee094054e5da82bd4b37b369b0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b900fee094054e5da82bd4b37b369b0e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-TaggedBootDevicesTest_v242-265168643 Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: b900fee094054e5da82bd4b37b369b0e Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-265168643 Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-TaggedBootDevicesTest_v242-265168643-project Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 337b74d434dc43a6b3305fb4a2981ad7 Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-TaggedBootDevicesTest_v242-265168643-project Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance e25a6ed1-1f55-4201-b1c9-395dbddd1bc4 could not be found. Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'e25a6ed1-1f55-4201-b1c9-395dbddd1bc4'} Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e25a6ed1-1f55-4201-b1c9-395dbddd1bc4 could not be found. Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e25a6ed1-1f55-4201-b1c9-395dbddd1bc4 could not be found. Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:43:37.401637 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:43:37.406633 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:43:37.406633 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:43:37.406633 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:43:37.406633 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:43:37.406633 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:43:37.406633 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:43:37.406633 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e25a6ed1-1f55-4201-b1c9-395dbddd1bc4 could not be found. Jul 28 10:43:37.406633 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:43:37.413487 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-92d35995-4826-4004-a86f-7eecb5165141 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Returning 404 to user: Instance e25a6ed1-1f55-4201-b1c9-395dbddd1bc4 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:43:37.413487 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-92d35995-4826-4004-a86f-7eecb5165141 tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] 10.222.0.46 "GET /compute/v2.1/servers/e25a6ed1-1f55-4201-b1c9-395dbddd1bc4" status: 404 len: 111 microversion: 2.42 time: 0.095141 Jul 28 10:43:37.413487 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 585/1182] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:43:37 2022] GET /compute/v2.1/servers/e25a6ed1-1f55-4201-b1c9-395dbddd1bc4 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:43:37.420053 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-58a54480-5206-47b6-b1b3-ef145a0062ae tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] Calling method '.version_select at 0x7fa94ba3b790>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:37.464430 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-58a54480-5206-47b6-b1b3-ef145a0062ae tempest-TaggedBootDevicesTest_v242-265168643 tempest-TaggedBootDevicesTest_v242-265168643-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1871884598" status: 204 len: 0 microversion: 2.42 time: 0.048873 Jul 28 10:43:37.465308 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 598/1183] 10.222.0.46 () {60 vars in 1262 bytes} [Thu Jul 28 10:43:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1871884598 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:44:56.676723 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:44:56.677961 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=16 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:44:56.681648 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:44:56.682495 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=44,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:44:57.647086 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-bd80946a-42b9-4b90-bf00-8acc9a41efe9 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:44:57.647864 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:44:57.647864 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:44:57.649576 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bd80946a-42b9-4b90-bf00-8acc9a41efe9 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:44:57.650053 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bd80946a-42b9-4b90-bf00-8acc9a41efe9 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:44:57.650855 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bd80946a-42b9-4b90-bf00-8acc9a41efe9 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:44:57.651287 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bd80946a-42b9-4b90-bf00-8acc9a41efe9 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:44:57.706399 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-bd80946a-42b9-4b90-bf00-8acc9a41efe9 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] 10.222.0.46 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 1.031157 Jul 28 10:44:57.718312 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 586/1184] 10.222.0.46 () {58 vars in 1185 bytes} [Thu Jul 28 10:44:56 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:44:57.910013 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:44:57.910784 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=14 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:44:57.911814 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:44:57.917305 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1460072697", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "availability_zone": "nova:n-h2-850468-6", "networks": [{"uuid": "b04ec3a9-73dd-43b9-8a36-fd7c72b5c582"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:44:58.035789 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] validate_networks() for [('b04ec3a9-73dd-43b9-8a36-fd7c72b5c582', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:45:01.287255 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:45:01.288400 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:45:01.289703 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:45:01.290635 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:45:01.291246 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:45:01.306983 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:01.309440 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:01.314936 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:01.315381 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:01.365966 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Getting quotas for project c688961aeda5402da0f5849c50d074c4. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:45:01.373420 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Getting quotas for user d89e4ac771e64a4bb96c1a3d5262514a and project c688961aeda5402da0f5849c50d074c4. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:45:01.400444 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:45:01.404079 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] [instance: 909ef1da-9941-448d-92ba-68a1d4812513] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:45:01.524877 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-90d26424-e764-4e3d-a8ec-094e08c5dd7f tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.615951 Jul 28 10:45:01.528088 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 599/1185] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:44:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 3620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:45:01.537219 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d2dbf371-3836-4a68-bf4c-9aa37b27230d tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:01.538533 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-d2dbf371-3836-4a68-bf4c-9aa37b27230d tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] [instance: 909ef1da-9941-448d-92ba-68a1d4812513] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:45:01.927036 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d2dbf371-3836-4a68-bf4c-9aa37b27230d tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/909ef1da-9941-448d-92ba-68a1d4812513" status: 200 len: 1329 microversion: 2.1 time: 0.393984 Jul 28 10:45:01.941108 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 587/1186] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:45:01 2022] GET /compute/v2.1/servers/909ef1da-9941-448d-92ba-68a1d4812513 => generated 1329 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:45:02.962900 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-aac61772-f5cd-4a20-8d48-42adc3d9f61b tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:02.964389 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-aac61772-f5cd-4a20-8d48-42adc3d9f61b tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] [instance: 909ef1da-9941-448d-92ba-68a1d4812513] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:45:02.991392 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-aac61772-f5cd-4a20-8d48-42adc3d9f61b tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:02.993085 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-aac61772-f5cd-4a20-8d48-42adc3d9f61b tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:02.995746 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-aac61772-f5cd-4a20-8d48-42adc3d9f61b tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:02.998037 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-aac61772-f5cd-4a20-8d48-42adc3d9f61b tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:03.329203 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-aac61772-f5cd-4a20-8d48-42adc3d9f61b tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:03.330333 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-aac61772-f5cd-4a20-8d48-42adc3d9f61b tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:03.335956 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-aac61772-f5cd-4a20-8d48-42adc3d9f61b tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lazy-loading 'fault' on Instance uuid 909ef1da-9941-448d-92ba-68a1d4812513 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:45:03.422836 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1782455835", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "509b896f-8544-44bb-a462-b993cf2a2f1a"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:45:03.526353 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] validate_networks() for [('509b896f-8544-44bb-a462-b993cf2a2f1a', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:45:03.801539 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-aac61772-f5cd-4a20-8d48-42adc3d9f61b tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/909ef1da-9941-448d-92ba-68a1d4812513" status: 200 len: 3128 microversion: 2.1 time: 0.856235 Jul 28 10:45:03.823117 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 600/1187] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:45:02 2022] GET /compute/v2.1/servers/909ef1da-9941-448d-92ba-68a1d4812513 => generated 3128 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:45:03.830770 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-835ad423-0676-4a7a-b622-9585acb49f45 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:03.831670 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-835ad423-0676-4a7a-b622-9585acb49f45 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] [instance: 909ef1da-9941-448d-92ba-68a1d4812513] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:45:03.857833 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-835ad423-0676-4a7a-b622-9585acb49f45 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:03.858564 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-835ad423-0676-4a7a-b622-9585acb49f45 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:03.859861 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-835ad423-0676-4a7a-b622-9585acb49f45 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:03.860528 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-835ad423-0676-4a7a-b622-9585acb49f45 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:03.929701 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-835ad423-0676-4a7a-b622-9585acb49f45 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] [instance: 909ef1da-9941-448d-92ba-68a1d4812513] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:45:04.319586 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-835ad423-0676-4a7a-b622-9585acb49f45 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] [instance: 909ef1da-9941-448d-92ba-68a1d4812513] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:45:04.321737 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-835ad423-0676-4a7a-b622-9585acb49f45 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:04.322516 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-835ad423-0676-4a7a-b622-9585acb49f45 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:04.323769 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-835ad423-0676-4a7a-b622-9585acb49f45 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] [instance: 909ef1da-9941-448d-92ba-68a1d4812513] instance's host None is down, deleting from database Jul 28 10:45:04.330149 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-835ad423-0676-4a7a-b622-9585acb49f45 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] [instance: 909ef1da-9941-448d-92ba-68a1d4812513] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:45:04.595014 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-835ad423-0676-4a7a-b622-9585acb49f45 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] [instance: 909ef1da-9941-448d-92ba-68a1d4812513] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:45:04.606733 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-835ad423-0676-4a7a-b622-9585acb49f45 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] [instance: 909ef1da-9941-448d-92ba-68a1d4812513] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:45:04.949796 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-835ad423-0676-4a7a-b622-9585acb49f45 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] 10.222.0.46 "DELETE /compute/v2.1/servers/909ef1da-9941-448d-92ba-68a1d4812513" status: 204 len: 0 microversion: 2.1 time: 1.122719 Jul 28 10:45:04.950873 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 601/1188] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:45:03 2022] DELETE /compute/v2.1/servers/909ef1da-9941-448d-92ba-68a1d4812513 => generated 0 bytes in 1124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 10:45:04.960934 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-74524d05-397a-4372-84c2-b40867082083 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:04.961989 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-74524d05-397a-4372-84c2-b40867082083 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] [instance: 909ef1da-9941-448d-92ba-68a1d4812513] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:45:04.969295 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-74524d05-397a-4372-84c2-b40867082083 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:04.970173 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-74524d05-397a-4372-84c2-b40867082083 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:04.971201 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-74524d05-397a-4372-84c2-b40867082083 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:04.971864 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-74524d05-397a-4372-84c2-b40867082083 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:04.993838 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-74524d05-397a-4372-84c2-b40867082083 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] HTTP exception thrown: Instance 909ef1da-9941-448d-92ba-68a1d4812513 could not be found. Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-74524d05-397a-4372-84c2-b40867082083 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Request method failure captured: Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/909ef1da-9941-448d-92ba-68a1d4812513 HTTP/1.1 Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mioLM2hTiRUDIKB4QSaUKWHAzM_AwoPOGrApTgg2wwmidGOmrIclfNU6z_lJwCClqU8XGCNZjUCwZ8VwRPOdwj_LyKtAPVGFpgUIfeKkwucI1IH5breOD6tMcc8IqDimndy39qfX1Epy0iGQ2EV743Vop-T7lL8Ia52vkxn_k5iS08 Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: c688961aeda5402da0f5849c50d074c4 Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-TestServerMultinode-1729641561 Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member,admin Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member,admin Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c688961aeda5402da0f5849c50d074c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c688961aeda5402da0f5849c50d074c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c688961aeda5402da0f5849c50d074c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c688961aeda5402da0f5849c50d074c4", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-TestServerMultinode-1729641561 Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: c688961aeda5402da0f5849c50d074c4 Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-TestServerMultinode-1729641561 Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-TestServerMultinode-1729641561-project-admin Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: d89e4ac771e64a4bb96c1a3d5262514a Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-TestServerMultinode-1729641561-project-admin Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 909ef1da-9941-448d-92ba-68a1d4812513 could not be found. Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '909ef1da-9941-448d-92ba-68a1d4812513'} Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 909ef1da-9941-448d-92ba-68a1d4812513 could not be found. Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 909ef1da-9941-448d-92ba-68a1d4812513 could not be found. Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:45:04.999509 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:45:05.006734 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:45:05.006734 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:45:05.006734 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:45:05.006734 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:45:05.006734 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:45:05.006734 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 909ef1da-9941-448d-92ba-68a1d4812513 could not be found. Jul 28 10:45:05.006734 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:45:05.006734 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-74524d05-397a-4372-84c2-b40867082083 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] Returning 404 to user: Instance 909ef1da-9941-448d-92ba-68a1d4812513 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:45:05.008466 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-74524d05-397a-4372-84c2-b40867082083 tempest-TestServerMultinode-1729641561 tempest-TestServerMultinode-1729641561-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/909ef1da-9941-448d-92ba-68a1d4812513" status: 404 len: 111 microversion: 2.1 time: 0.049765 Jul 28 10:45:05.010857 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 602/1189] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:45:04 2022] GET /compute/v2.1/servers/909ef1da-9941-448d-92ba-68a1d4812513 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:45:05.703823 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:45:05.704382 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:45:05.704705 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:45:05.705099 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:45:05.705510 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:45:05.719429 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:05.719888 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:05.720685 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:05.723970 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:05.777130 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Getting quotas for project 250e9ea221004badbf41f4631cdc26bc. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:45:05.790367 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Getting quotas for user 7adc18824ee742cbb59a3529418d77e1 and project 250e9ea221004badbf41f4631cdc26bc. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:45:05.823750 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:45:05.825981 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] [instance: 9e677213-64e8-4eb6-aa22-d9da1c8bcd97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:45:05.955401 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-9857455c-c5ef-48b8-be9e-4ca9083d6f25 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.832097 Jul 28 10:45:05.965651 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 588/1190] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Jul 28 10:45:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2843 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 28 10:45:05.971409 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-bd2dacfd-b63c-4151-b153-06161cbb572d tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:05.972669 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-bd2dacfd-b63c-4151-b153-06161cbb572d tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] [instance: 9e677213-64e8-4eb6-aa22-d9da1c8bcd97] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:45:06.557304 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-bd2dacfd-b63c-4151-b153-06161cbb572d tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7adc18824ee742cbb59a3529418d77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e9ea221004badbf41f4631cdc26bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:45:06.576332 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-bd2dacfd-b63c-4151-b153-06161cbb572d tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7adc18824ee742cbb59a3529418d77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e9ea221004badbf41f4631cdc26bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:45:06.586026 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-bd2dacfd-b63c-4151-b153-06161cbb572d tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7adc18824ee742cbb59a3529418d77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e9ea221004badbf41f4631cdc26bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:45:06.591021 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-bd2dacfd-b63c-4151-b153-06161cbb572d tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] 10.222.0.46 "GET /compute/v2.1/servers/9e677213-64e8-4eb6-aa22-d9da1c8bcd97" status: 200 len: 1259 microversion: 2.21 time: 0.624063 Jul 28 10:45:06.595600 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 603/1191] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:45:05 2022] GET /compute/v2.1/servers/9e677213-64e8-4eb6-aa22-d9da1c8bcd97 => generated 1259 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:45:07.621245 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-662f875c-5bf9-4ce1-8a78-17bce33359a2 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:07.622807 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-662f875c-5bf9-4ce1-8a78-17bce33359a2 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] [instance: 9e677213-64e8-4eb6-aa22-d9da1c8bcd97] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:45:07.644745 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-662f875c-5bf9-4ce1-8a78-17bce33359a2 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:07.645524 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-662f875c-5bf9-4ce1-8a78-17bce33359a2 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:07.646746 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-662f875c-5bf9-4ce1-8a78-17bce33359a2 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:07.649685 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-662f875c-5bf9-4ce1-8a78-17bce33359a2 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:07.747294 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-662f875c-5bf9-4ce1-8a78-17bce33359a2 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:07.748066 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-662f875c-5bf9-4ce1-8a78-17bce33359a2 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:07.751860 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-662f875c-5bf9-4ce1-8a78-17bce33359a2 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lazy-loading 'fault' on Instance uuid 9e677213-64e8-4eb6-aa22-d9da1c8bcd97 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:45:08.017254 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-662f875c-5bf9-4ce1-8a78-17bce33359a2 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7adc18824ee742cbb59a3529418d77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e9ea221004badbf41f4631cdc26bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:45:08.057774 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-662f875c-5bf9-4ce1-8a78-17bce33359a2 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7adc18824ee742cbb59a3529418d77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e9ea221004badbf41f4631cdc26bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:45:08.062249 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-662f875c-5bf9-4ce1-8a78-17bce33359a2 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7adc18824ee742cbb59a3529418d77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e9ea221004badbf41f4631cdc26bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:45:08.065338 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-662f875c-5bf9-4ce1-8a78-17bce33359a2 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] 10.222.0.46 "GET /compute/v2.1/servers/9e677213-64e8-4eb6-aa22-d9da1c8bcd97" status: 200 len: 1332 microversion: 2.21 time: 0.446669 Jul 28 10:45:08.080636 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 589/1192] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:45:07 2022] GET /compute/v2.1/servers/9e677213-64e8-4eb6-aa22-d9da1c8bcd97 => generated 1332 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:45:08.119111 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9908daa4-b8c6-420b-aabb-32d9f76fcd81 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:08.120192 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-9908daa4-b8c6-420b-aabb-32d9f76fcd81 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] [instance: 9e677213-64e8-4eb6-aa22-d9da1c8bcd97] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:45:08.152344 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9908daa4-b8c6-420b-aabb-32d9f76fcd81 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:08.153248 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9908daa4-b8c6-420b-aabb-32d9f76fcd81 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:08.154405 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9908daa4-b8c6-420b-aabb-32d9f76fcd81 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:08.157052 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9908daa4-b8c6-420b-aabb-32d9f76fcd81 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:08.204297 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-9908daa4-b8c6-420b-aabb-32d9f76fcd81 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] [instance: 9e677213-64e8-4eb6-aa22-d9da1c8bcd97] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:45:08.388351 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-9908daa4-b8c6-420b-aabb-32d9f76fcd81 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] [instance: 9e677213-64e8-4eb6-aa22-d9da1c8bcd97] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:45:08.397692 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9908daa4-b8c6-420b-aabb-32d9f76fcd81 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:08.398835 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9908daa4-b8c6-420b-aabb-32d9f76fcd81 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:08.401504 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-9908daa4-b8c6-420b-aabb-32d9f76fcd81 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] [instance: 9e677213-64e8-4eb6-aa22-d9da1c8bcd97] instance's host None is down, deleting from database Jul 28 10:45:08.417848 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-9908daa4-b8c6-420b-aabb-32d9f76fcd81 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] [instance: 9e677213-64e8-4eb6-aa22-d9da1c8bcd97] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:45:08.881394 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-9908daa4-b8c6-420b-aabb-32d9f76fcd81 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] [instance: 9e677213-64e8-4eb6-aa22-d9da1c8bcd97] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:45:08.890381 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-9908daa4-b8c6-420b-aabb-32d9f76fcd81 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] [instance: 9e677213-64e8-4eb6-aa22-d9da1c8bcd97] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:45:09.292822 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:UPDATE=32,nova_cell0:DELETE=4,nova_cell0:SELECT=60,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:45:09.329152 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9908daa4-b8c6-420b-aabb-32d9f76fcd81 tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9e677213-64e8-4eb6-aa22-d9da1c8bcd97" status: 204 len: 0 microversion: 2.21 time: 1.221873 Jul 28 10:45:09.332014 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 604/1193] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 10:45:08 2022] DELETE /compute/v2.1/servers/9e677213-64e8-4eb6-aa22-d9da1c8bcd97 => generated 0 bytes in 1226 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:45:09.340945 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-956a4494-87c5-448b-b7d1-61bb6e28ccde tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:09.342343 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-956a4494-87c5-448b-b7d1-61bb6e28ccde tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] [instance: 9e677213-64e8-4eb6-aa22-d9da1c8bcd97] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:45:09.356285 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-956a4494-87c5-448b-b7d1-61bb6e28ccde tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:09.363023 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-956a4494-87c5-448b-b7d1-61bb6e28ccde tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:09.365504 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-956a4494-87c5-448b-b7d1-61bb6e28ccde tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:09.368505 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-956a4494-87c5-448b-b7d1-61bb6e28ccde tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:09.416520 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-956a4494-87c5-448b-b7d1-61bb6e28ccde tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] HTTP exception thrown: Instance 9e677213-64e8-4eb6-aa22-d9da1c8bcd97 could not be found. Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-956a4494-87c5-448b-b7d1-61bb6e28ccde tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Request method failure captured: Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/9e677213-64e8-4eb6-aa22-d9da1c8bcd97 HTTP/1.1 Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4miumh-l2s4133I-qOHCh35ahOxw0qR8FoMHSs3_8RgxMYLWMAuEf-riOR-DBLlhNi04UAh8Qpl8OPexF-Wr2jRyYF6gVXPNReTdZf64PbZnpDzlzlWys7R5NnEmSVrn4C9Sx7lVel0n0UOMvdP4R261ASlXiJIY3zQILGc5LfeH9yE Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: X-Openstack-Nova-Api-Version: 2.21 Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 250e9ea221004badbf41f4631cdc26bc Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1929519920 Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/250e9ea221004badbf41f4631cdc26bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/250e9ea221004badbf41f4631cdc26bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/250e9ea221004badbf41f4631cdc26bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_250e9ea221004badbf41f4631cdc26bc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-InstanceActionsV221TestJSON-1929519920 Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 250e9ea221004badbf41f4631cdc26bc Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1929519920 Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-InstanceActionsV221TestJSON-1929519920-project Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 7adc18824ee742cbb59a3529418d77e1 Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-InstanceActionsV221TestJSON-1929519920-project Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 9e677213-64e8-4eb6-aa22-d9da1c8bcd97 could not be found. Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '9e677213-64e8-4eb6-aa22-d9da1c8bcd97'} Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e677213-64e8-4eb6-aa22-d9da1c8bcd97 could not be found. Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e677213-64e8-4eb6-aa22-d9da1c8bcd97 could not be found. Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:45:09.420890 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:45:09.425706 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:45:09.425706 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:45:09.425706 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:45:09.425706 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:45:09.425706 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:45:09.425706 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:45:09.425706 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e677213-64e8-4eb6-aa22-d9da1c8bcd97 could not be found. Jul 28 10:45:09.425706 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:45:09.425706 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-956a4494-87c5-448b-b7d1-61bb6e28ccde tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] Returning 404 to user: Instance 9e677213-64e8-4eb6-aa22-d9da1c8bcd97 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:45:09.425706 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-956a4494-87c5-448b-b7d1-61bb6e28ccde tempest-InstanceActionsV221TestJSON-1929519920 tempest-InstanceActionsV221TestJSON-1929519920-project] 10.222.0.46 "GET /compute/v2.1/servers/9e677213-64e8-4eb6-aa22-d9da1c8bcd97" status: 404 len: 111 microversion: 2.21 time: 0.085547 Jul 28 10:45:09.435318 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 590/1194] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 10:45:09 2022] GET /compute/v2.1/servers/9e677213-64e8-4eb6-aa22-d9da1c8bcd97 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:45:26.314101 n-d-850468-6 devstack@n-api.service[119463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:45:26.315702 n-d-850468-6 devstack@n-api.service[119463]: Thu Jul 28 10:45:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 10:45:47.130143 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:45:47.132719 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=8 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:45:47.133944 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:45:47.487326 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-2025225998", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "96d05408-eedf-4646-93cb-6768efac6dfb"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:45:47.841119 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] validate_networks() for [('96d05408-eedf-4646-93cb-6768efac6dfb', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:45:50.553131 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:45:50.554140 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:45:50.554812 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:45:50.555411 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:45:50.556011 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:45:50.586201 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:50.591727 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:50.592577 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:50.593078 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:50.626928 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Getting quotas for project 42b982235395445cb6be74b9fc2cf4e7. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:45:50.633760 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Getting quotas for user d20ee5f0d8e84869aa1085575ce80df8 and project 42b982235395445cb6be74b9fc2cf4e7. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:45:50.664586 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:45:50.666878 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] [instance: c0ed7115-742c-4dbc-abd5-f88e9d7ee630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:45:50.740456 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-cf2025df-65a2-4a1d-a624-5457dfa41891 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.618296 Jul 28 10:45:50.742581 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 605/1195] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:45:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:45:50.753744 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-fc98e23c-5f0e-4031-91ba-f3c131f520f8 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:50.755221 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-fc98e23c-5f0e-4031-91ba-f3c131f520f8 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] [instance: c0ed7115-742c-4dbc-abd5-f88e9d7ee630] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:45:50.761922 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:45:50.763777 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=8 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:45:50.764664 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:45:50.768841 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=14 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:45:51.329713 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-fc98e23c-5f0e-4031-91ba-f3c131f520f8 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ee5f0d8e84869aa1085575ce80df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b982235395445cb6be74b9fc2cf4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:45:51.340618 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-fc98e23c-5f0e-4031-91ba-f3c131f520f8 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] 10.222.0.46 "GET /compute/v2.1/servers/c0ed7115-742c-4dbc-abd5-f88e9d7ee630" status: 200 len: 1225 microversion: 2.1 time: 0.591787 Jul 28 10:45:51.349344 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 591/1196] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:45:50 2022] GET /compute/v2.1/servers/c0ed7115-742c-4dbc-abd5-f88e9d7ee630 => generated 1225 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:45:52.368405 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4279d078-ad17-46b8-a660-c472e7f71b2e tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:52.369032 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-4279d078-ad17-46b8-a660-c472e7f71b2e tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] [instance: c0ed7115-742c-4dbc-abd5-f88e9d7ee630] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:45:52.376750 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4279d078-ad17-46b8-a660-c472e7f71b2e tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:52.377210 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4279d078-ad17-46b8-a660-c472e7f71b2e tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:52.378118 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4279d078-ad17-46b8-a660-c472e7f71b2e tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:52.378554 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4279d078-ad17-46b8-a660-c472e7f71b2e tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:52.438755 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4279d078-ad17-46b8-a660-c472e7f71b2e tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:52.440361 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4279d078-ad17-46b8-a660-c472e7f71b2e tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:52.442137 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-4279d078-ad17-46b8-a660-c472e7f71b2e tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lazy-loading 'fault' on Instance uuid c0ed7115-742c-4dbc-abd5-f88e9d7ee630 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:45:52.678179 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-4279d078-ad17-46b8-a660-c472e7f71b2e tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ee5f0d8e84869aa1085575ce80df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b982235395445cb6be74b9fc2cf4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:45:52.719707 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-4279d078-ad17-46b8-a660-c472e7f71b2e tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] 10.222.0.46 "GET /compute/v2.1/servers/c0ed7115-742c-4dbc-abd5-f88e9d7ee630" status: 200 len: 1298 microversion: 2.1 time: 0.354360 Jul 28 10:45:52.720568 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 606/1197] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:45:52 2022] GET /compute/v2.1/servers/c0ed7115-742c-4dbc-abd5-f88e9d7ee630 => generated 1298 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:45:52.744858 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1b95bc8d-f878-4b15-952b-64e137b15ad2 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:52.748403 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1b95bc8d-f878-4b15-952b-64e137b15ad2 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] [instance: c0ed7115-742c-4dbc-abd5-f88e9d7ee630] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:45:52.773179 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1b95bc8d-f878-4b15-952b-64e137b15ad2 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:52.775057 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1b95bc8d-f878-4b15-952b-64e137b15ad2 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:52.775879 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1b95bc8d-f878-4b15-952b-64e137b15ad2 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:52.779874 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1b95bc8d-f878-4b15-952b-64e137b15ad2 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:52.835641 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1b95bc8d-f878-4b15-952b-64e137b15ad2 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] [instance: c0ed7115-742c-4dbc-abd5-f88e9d7ee630] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:45:52.936890 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1b95bc8d-f878-4b15-952b-64e137b15ad2 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] [instance: c0ed7115-742c-4dbc-abd5-f88e9d7ee630] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:45:52.938226 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1b95bc8d-f878-4b15-952b-64e137b15ad2 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:52.938698 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1b95bc8d-f878-4b15-952b-64e137b15ad2 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:52.939197 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-1b95bc8d-f878-4b15-952b-64e137b15ad2 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] [instance: c0ed7115-742c-4dbc-abd5-f88e9d7ee630] instance's host None is down, deleting from database Jul 28 10:45:52.945259 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-1b95bc8d-f878-4b15-952b-64e137b15ad2 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] [instance: c0ed7115-742c-4dbc-abd5-f88e9d7ee630] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:45:53.034242 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-1b95bc8d-f878-4b15-952b-64e137b15ad2 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] [instance: c0ed7115-742c-4dbc-abd5-f88e9d7ee630] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:45:53.047903 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-1b95bc8d-f878-4b15-952b-64e137b15ad2 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] [instance: c0ed7115-742c-4dbc-abd5-f88e9d7ee630] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:45:53.770656 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-1b95bc8d-f878-4b15-952b-64e137b15ad2 tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c0ed7115-742c-4dbc-abd5-f88e9d7ee630" status: 204 len: 0 microversion: 2.1 time: 1.031747 Jul 28 10:45:53.786546 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4aa7dd80-d7da-4444-a69e-57b8b3e9063a tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:53.786546 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-4aa7dd80-d7da-4444-a69e-57b8b3e9063a tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] [instance: c0ed7115-742c-4dbc-abd5-f88e9d7ee630] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:45:53.787878 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 592/1198] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:45:52 2022] DELETE /compute/v2.1/servers/c0ed7115-742c-4dbc-abd5-f88e9d7ee630 => generated 0 bytes in 1034 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:45:53.796728 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4aa7dd80-d7da-4444-a69e-57b8b3e9063a tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:53.797373 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4aa7dd80-d7da-4444-a69e-57b8b3e9063a tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:53.798349 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4aa7dd80-d7da-4444-a69e-57b8b3e9063a tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:45:53.798900 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4aa7dd80-d7da-4444-a69e-57b8b3e9063a tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:45:53.838717 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-4aa7dd80-d7da-4444-a69e-57b8b3e9063a tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] HTTP exception thrown: Instance c0ed7115-742c-4dbc-abd5-f88e9d7ee630 could not be found. Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4aa7dd80-d7da-4444-a69e-57b8b3e9063a tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Request method failure captured: Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/c0ed7115-742c-4dbc-abd5-f88e9d7ee630 HTTP/1.1 Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mjajlNuAVG0ZFrtqA8Hwp1xEkjLKbzsAaTFuuc_5p7VFVEZpdFZ3WEpyuYiy6u5vBT-_Qw-PrDv98qrpSuzMkElQS4zX7cS5uMmbl0d-mu8-S_HNc9pphLzk5cNMIWJ0qU6-iuNj0VepuqcXiB2uT7ydxxvbbAhsXyF1qqJZ33lLUk Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 42b982235395445cb6be74b9fc2cf4e7 Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1346901576 Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/42b982235395445cb6be74b9fc2cf4e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/42b982235395445cb6be74b9fc2cf4e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/42b982235395445cb6be74b9fc2cf4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_42b982235395445cb6be74b9fc2cf4e7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1346901576 Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 42b982235395445cb6be74b9fc2cf4e7 Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1346901576 Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-InstanceActionsNegativeTestJSON-1346901576-project Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: d20ee5f0d8e84869aa1085575ce80df8 Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1346901576-project Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance c0ed7115-742c-4dbc-abd5-f88e9d7ee630 could not be found. Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'c0ed7115-742c-4dbc-abd5-f88e9d7ee630'} Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0ed7115-742c-4dbc-abd5-f88e9d7ee630 could not be found. Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0ed7115-742c-4dbc-abd5-f88e9d7ee630 could not be found. Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:45:53.840696 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:45:53.845448 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:45:53.845448 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:45:53.845448 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:45:53.845448 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:45:53.845448 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:45:53.845448 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:45:53.845448 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0ed7115-742c-4dbc-abd5-f88e9d7ee630 could not be found. Jul 28 10:45:53.845448 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:45:53.846833 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4aa7dd80-d7da-4444-a69e-57b8b3e9063a tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] Returning 404 to user: Instance c0ed7115-742c-4dbc-abd5-f88e9d7ee630 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:45:53.848784 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-4aa7dd80-d7da-4444-a69e-57b8b3e9063a tempest-InstanceActionsNegativeTestJSON-1346901576 tempest-InstanceActionsNegativeTestJSON-1346901576-project] 10.222.0.46 "GET /compute/v2.1/servers/c0ed7115-742c-4dbc-abd5-f88e9d7ee630" status: 404 len: 111 microversion: 2.1 time: 0.070757 Jul 28 10:45:53.849617 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 607/1199] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:45:53 2022] GET /compute/v2.1/servers/c0ed7115-742c-4dbc-abd5-f88e9d7ee630 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:46:40.431491 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1604147193", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f2fe40e2-e69e-434c-8219-756966d318b2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "60cc7037-2405-4fb9-943a-b808862d4369"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:46:40.481010 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:46:40.482292 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:46:40.486464 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:46:40.725225 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] validate_networks() for [('60cc7037-2405-4fb9-943a-b808862d4369', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:46:41.117747 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:46:41.130151 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=6 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:46:41.139828 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:46:41.140492 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:UPDATE=2,nova_cell0:DELETE=2,nova_cell0:SELECT=12 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:46:41.512899 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-75807924", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "de6ab044-62c3-4931-bccf-ee1cec01f1d0"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:46:41.631972 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] validate_networks() for [('de6ab044-62c3-4931-bccf-ee1cec01f1d0', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:46:44.650557 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:46:44.651121 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:46:44.651510 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:46:44.651870 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:46:44.652284 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:46:44.684193 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:44.689620 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:44.690779 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:44.691256 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:44.716871 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:46:44.717323 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:46:44.717771 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:46:44.718212 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:46:44.718628 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:46:44.748947 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:44.759949 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:44.761229 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:44.766448 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:44.836122 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Getting quotas for project c153af93b73a42319a79b2bf94d696be. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:46:44.865401 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Getting quotas for user c17c1672c6fb444d854d4060d5ee9f6a and project c153af93b73a42319a79b2bf94d696be. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:46:44.874641 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Getting quotas for project a8209f1d63904867a0c74297c01a12c0. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:46:44.908157 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Getting quotas for user f4c9167954974c6a8908f2d61cb9aa5a and project a8209f1d63904867a0c74297c01a12c0. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:46:44.932776 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Going to run 3 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:46:44.935116 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: e5ede991-6b40-42cd-8353-cb63cadbcb24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:46:45.080190 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: eb5b6e3a-d7b5-43f3-9179-921832b4b6c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=e5ede991-6b40-42cd-8353-cb63cadbcb24,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:46:45.191666 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:46:45.193654 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 777d70fa-f03b-4d86-b41a-8467b637500a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f2fe40e2-e69e-434c-8219-756966d318b2',volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:46:45.213037 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: b860a7c5-df92-4e9d-a91b-41ddbbf41ef7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=eb5b6e3a-d7b5-43f3-9179-921832b4b6c1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:46:45.451154 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-5c742b4b-2c82-4cec-882d-dec656975550 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.351520 Jul 28 10:46:45.455659 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 608/1200] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:46:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 4358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:46:45.467482 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9001ef76-5af4-4f4c-99c5-ddabb7d4b4e8 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:45.484743 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-9001ef76-5af4-4f4c-99c5-ddabb7d4b4e8 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c17c1672c6fb444d854d4060d5ee9f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c153af93b73a42319a79b2bf94d696be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:45.486931 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-9001ef76-5af4-4f4c-99c5-ddabb7d4b4e8 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Searching by: {'deleted': False, 'project_id': 'c153af93b73a42319a79b2bf94d696be'} {{(pid=119464) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 10:46:45.586271 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9001ef76-5af4-4f4c-99c5-ddabb7d4b4e8 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:45.586836 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9001ef76-5af4-4f4c-99c5-ddabb7d4b4e8 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:45.588380 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9001ef76-5af4-4f4c-99c5-ddabb7d4b4e8 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:45.591419 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9001ef76-5af4-4f4c-99c5-ddabb7d4b4e8 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:45.602221 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-1bdc0eaf-2753-45c9-8612-f05c04965a4f tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.175521 Jul 28 10:46:45.608513 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 593/1201] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:46:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 5182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:46:45.614705 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7046b6a1-7c56-417d-ae4f-830f2477d7bf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:45.615520 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-7046b6a1-7c56-417d-ae4f-830f2477d7bf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 777d70fa-f03b-4d86-b41a-8467b637500a] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:46:45.900009 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9001ef76-5af4-4f4c-99c5-ddabb7d4b4e8 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.439425 Jul 28 10:46:45.911707 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 609/1202] 10.222.0.46 () {58 vars in 1125 bytes} [Thu Jul 28 10:46:45 2022] GET /compute/v2.1/servers => generated 1012 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:46:45.926483 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-83387b2d-a9ca-42b6-b75c-7c69cf87310c tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:45.927540 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-83387b2d-a9ca-42b6-b75c-7c69cf87310c tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: b860a7c5-df92-4e9d-a91b-41ddbbf41ef7] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:46:46.106081 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-7046b6a1-7c56-417d-ae4f-830f2477d7bf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c9167954974c6a8908f2d61cb9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8209f1d63904867a0c74297c01a12c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:46.115409 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-7046b6a1-7c56-417d-ae4f-830f2477d7bf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "GET /compute/v2.1/servers/777d70fa-f03b-4d86-b41a-8467b637500a" status: 200 len: 1057 microversion: 2.1 time: 0.504766 Jul 28 10:46:46.137932 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 594/1203] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:46:45 2022] GET /compute/v2.1/servers/777d70fa-f03b-4d86-b41a-8467b637500a => generated 1057 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:46.357123 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-83387b2d-a9ca-42b6-b75c-7c69cf87310c tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c1672c6fb444d854d4060d5ee9f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c153af93b73a42319a79b2bf94d696be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:46.377043 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-83387b2d-a9ca-42b6-b75c-7c69cf87310c tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] 10.222.0.46 "GET /compute/v2.1/servers/b860a7c5-df92-4e9d-a91b-41ddbbf41ef7" status: 200 len: 1221 microversion: 2.1 time: 0.459307 Jul 28 10:46:46.377734 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 610/1204] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:46:45 2022] GET /compute/v2.1/servers/b860a7c5-df92-4e9d-a91b-41ddbbf41ef7 => generated 1221 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:47.149640 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8e95df6f-cee8-4e23-a064-46bc168c5b64 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:47.150292 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-8e95df6f-cee8-4e23-a064-46bc168c5b64 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 777d70fa-f03b-4d86-b41a-8467b637500a] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:46:47.179310 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8e95df6f-cee8-4e23-a064-46bc168c5b64 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:47.179781 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8e95df6f-cee8-4e23-a064-46bc168c5b64 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:47.191266 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8e95df6f-cee8-4e23-a064-46bc168c5b64 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:47.198727 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8e95df6f-cee8-4e23-a064-46bc168c5b64 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:47.288732 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8e95df6f-cee8-4e23-a064-46bc168c5b64 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:47.290470 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8e95df6f-cee8-4e23-a064-46bc168c5b64 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:47.291196 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-8e95df6f-cee8-4e23-a064-46bc168c5b64 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lazy-loading 'fault' on Instance uuid 777d70fa-f03b-4d86-b41a-8467b637500a {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:46:47.411637 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a5a39287-c79d-4867-a98f-f7144ceb81a4 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:47.412413 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a5a39287-c79d-4867-a98f-f7144ceb81a4 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: b860a7c5-df92-4e9d-a91b-41ddbbf41ef7] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:46:47.431340 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a5a39287-c79d-4867-a98f-f7144ceb81a4 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:47.431801 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a5a39287-c79d-4867-a98f-f7144ceb81a4 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:47.432593 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a5a39287-c79d-4867-a98f-f7144ceb81a4 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:47.433037 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a5a39287-c79d-4867-a98f-f7144ceb81a4 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:47.530021 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a5a39287-c79d-4867-a98f-f7144ceb81a4 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:47.531032 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a5a39287-c79d-4867-a98f-f7144ceb81a4 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:47.531743 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-a5a39287-c79d-4867-a98f-f7144ceb81a4 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lazy-loading 'fault' on Instance uuid b860a7c5-df92-4e9d-a91b-41ddbbf41ef7 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:46:47.650767 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-8e95df6f-cee8-4e23-a064-46bc168c5b64 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c9167954974c6a8908f2d61cb9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8209f1d63904867a0c74297c01a12c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:47.660936 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-a5a39287-c79d-4867-a98f-f7144ceb81a4 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c1672c6fb444d854d4060d5ee9f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c153af93b73a42319a79b2bf94d696be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:47.682861 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-8e95df6f-cee8-4e23-a064-46bc168c5b64 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "GET /compute/v2.1/servers/777d70fa-f03b-4d86-b41a-8467b637500a" status: 200 len: 1176 microversion: 2.1 time: 0.528270 Jul 28 10:46:47.699762 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a5a39287-c79d-4867-a98f-f7144ceb81a4 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] 10.222.0.46 "GET /compute/v2.1/servers/b860a7c5-df92-4e9d-a91b-41ddbbf41ef7" status: 200 len: 1294 microversion: 2.1 time: 0.293225 Jul 28 10:46:47.700303 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 595/1205] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:46:47 2022] GET /compute/v2.1/servers/777d70fa-f03b-4d86-b41a-8467b637500a => generated 1176 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:47.700973 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 611/1206] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:46:47 2022] GET /compute/v2.1/servers/b860a7c5-df92-4e9d-a91b-41ddbbf41ef7 => generated 1294 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:47.730982 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e0dbb8f3-dd42-4b40-a46b-b6ec06b9149a tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:47.731894 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-e0dbb8f3-dd42-4b40-a46b-b6ec06b9149a tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: b860a7c5-df92-4e9d-a91b-41ddbbf41ef7] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:46:47.736048 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e23816fa-c1a3-4558-a457-ff75642821ed tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:47.736721 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-e23816fa-c1a3-4558-a457-ff75642821ed tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 777d70fa-f03b-4d86-b41a-8467b637500a] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:46:47.749692 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e0dbb8f3-dd42-4b40-a46b-b6ec06b9149a tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:47.750453 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e0dbb8f3-dd42-4b40-a46b-b6ec06b9149a tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:47.752120 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e23816fa-c1a3-4558-a457-ff75642821ed tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:47.752989 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e23816fa-c1a3-4558-a457-ff75642821ed tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:47.753441 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e0dbb8f3-dd42-4b40-a46b-b6ec06b9149a tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:47.755297 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e0dbb8f3-dd42-4b40-a46b-b6ec06b9149a tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:47.756851 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e23816fa-c1a3-4558-a457-ff75642821ed tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:47.760124 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e23816fa-c1a3-4558-a457-ff75642821ed tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:47.825348 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-e23816fa-c1a3-4558-a457-ff75642821ed tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 777d70fa-f03b-4d86-b41a-8467b637500a] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:46:47.827313 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-e0dbb8f3-dd42-4b40-a46b-b6ec06b9149a tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: b860a7c5-df92-4e9d-a91b-41ddbbf41ef7] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:46:47.949365 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-e23816fa-c1a3-4558-a457-ff75642821ed tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 777d70fa-f03b-4d86-b41a-8467b637500a] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:46:47.950500 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e23816fa-c1a3-4558-a457-ff75642821ed tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:47.954499 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e23816fa-c1a3-4558-a457-ff75642821ed tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:47.955119 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-e23816fa-c1a3-4558-a457-ff75642821ed tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 777d70fa-f03b-4d86-b41a-8467b637500a] instance's host None is down, deleting from database Jul 28 10:46:47.974767 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-e23816fa-c1a3-4558-a457-ff75642821ed tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 777d70fa-f03b-4d86-b41a-8467b637500a] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:46:47.985341 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-e0dbb8f3-dd42-4b40-a46b-b6ec06b9149a tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: b860a7c5-df92-4e9d-a91b-41ddbbf41ef7] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:46:47.986281 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e0dbb8f3-dd42-4b40-a46b-b6ec06b9149a tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:47.986964 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e0dbb8f3-dd42-4b40-a46b-b6ec06b9149a tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:47.990189 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-e0dbb8f3-dd42-4b40-a46b-b6ec06b9149a tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: b860a7c5-df92-4e9d-a91b-41ddbbf41ef7] instance's host None is down, deleting from database Jul 28 10:46:47.994685 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-e0dbb8f3-dd42-4b40-a46b-b6ec06b9149a tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: b860a7c5-df92-4e9d-a91b-41ddbbf41ef7] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:46:48.214826 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-e23816fa-c1a3-4558-a457-ff75642821ed tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 777d70fa-f03b-4d86-b41a-8467b637500a] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:46:48.221110 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-e23816fa-c1a3-4558-a457-ff75642821ed tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 777d70fa-f03b-4d86-b41a-8467b637500a] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:46:48.450634 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-e0dbb8f3-dd42-4b40-a46b-b6ec06b9149a tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: b860a7c5-df92-4e9d-a91b-41ddbbf41ef7] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:46:48.460633 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-e0dbb8f3-dd42-4b40-a46b-b6ec06b9149a tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: b860a7c5-df92-4e9d-a91b-41ddbbf41ef7] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:46:48.917231 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e23816fa-c1a3-4558-a457-ff75642821ed tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "DELETE /compute/v2.1/servers/777d70fa-f03b-4d86-b41a-8467b637500a" status: 204 len: 0 microversion: 2.1 time: 1.204893 Jul 28 10:46:48.921850 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 596/1207] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:46:47 2022] DELETE /compute/v2.1/servers/777d70fa-f03b-4d86-b41a-8467b637500a => generated 0 bytes in 1207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:46:48.928462 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-789f0a59-791c-446b-affd-115821c79ed1 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:48.929251 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-789f0a59-791c-446b-affd-115821c79ed1 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 777d70fa-f03b-4d86-b41a-8467b637500a] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:46:48.938207 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-789f0a59-791c-446b-affd-115821c79ed1 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:48.938910 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-789f0a59-791c-446b-affd-115821c79ed1 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:48.939761 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-789f0a59-791c-446b-affd-115821c79ed1 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:48.940219 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-789f0a59-791c-446b-affd-115821c79ed1 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:48.966523 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-789f0a59-791c-446b-affd-115821c79ed1 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] HTTP exception thrown: Instance 777d70fa-f03b-4d86-b41a-8467b637500a could not be found. Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-789f0a59-791c-446b-affd-115821c79ed1 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Request method failure captured: Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/777d70fa-f03b-4d86-b41a-8467b637500a HTTP/1.1 Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mjyC3fTgoib6gZ84Pzs1H0WGFzATjUZ993aaue2Om9orB7eK_fh9xiT4QMXZtT_KdLk0bsSNDQzKKAyoUEc6o6yLbTk9llZb_KxyvKyz2vFLNpc9kR6zacAg0s1EIVfbjXWrGIUbmS0Sj7SellzyWHpCpymlLe7ycorAaxmUez9kZM Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: a8209f1d63904867a0c74297c01a12c0 Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-TestVolumeBootPattern-148227680 Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a8209f1d63904867a0c74297c01a12c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a8209f1d63904867a0c74297c01a12c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a8209f1d63904867a0c74297c01a12c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a8209f1d63904867a0c74297c01a12c0", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-TestVolumeBootPattern-148227680 Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: a8209f1d63904867a0c74297c01a12c0 Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-TestVolumeBootPattern-148227680 Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-TestVolumeBootPattern-148227680-project Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: f4c9167954974c6a8908f2d61cb9aa5a Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-TestVolumeBootPattern-148227680-project Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 777d70fa-f03b-4d86-b41a-8467b637500a could not be found. Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '777d70fa-f03b-4d86-b41a-8467b637500a'} Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 777d70fa-f03b-4d86-b41a-8467b637500a could not be found. Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 777d70fa-f03b-4d86-b41a-8467b637500a could not be found. Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:46:48.968367 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:46:48.971533 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:46:48.971533 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:46:48.971533 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:46:48.971533 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:46:48.971533 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:46:48.971533 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 777d70fa-f03b-4d86-b41a-8467b637500a could not be found. Jul 28 10:46:48.971533 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:46:48.971533 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-789f0a59-791c-446b-affd-115821c79ed1 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Returning 404 to user: Instance 777d70fa-f03b-4d86-b41a-8467b637500a could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:46:48.971533 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-789f0a59-791c-446b-affd-115821c79ed1 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "GET /compute/v2.1/servers/777d70fa-f03b-4d86-b41a-8467b637500a" status: 404 len: 111 microversion: 2.1 time: 0.046818 Jul 28 10:46:48.971533 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 597/1208] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:46:48 2022] GET /compute/v2.1/servers/777d70fa-f03b-4d86-b41a-8467b637500a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:46:49.330015 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e0dbb8f3-dd42-4b40-a46b-b6ec06b9149a tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b860a7c5-df92-4e9d-a91b-41ddbbf41ef7" status: 204 len: 0 microversion: 2.1 time: 1.605753 Jul 28 10:46:49.330931 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 612/1209] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:46:47 2022] DELETE /compute/v2.1/servers/b860a7c5-df92-4e9d-a91b-41ddbbf41ef7 => generated 0 bytes in 1607 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:46:49.342004 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f3e10763-e669-4f40-8edd-0ea51536ef92 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:49.343325 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f3e10763-e669-4f40-8edd-0ea51536ef92 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: eb5b6e3a-d7b5-43f3-9179-921832b4b6c1] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:46:49.363181 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f3e10763-e669-4f40-8edd-0ea51536ef92 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:49.363913 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f3e10763-e669-4f40-8edd-0ea51536ef92 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:49.384050 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f3e10763-e669-4f40-8edd-0ea51536ef92 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:49.389568 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f3e10763-e669-4f40-8edd-0ea51536ef92 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:49.476574 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f3e10763-e669-4f40-8edd-0ea51536ef92 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: eb5b6e3a-d7b5-43f3-9179-921832b4b6c1] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:46:49.658386 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f3e10763-e669-4f40-8edd-0ea51536ef92 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: eb5b6e3a-d7b5-43f3-9179-921832b4b6c1] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:46:49.661795 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f3e10763-e669-4f40-8edd-0ea51536ef92 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:49.664233 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f3e10763-e669-4f40-8edd-0ea51536ef92 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:49.666112 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-f3e10763-e669-4f40-8edd-0ea51536ef92 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: eb5b6e3a-d7b5-43f3-9179-921832b4b6c1] instance's host None is down, deleting from database Jul 28 10:46:49.681297 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-f3e10763-e669-4f40-8edd-0ea51536ef92 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: eb5b6e3a-d7b5-43f3-9179-921832b4b6c1] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:46:50.249622 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-f3e10763-e669-4f40-8edd-0ea51536ef92 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: eb5b6e3a-d7b5-43f3-9179-921832b4b6c1] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:46:50.259877 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-f3e10763-e669-4f40-8edd-0ea51536ef92 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: eb5b6e3a-d7b5-43f3-9179-921832b4b6c1] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:46:50.701402 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f3e10763-e669-4f40-8edd-0ea51536ef92 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] 10.222.0.46 "DELETE /compute/v2.1/servers/eb5b6e3a-d7b5-43f3-9179-921832b4b6c1" status: 204 len: 0 microversion: 2.1 time: 1.365325 Jul 28 10:46:50.714415 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 598/1210] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:46:49 2022] DELETE /compute/v2.1/servers/eb5b6e3a-d7b5-43f3-9179-921832b4b6c1 => generated 0 bytes in 1379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:46:50.724239 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-629480e2-76c3-4708-b3b0-ce4e0415e1ce tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:50.725200 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-629480e2-76c3-4708-b3b0-ce4e0415e1ce tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: e5ede991-6b40-42cd-8353-cb63cadbcb24] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:46:50.735170 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-629480e2-76c3-4708-b3b0-ce4e0415e1ce tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:50.735620 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-629480e2-76c3-4708-b3b0-ce4e0415e1ce tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:50.736425 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-629480e2-76c3-4708-b3b0-ce4e0415e1ce tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:50.736871 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-629480e2-76c3-4708-b3b0-ce4e0415e1ce tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:50.842343 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-629480e2-76c3-4708-b3b0-ce4e0415e1ce tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: e5ede991-6b40-42cd-8353-cb63cadbcb24] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:46:50.947693 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-629480e2-76c3-4708-b3b0-ce4e0415e1ce tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: e5ede991-6b40-42cd-8353-cb63cadbcb24] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:46:50.949054 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-629480e2-76c3-4708-b3b0-ce4e0415e1ce tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:50.949952 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-629480e2-76c3-4708-b3b0-ce4e0415e1ce tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:50.951608 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-629480e2-76c3-4708-b3b0-ce4e0415e1ce tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: e5ede991-6b40-42cd-8353-cb63cadbcb24] instance's host None is down, deleting from database Jul 28 10:46:50.976600 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-629480e2-76c3-4708-b3b0-ce4e0415e1ce tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: e5ede991-6b40-42cd-8353-cb63cadbcb24] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:46:51.051846 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-629480e2-76c3-4708-b3b0-ce4e0415e1ce tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: e5ede991-6b40-42cd-8353-cb63cadbcb24] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:46:51.059551 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-629480e2-76c3-4708-b3b0-ce4e0415e1ce tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: e5ede991-6b40-42cd-8353-cb63cadbcb24] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:46:51.403370 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-629480e2-76c3-4708-b3b0-ce4e0415e1ce tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e5ede991-6b40-42cd-8353-cb63cadbcb24" status: 204 len: 0 microversion: 2.1 time: 0.683897 Jul 28 10:46:51.409539 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 613/1211] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:46:50 2022] DELETE /compute/v2.1/servers/e5ede991-6b40-42cd-8353-cb63cadbcb24 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:46:51.421480 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-67a1e7ed-42ca-468c-8d8d-34f7adfceb75 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:51.422141 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-67a1e7ed-42ca-468c-8d8d-34f7adfceb75 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: b860a7c5-df92-4e9d-a91b-41ddbbf41ef7] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:46:51.450192 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-67a1e7ed-42ca-468c-8d8d-34f7adfceb75 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:51.454176 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-67a1e7ed-42ca-468c-8d8d-34f7adfceb75 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:51.455428 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-67a1e7ed-42ca-468c-8d8d-34f7adfceb75 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:51.456031 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-67a1e7ed-42ca-468c-8d8d-34f7adfceb75 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:51.492111 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=62,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:46:51.493663 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-67a1e7ed-42ca-468c-8d8d-34f7adfceb75 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] HTTP exception thrown: Instance b860a7c5-df92-4e9d-a91b-41ddbbf41ef7 could not be found. Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-67a1e7ed-42ca-468c-8d8d-34f7adfceb75 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Request method failure captured: Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/b860a7c5-df92-4e9d-a91b-41ddbbf41ef7 HTTP/1.1 Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mkQ_98_wub_oRDLDVUwi-xlGW86N1Sz5LEM72agdgPU-h5R-4SRpVaLsE3CJexVQ_3n1XYzOaeyCwGPPGzrtQ3RyJQQYGeuA-sHfWE2oeRrIRR9kfv9dG9J1pvu-TVg4m5zR19sRal2ooIYyJ9Cv_M7ml-wDRbzcH8z-C07ngl8b1s Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: c153af93b73a42319a79b2bf94d696be Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ListServersNegativeTestJSON-1971529632 Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c153af93b73a42319a79b2bf94d696be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c153af93b73a42319a79b2bf94d696be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c153af93b73a42319a79b2bf94d696be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c153af93b73a42319a79b2bf94d696be", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ListServersNegativeTestJSON-1971529632 Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: c153af93b73a42319a79b2bf94d696be Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1971529632 Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ListServersNegativeTestJSON-1971529632-project Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: c17c1672c6fb444d854d4060d5ee9f6a Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ListServersNegativeTestJSON-1971529632-project Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance b860a7c5-df92-4e9d-a91b-41ddbbf41ef7 could not be found. Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'b860a7c5-df92-4e9d-a91b-41ddbbf41ef7'} Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b860a7c5-df92-4e9d-a91b-41ddbbf41ef7 could not be found. Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b860a7c5-df92-4e9d-a91b-41ddbbf41ef7 could not be found. Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:46:51.495881 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:46:51.499463 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:46:51.499463 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:46:51.499463 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:46:51.499463 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:46:51.499463 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:46:51.499463 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b860a7c5-df92-4e9d-a91b-41ddbbf41ef7 could not be found. Jul 28 10:46:51.499463 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:46:51.501178 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-67a1e7ed-42ca-468c-8d8d-34f7adfceb75 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Returning 404 to user: Instance b860a7c5-df92-4e9d-a91b-41ddbbf41ef7 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:46:51.502269 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-67a1e7ed-42ca-468c-8d8d-34f7adfceb75 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] 10.222.0.46 "GET /compute/v2.1/servers/b860a7c5-df92-4e9d-a91b-41ddbbf41ef7" status: 404 len: 111 microversion: 2.1 time: 0.085873 Jul 28 10:46:51.506667 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 599/1212] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:46:51 2022] GET /compute/v2.1/servers/b860a7c5-df92-4e9d-a91b-41ddbbf41ef7 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:46:51.514435 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-471aea91-2e7e-43bf-a386-365f308b3415 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:51.515064 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-471aea91-2e7e-43bf-a386-365f308b3415 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: eb5b6e3a-d7b5-43f3-9179-921832b4b6c1] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:46:51.538487 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-471aea91-2e7e-43bf-a386-365f308b3415 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:51.538986 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-471aea91-2e7e-43bf-a386-365f308b3415 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:51.539867 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-471aea91-2e7e-43bf-a386-365f308b3415 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:51.540256 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-471aea91-2e7e-43bf-a386-365f308b3415 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:51.584938 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=62,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:46:51.586321 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-471aea91-2e7e-43bf-a386-365f308b3415 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] HTTP exception thrown: Instance eb5b6e3a-d7b5-43f3-9179-921832b4b6c1 could not be found. Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-471aea91-2e7e-43bf-a386-365f308b3415 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Request method failure captured: Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/eb5b6e3a-d7b5-43f3-9179-921832b4b6c1 HTTP/1.1 Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mkQ_98_wub_oRDLDVUwi-xlGW86N1Sz5LEM72agdgPU-h5R-4SRpVaLsE3CJexVQ_3n1XYzOaeyCwGPPGzrtQ3RyJQQYGeuA-sHfWE2oeRrIRR9kfv9dG9J1pvu-TVg4m5zR19sRal2ooIYyJ9Cv_M7ml-wDRbzcH8z-C07ngl8b1s Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: c153af93b73a42319a79b2bf94d696be Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ListServersNegativeTestJSON-1971529632 Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c153af93b73a42319a79b2bf94d696be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c153af93b73a42319a79b2bf94d696be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c153af93b73a42319a79b2bf94d696be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c153af93b73a42319a79b2bf94d696be", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ListServersNegativeTestJSON-1971529632 Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: c153af93b73a42319a79b2bf94d696be Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1971529632 Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ListServersNegativeTestJSON-1971529632-project Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: c17c1672c6fb444d854d4060d5ee9f6a Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ListServersNegativeTestJSON-1971529632-project Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance eb5b6e3a-d7b5-43f3-9179-921832b4b6c1 could not be found. Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'eb5b6e3a-d7b5-43f3-9179-921832b4b6c1'} Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb5b6e3a-d7b5-43f3-9179-921832b4b6c1 could not be found. Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb5b6e3a-d7b5-43f3-9179-921832b4b6c1 could not be found. Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:46:51.589778 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:46:51.592939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:46:51.592939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:46:51.592939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:46:51.592939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:46:51.592939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:46:51.592939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb5b6e3a-d7b5-43f3-9179-921832b4b6c1 could not be found. Jul 28 10:46:51.592939 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:46:51.592939 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-471aea91-2e7e-43bf-a386-365f308b3415 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Returning 404 to user: Instance eb5b6e3a-d7b5-43f3-9179-921832b4b6c1 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:46:51.593516 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-471aea91-2e7e-43bf-a386-365f308b3415 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] 10.222.0.46 "GET /compute/v2.1/servers/eb5b6e3a-d7b5-43f3-9179-921832b4b6c1" status: 404 len: 111 microversion: 2.1 time: 0.083108 Jul 28 10:46:51.595390 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 614/1213] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:46:51 2022] GET /compute/v2.1/servers/eb5b6e3a-d7b5-43f3-9179-921832b4b6c1 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:46:51.603673 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-cbe5791d-920d-4516-af28-4b973258dac0 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:51.604407 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-cbe5791d-920d-4516-af28-4b973258dac0 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] [instance: e5ede991-6b40-42cd-8353-cb63cadbcb24] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:46:51.628561 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cbe5791d-920d-4516-af28-4b973258dac0 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:51.629166 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cbe5791d-920d-4516-af28-4b973258dac0 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:51.630593 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cbe5791d-920d-4516-af28-4b973258dac0 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:46:51.631482 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cbe5791d-920d-4516-af28-4b973258dac0 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:46:51.688570 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-cbe5791d-920d-4516-af28-4b973258dac0 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] HTTP exception thrown: Instance e5ede991-6b40-42cd-8353-cb63cadbcb24 could not be found. Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-cbe5791d-920d-4516-af28-4b973258dac0 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Request method failure captured: Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/e5ede991-6b40-42cd-8353-cb63cadbcb24 HTTP/1.1 Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mkQ_98_wub_oRDLDVUwi-xlGW86N1Sz5LEM72agdgPU-h5R-4SRpVaLsE3CJexVQ_3n1XYzOaeyCwGPPGzrtQ3RyJQQYGeuA-sHfWE2oeRrIRR9kfv9dG9J1pvu-TVg4m5zR19sRal2ooIYyJ9Cv_M7ml-wDRbzcH8z-C07ngl8b1s Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: c153af93b73a42319a79b2bf94d696be Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ListServersNegativeTestJSON-1971529632 Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c153af93b73a42319a79b2bf94d696be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c153af93b73a42319a79b2bf94d696be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c153af93b73a42319a79b2bf94d696be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c153af93b73a42319a79b2bf94d696be", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ListServersNegativeTestJSON-1971529632 Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: c153af93b73a42319a79b2bf94d696be Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1971529632 Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ListServersNegativeTestJSON-1971529632-project Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: c17c1672c6fb444d854d4060d5ee9f6a Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ListServersNegativeTestJSON-1971529632-project Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance e5ede991-6b40-42cd-8353-cb63cadbcb24 could not be found. Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'e5ede991-6b40-42cd-8353-cb63cadbcb24'} Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5ede991-6b40-42cd-8353-cb63cadbcb24 could not be found. Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5ede991-6b40-42cd-8353-cb63cadbcb24 could not be found. Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:46:51.692264 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:46:51.696647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:46:51.696647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:46:51.696647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:46:51.696647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:46:51.696647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:46:51.696647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5ede991-6b40-42cd-8353-cb63cadbcb24 could not be found. Jul 28 10:46:51.696647 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:46:51.699388 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-cbe5791d-920d-4516-af28-4b973258dac0 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] Returning 404 to user: Instance e5ede991-6b40-42cd-8353-cb63cadbcb24 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:46:51.700536 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-cbe5791d-920d-4516-af28-4b973258dac0 tempest-ListServersNegativeTestJSON-1971529632 tempest-ListServersNegativeTestJSON-1971529632-project] 10.222.0.46 "GET /compute/v2.1/servers/e5ede991-6b40-42cd-8353-cb63cadbcb24" status: 404 len: 111 microversion: 2.1 time: 0.101208 Jul 28 10:46:51.708655 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 600/1214] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:46:51 2022] GET /compute/v2.1/servers/e5ede991-6b40-42cd-8353-cb63cadbcb24 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:46:58.178964 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1375508434", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4d115eec-8e68-43bc-812c-6d743e46df9b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "60cc7037-2405-4fb9-943a-b808862d4369"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:46:58.198368 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:46:58.210528 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=8 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:46:58.399762 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] validate_networks() for [('60cc7037-2405-4fb9-943a-b808862d4369', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:47:00.294389 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:47:00.295519 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:47:00.296316 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:47:00.296900 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:47:00.297515 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:47:00.315161 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:00.317093 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:00.319142 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:00.323366 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:00.376483 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Getting quotas for project a8209f1d63904867a0c74297c01a12c0. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:47:00.393431 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Getting quotas for user f4c9167954974c6a8908f2d61cb9aa5a and project a8209f1d63904867a0c74297c01a12c0. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:47:00.600220 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:47:00.602571 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 494237a8-d01a-4eb6-8de2-621c350f8700] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4d115eec-8e68-43bc-812c-6d743e46df9b',volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:47:00.900048 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-19f1e652-e0bf-4ff8-9ca6-85170910b358 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.726031 Jul 28 10:47:00.901290 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 615/1215] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:46:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:47:00.913317 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-23e7ae10-6ead-40b8-91c6-b02285ac0c3e tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:00.914787 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-23e7ae10-6ead-40b8-91c6-b02285ac0c3e tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 494237a8-d01a-4eb6-8de2-621c350f8700] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:47:00.917228 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:47:00.918508 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=8 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:47:01.195640 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-23e7ae10-6ead-40b8-91c6-b02285ac0c3e tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c9167954974c6a8908f2d61cb9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8209f1d63904867a0c74297c01a12c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:47:01.208175 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-23e7ae10-6ead-40b8-91c6-b02285ac0c3e tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "GET /compute/v2.1/servers/494237a8-d01a-4eb6-8de2-621c350f8700" status: 200 len: 1057 microversion: 2.1 time: 0.296469 Jul 28 10:47:01.214204 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 601/1216] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:47:00 2022] GET /compute/v2.1/servers/494237a8-d01a-4eb6-8de2-621c350f8700 => generated 1057 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:47:02.230885 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a1541454-665c-40fa-8430-25d29caa5188 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:02.232321 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a1541454-665c-40fa-8430-25d29caa5188 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 494237a8-d01a-4eb6-8de2-621c350f8700] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:47:02.249686 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a1541454-665c-40fa-8430-25d29caa5188 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:02.252360 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a1541454-665c-40fa-8430-25d29caa5188 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:02.256654 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a1541454-665c-40fa-8430-25d29caa5188 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:02.258611 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a1541454-665c-40fa-8430-25d29caa5188 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:02.367248 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a1541454-665c-40fa-8430-25d29caa5188 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:02.370123 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a1541454-665c-40fa-8430-25d29caa5188 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:02.372031 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-a1541454-665c-40fa-8430-25d29caa5188 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lazy-loading 'fault' on Instance uuid 494237a8-d01a-4eb6-8de2-621c350f8700 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:47:03.358425 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-a1541454-665c-40fa-8430-25d29caa5188 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c9167954974c6a8908f2d61cb9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8209f1d63904867a0c74297c01a12c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:47:03.375470 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a1541454-665c-40fa-8430-25d29caa5188 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "GET /compute/v2.1/servers/494237a8-d01a-4eb6-8de2-621c350f8700" status: 200 len: 1176 microversion: 2.1 time: 1.150561 Jul 28 10:47:03.383820 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 616/1217] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:47:02 2022] GET /compute/v2.1/servers/494237a8-d01a-4eb6-8de2-621c350f8700 => generated 1176 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:47:03.413733 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8af1026e-7238-45a7-92c7-35999d19d9be tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:03.414918 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-8af1026e-7238-45a7-92c7-35999d19d9be tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 494237a8-d01a-4eb6-8de2-621c350f8700] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:47:03.433505 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8af1026e-7238-45a7-92c7-35999d19d9be tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:03.433994 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8af1026e-7238-45a7-92c7-35999d19d9be tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:03.435220 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8af1026e-7238-45a7-92c7-35999d19d9be tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:03.436581 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8af1026e-7238-45a7-92c7-35999d19d9be tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:03.489203 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-8af1026e-7238-45a7-92c7-35999d19d9be tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 494237a8-d01a-4eb6-8de2-621c350f8700] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:47:03.613631 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-8af1026e-7238-45a7-92c7-35999d19d9be tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 494237a8-d01a-4eb6-8de2-621c350f8700] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:47:03.614660 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8af1026e-7238-45a7-92c7-35999d19d9be tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:03.615299 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-8af1026e-7238-45a7-92c7-35999d19d9be tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:03.615881 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-8af1026e-7238-45a7-92c7-35999d19d9be tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 494237a8-d01a-4eb6-8de2-621c350f8700] instance's host None is down, deleting from database Jul 28 10:47:03.636127 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-8af1026e-7238-45a7-92c7-35999d19d9be tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 494237a8-d01a-4eb6-8de2-621c350f8700] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:47:03.709271 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-8af1026e-7238-45a7-92c7-35999d19d9be tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 494237a8-d01a-4eb6-8de2-621c350f8700] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:47:03.716540 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-8af1026e-7238-45a7-92c7-35999d19d9be tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 494237a8-d01a-4eb6-8de2-621c350f8700] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:47:04.213806 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-8af1026e-7238-45a7-92c7-35999d19d9be tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "DELETE /compute/v2.1/servers/494237a8-d01a-4eb6-8de2-621c350f8700" status: 204 len: 0 microversion: 2.1 time: 0.804102 Jul 28 10:47:04.217063 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 602/1218] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:47:03 2022] DELETE /compute/v2.1/servers/494237a8-d01a-4eb6-8de2-621c350f8700 => generated 0 bytes in 808 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:47:04.229058 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-78af6222-dd36-4271-bbc3-fefa03cc7382 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:04.229983 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-78af6222-dd36-4271-bbc3-fefa03cc7382 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: 494237a8-d01a-4eb6-8de2-621c350f8700] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:47:04.236995 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-78af6222-dd36-4271-bbc3-fefa03cc7382 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:04.237791 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-78af6222-dd36-4271-bbc3-fefa03cc7382 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:04.239803 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-78af6222-dd36-4271-bbc3-fefa03cc7382 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:04.240489 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-78af6222-dd36-4271-bbc3-fefa03cc7382 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:04.257350 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-78af6222-dd36-4271-bbc3-fefa03cc7382 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] HTTP exception thrown: Instance 494237a8-d01a-4eb6-8de2-621c350f8700 could not be found. Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-78af6222-dd36-4271-bbc3-fefa03cc7382 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Request method failure captured: Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/494237a8-d01a-4eb6-8de2-621c350f8700 HTTP/1.1 Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mjyC3fTgoib6gZ84Pzs1H0WGFzATjUZ993aaue2Om9orB7eK_fh9xiT4QMXZtT_KdLk0bsSNDQzKKAyoUEc6o6yLbTk9llZb_KxyvKyz2vFLNpc9kR6zacAg0s1EIVfbjXWrGIUbmS0Sj7SellzyWHpCpymlLe7ycorAaxmUez9kZM Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: a8209f1d63904867a0c74297c01a12c0 Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-TestVolumeBootPattern-148227680 Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a8209f1d63904867a0c74297c01a12c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a8209f1d63904867a0c74297c01a12c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a8209f1d63904867a0c74297c01a12c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a8209f1d63904867a0c74297c01a12c0", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-TestVolumeBootPattern-148227680 Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: a8209f1d63904867a0c74297c01a12c0 Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-TestVolumeBootPattern-148227680 Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-TestVolumeBootPattern-148227680-project Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: f4c9167954974c6a8908f2d61cb9aa5a Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-TestVolumeBootPattern-148227680-project Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 494237a8-d01a-4eb6-8de2-621c350f8700 could not be found. Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '494237a8-d01a-4eb6-8de2-621c350f8700'} Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 494237a8-d01a-4eb6-8de2-621c350f8700 could not be found. Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 494237a8-d01a-4eb6-8de2-621c350f8700 could not be found. Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:47:04.259538 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:47:04.264237 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:47:04.264237 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:47:04.264237 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:47:04.264237 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:47:04.264237 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:47:04.264237 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 494237a8-d01a-4eb6-8de2-621c350f8700 could not be found. Jul 28 10:47:04.264237 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:47:04.264237 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-78af6222-dd36-4271-bbc3-fefa03cc7382 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Returning 404 to user: Instance 494237a8-d01a-4eb6-8de2-621c350f8700 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:47:04.266046 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-78af6222-dd36-4271-bbc3-fefa03cc7382 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "GET /compute/v2.1/servers/494237a8-d01a-4eb6-8de2-621c350f8700" status: 404 len: 111 microversion: 2.1 time: 0.044762 Jul 28 10:47:04.267317 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 617/1219] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:47:04 2022] GET /compute/v2.1/servers/494237a8-d01a-4eb6-8de2-621c350f8700 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:47:36.623350 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:47:36.624402 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:47:36.625103 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=26,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:47:37.630697 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1109320474", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "eb0e6710-e280-4c53-9408-e98f4b9c79df"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:47:37.709692 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] validate_networks() for [('eb0e6710-e280-4c53-9408-e98f4b9c79df', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:47:38.954629 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:47:38.955285 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:47:38.955546 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:47:38.956000 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:47:38.956423 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:47:38.976568 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:38.977024 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:38.977834 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:38.978487 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:39.033094 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Getting quotas for project a3652f288c18441cb1e04b49e4224bb1. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:47:39.039398 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Getting quotas for user 0764ea93901d4675a2cab5b058c3d5ee and project a3652f288c18441cb1e04b49e4224bb1. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:47:39.075121 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:47:39.077318 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] [instance: 97d17963-b410-49fe-a418-b6a953b5f0f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:47:39.205198 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-84733af9-2e7e-486f-88b4-dd15e2b06d8b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.583973 Jul 28 10:47:39.210294 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 603/1220] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:47:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:47:39.222643 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-41c94e1d-6993-4cfd-b054-0dbfcb5bfba8 tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:39.226731 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-41c94e1d-6993-4cfd-b054-0dbfcb5bfba8 tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] [instance: 97d17963-b410-49fe-a418-b6a953b5f0f7] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:47:39.236870 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:47:39.242703 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=6 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:47:39.243720 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=12,nova_api:UPDATE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:47:39.244515 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=12 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:47:39.514300 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-41c94e1d-6993-4cfd-b054-0dbfcb5bfba8 tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0764ea93901d4675a2cab5b058c3d5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3652f288c18441cb1e04b49e4224bb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:47:39.521803 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-41c94e1d-6993-4cfd-b054-0dbfcb5bfba8 tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] 10.222.0.46 "GET /compute/v2.1/servers/97d17963-b410-49fe-a418-b6a953b5f0f7" status: 200 len: 1217 microversion: 2.1 time: 0.306998 Jul 28 10:47:39.522996 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 618/1221] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:47:39 2022] GET /compute/v2.1/servers/97d17963-b410-49fe-a418-b6a953b5f0f7 => generated 1217 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:47:40.546790 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d8644e0a-6910-418f-b366-18603a75a7b3 tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:40.547581 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-d8644e0a-6910-418f-b366-18603a75a7b3 tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] [instance: 97d17963-b410-49fe-a418-b6a953b5f0f7] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:47:40.568206 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d8644e0a-6910-418f-b366-18603a75a7b3 tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:40.568680 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d8644e0a-6910-418f-b366-18603a75a7b3 tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:40.569474 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d8644e0a-6910-418f-b366-18603a75a7b3 tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:40.569952 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d8644e0a-6910-418f-b366-18603a75a7b3 tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:40.698424 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d8644e0a-6910-418f-b366-18603a75a7b3 tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:40.699216 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d8644e0a-6910-418f-b366-18603a75a7b3 tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:40.700017 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-d8644e0a-6910-418f-b366-18603a75a7b3 tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lazy-loading 'fault' on Instance uuid 97d17963-b410-49fe-a418-b6a953b5f0f7 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:47:40.895286 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-d8644e0a-6910-418f-b366-18603a75a7b3 tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0764ea93901d4675a2cab5b058c3d5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3652f288c18441cb1e04b49e4224bb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:47:40.910935 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d8644e0a-6910-418f-b366-18603a75a7b3 tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] 10.222.0.46 "GET /compute/v2.1/servers/97d17963-b410-49fe-a418-b6a953b5f0f7" status: 200 len: 1290 microversion: 2.1 time: 0.369681 Jul 28 10:47:40.936119 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 604/1222] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:47:40 2022] GET /compute/v2.1/servers/97d17963-b410-49fe-a418-b6a953b5f0f7 => generated 1290 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:47:40.946563 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4b283bdd-7a72-421c-9b03-c65631013d7f tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:40.947079 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-4b283bdd-7a72-421c-9b03-c65631013d7f tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] [instance: 97d17963-b410-49fe-a418-b6a953b5f0f7] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:47:40.956253 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4b283bdd-7a72-421c-9b03-c65631013d7f tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:40.956800 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4b283bdd-7a72-421c-9b03-c65631013d7f tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:40.957758 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4b283bdd-7a72-421c-9b03-c65631013d7f tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:40.967714 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4b283bdd-7a72-421c-9b03-c65631013d7f tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:41.028132 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-4b283bdd-7a72-421c-9b03-c65631013d7f tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] [instance: 97d17963-b410-49fe-a418-b6a953b5f0f7] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:47:41.118834 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-4b283bdd-7a72-421c-9b03-c65631013d7f tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] [instance: 97d17963-b410-49fe-a418-b6a953b5f0f7] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:47:41.120294 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4b283bdd-7a72-421c-9b03-c65631013d7f tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:41.121134 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4b283bdd-7a72-421c-9b03-c65631013d7f tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:41.121982 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-4b283bdd-7a72-421c-9b03-c65631013d7f tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] [instance: 97d17963-b410-49fe-a418-b6a953b5f0f7] instance's host None is down, deleting from database Jul 28 10:47:41.128525 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-4b283bdd-7a72-421c-9b03-c65631013d7f tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] [instance: 97d17963-b410-49fe-a418-b6a953b5f0f7] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:47:41.384422 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-4b283bdd-7a72-421c-9b03-c65631013d7f tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] [instance: 97d17963-b410-49fe-a418-b6a953b5f0f7] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:47:41.391431 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-4b283bdd-7a72-421c-9b03-c65631013d7f tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] [instance: 97d17963-b410-49fe-a418-b6a953b5f0f7] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:47:41.842378 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-4b283bdd-7a72-421c-9b03-c65631013d7f tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] 10.222.0.46 "DELETE /compute/v2.1/servers/97d17963-b410-49fe-a418-b6a953b5f0f7" status: 204 len: 0 microversion: 2.1 time: 0.900991 Jul 28 10:47:41.853336 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 619/1223] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:47:40 2022] DELETE /compute/v2.1/servers/97d17963-b410-49fe-a418-b6a953b5f0f7 => generated 0 bytes in 903 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 10:47:41.853653 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f4dbd224-1852-49aa-b8fd-c9c97bfe927b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:41.854835 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f4dbd224-1852-49aa-b8fd-c9c97bfe927b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] [instance: 97d17963-b410-49fe-a418-b6a953b5f0f7] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:47:41.868563 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f4dbd224-1852-49aa-b8fd-c9c97bfe927b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:41.870812 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f4dbd224-1852-49aa-b8fd-c9c97bfe927b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:41.872134 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f4dbd224-1852-49aa-b8fd-c9c97bfe927b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:47:41.874534 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f4dbd224-1852-49aa-b8fd-c9c97bfe927b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:47:41.918506 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-f4dbd224-1852-49aa-b8fd-c9c97bfe927b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] HTTP exception thrown: Instance 97d17963-b410-49fe-a418-b6a953b5f0f7 could not be found. Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f4dbd224-1852-49aa-b8fd-c9c97bfe927b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Request method failure captured: Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/97d17963-b410-49fe-a418-b6a953b5f0f7 HTTP/1.1 Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mlHvAmw5-hMK0exCsUD4s45r_IZIXXXqfUwLd4iiUMhTO_5Uqzrm4wPx68O5SrUX9k0IQEpouwGdN36iLI4phFaNv9eoHBBf6puim2LNOGfKs0Dd_NXMp_e6fBZ4EB9V5kUMP7IKvBBKqQ81tEWGVaY3-VNkmR_9KldcIowW9u521E Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: a3652f288c18441cb1e04b49e4224bb1 Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServerAddressesTestJSON-1533351318 Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a3652f288c18441cb1e04b49e4224bb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a3652f288c18441cb1e04b49e4224bb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a3652f288c18441cb1e04b49e4224bb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a3652f288c18441cb1e04b49e4224bb1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServerAddressesTestJSON-1533351318 Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: a3652f288c18441cb1e04b49e4224bb1 Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1533351318 Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServerAddressesTestJSON-1533351318-project Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 0764ea93901d4675a2cab5b058c3d5ee Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServerAddressesTestJSON-1533351318-project Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 97d17963-b410-49fe-a418-b6a953b5f0f7 could not be found. Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '97d17963-b410-49fe-a418-b6a953b5f0f7'} Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97d17963-b410-49fe-a418-b6a953b5f0f7 could not be found. Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97d17963-b410-49fe-a418-b6a953b5f0f7 could not be found. Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:47:41.920842 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:47:41.925947 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:47:41.925947 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:47:41.925947 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:47:41.925947 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:47:41.925947 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:47:41.925947 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97d17963-b410-49fe-a418-b6a953b5f0f7 could not be found. Jul 28 10:47:41.925947 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:47:41.927200 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f4dbd224-1852-49aa-b8fd-c9c97bfe927b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] Returning 404 to user: Instance 97d17963-b410-49fe-a418-b6a953b5f0f7 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:47:41.928250 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f4dbd224-1852-49aa-b8fd-c9c97bfe927b tempest-ServerAddressesTestJSON-1533351318 tempest-ServerAddressesTestJSON-1533351318-project] 10.222.0.46 "GET /compute/v2.1/servers/97d17963-b410-49fe-a418-b6a953b5f0f7" status: 404 len: 111 microversion: 2.1 time: 0.079547 Jul 28 10:47:41.930247 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 605/1224] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:47:41 2022] GET /compute/v2.1/servers/97d17963-b410-49fe-a418-b6a953b5f0f7 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:48:00.443914 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:48:00.444758 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:48:00.446899 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:48:00.457708 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1450355344", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "60120312-4e36-4500-8dd3-ac2b308b5fc1", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "60cc7037-2405-4fb9-943a-b808862d4369"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:48:01.198575 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] validate_networks() for [('60cc7037-2405-4fb9-943a-b808862d4369', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:48:02.409510 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:48:02.410944 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:48:02.411612 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:48:02.412438 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:48:02.413243 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:48:02.434098 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:48:02.436136 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:48:02.439688 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:48:02.441886 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:48:02.550712 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Getting quotas for project a8209f1d63904867a0c74297c01a12c0. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:48:02.568057 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Getting quotas for user f4c9167954974c6a8908f2d61cb9aa5a and project a8209f1d63904867a0c74297c01a12c0. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:48:02.612544 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:48:02.618807 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6957a7-ce06-4dcb-90c0-74ef32fe7416] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='60120312-4e36-4500-8dd3-ac2b308b5fc1',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:48:02.782883 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-86bc3f76-14da-4100-9973-24e7a5de53cf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.339514 Jul 28 10:48:02.783676 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 620/1225] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:48:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 10:48:02.801843 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-571609d3-f8f7-4986-85ab-02e62608a8c0 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:02.803873 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-571609d3-f8f7-4986-85ab-02e62608a8c0 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6957a7-ce06-4dcb-90c0-74ef32fe7416] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:48:02.808429 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:48:02.812778 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=6 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:48:02.820170 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:48:02.822801 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=12 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:48:03.124297 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-571609d3-f8f7-4986-85ab-02e62608a8c0 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c9167954974c6a8908f2d61cb9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8209f1d63904867a0c74297c01a12c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:48:03.156850 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-571609d3-f8f7-4986-85ab-02e62608a8c0 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "GET /compute/v2.1/servers/dc6957a7-ce06-4dcb-90c0-74ef32fe7416" status: 200 len: 1057 microversion: 2.1 time: 0.361841 Jul 28 10:48:03.162862 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 606/1226] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:48:02 2022] GET /compute/v2.1/servers/dc6957a7-ce06-4dcb-90c0-74ef32fe7416 => generated 1057 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:48:04.183408 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-168ff029-5d17-4848-ab54-e14883e51bb5 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:04.184732 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-168ff029-5d17-4848-ab54-e14883e51bb5 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6957a7-ce06-4dcb-90c0-74ef32fe7416] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:48:04.244354 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-168ff029-5d17-4848-ab54-e14883e51bb5 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:48:04.246352 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-168ff029-5d17-4848-ab54-e14883e51bb5 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:48:04.247224 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-168ff029-5d17-4848-ab54-e14883e51bb5 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:48:04.247662 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-168ff029-5d17-4848-ab54-e14883e51bb5 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:48:04.358805 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-168ff029-5d17-4848-ab54-e14883e51bb5 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:48:04.363574 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-168ff029-5d17-4848-ab54-e14883e51bb5 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:48:04.364472 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-168ff029-5d17-4848-ab54-e14883e51bb5 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lazy-loading 'fault' on Instance uuid dc6957a7-ce06-4dcb-90c0-74ef32fe7416 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:48:04.942291 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-168ff029-5d17-4848-ab54-e14883e51bb5 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c9167954974c6a8908f2d61cb9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8209f1d63904867a0c74297c01a12c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:48:04.964218 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-168ff029-5d17-4848-ab54-e14883e51bb5 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "GET /compute/v2.1/servers/dc6957a7-ce06-4dcb-90c0-74ef32fe7416" status: 200 len: 1130 microversion: 2.1 time: 0.785161 Jul 28 10:48:04.968405 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 621/1227] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:48:04 2022] GET /compute/v2.1/servers/dc6957a7-ce06-4dcb-90c0-74ef32fe7416 => generated 1130 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:48:04.991207 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1accf315-c801-4dd1-ac56-24d8cc7e7974 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:04.991761 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1accf315-c801-4dd1-ac56-24d8cc7e7974 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6957a7-ce06-4dcb-90c0-74ef32fe7416] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:48:05.022808 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1accf315-c801-4dd1-ac56-24d8cc7e7974 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:48:05.023907 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1accf315-c801-4dd1-ac56-24d8cc7e7974 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:48:05.027259 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1accf315-c801-4dd1-ac56-24d8cc7e7974 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:48:05.031253 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1accf315-c801-4dd1-ac56-24d8cc7e7974 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:48:05.155035 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1accf315-c801-4dd1-ac56-24d8cc7e7974 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6957a7-ce06-4dcb-90c0-74ef32fe7416] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:48:05.349599 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1accf315-c801-4dd1-ac56-24d8cc7e7974 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6957a7-ce06-4dcb-90c0-74ef32fe7416] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:48:05.350499 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1accf315-c801-4dd1-ac56-24d8cc7e7974 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:48:05.350948 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1accf315-c801-4dd1-ac56-24d8cc7e7974 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:48:05.351388 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-1accf315-c801-4dd1-ac56-24d8cc7e7974 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6957a7-ce06-4dcb-90c0-74ef32fe7416] instance's host None is down, deleting from database Jul 28 10:48:05.370385 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-1accf315-c801-4dd1-ac56-24d8cc7e7974 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6957a7-ce06-4dcb-90c0-74ef32fe7416] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:48:05.714614 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-1accf315-c801-4dd1-ac56-24d8cc7e7974 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6957a7-ce06-4dcb-90c0-74ef32fe7416] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:48:05.721614 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-1accf315-c801-4dd1-ac56-24d8cc7e7974 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6957a7-ce06-4dcb-90c0-74ef32fe7416] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:48:05.742724 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1accf315-c801-4dd1-ac56-24d8cc7e7974 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6957a7-ce06-4dcb-90c0-74ef32fe7416] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=119463) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2556}} Jul 28 10:48:05.979184 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-1accf315-c801-4dd1-ac56-24d8cc7e7974 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6957a7-ce06-4dcb-90c0-74ef32fe7416] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Jul 28 10:48:06.820660 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-1accf315-c801-4dd1-ac56-24d8cc7e7974 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dc6957a7-ce06-4dcb-90c0-74ef32fe7416" status: 204 len: 0 microversion: 2.1 time: 1.833315 Jul 28 10:48:06.833589 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 607/1228] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:48:04 2022] DELETE /compute/v2.1/servers/dc6957a7-ce06-4dcb-90c0-74ef32fe7416 => generated 0 bytes in 1847 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:48:06.848018 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-cd565143-f7ee-45be-9332-bd65f6471726 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:06.854954 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-cd565143-f7ee-45be-9332-bd65f6471726 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6957a7-ce06-4dcb-90c0-74ef32fe7416] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:48:06.896509 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cd565143-f7ee-45be-9332-bd65f6471726 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:48:06.899637 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cd565143-f7ee-45be-9332-bd65f6471726 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:48:06.907060 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cd565143-f7ee-45be-9332-bd65f6471726 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:48:06.912625 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cd565143-f7ee-45be-9332-bd65f6471726 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:48:06.981730 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-cd565143-f7ee-45be-9332-bd65f6471726 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] HTTP exception thrown: Instance dc6957a7-ce06-4dcb-90c0-74ef32fe7416 could not be found. Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-cd565143-f7ee-45be-9332-bd65f6471726 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Request method failure captured: Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/dc6957a7-ce06-4dcb-90c0-74ef32fe7416 HTTP/1.1 Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mjyC3fTgoib6gZ84Pzs1H0WGFzATjUZ993aaue2Om9orB7eK_fh9xiT4QMXZtT_KdLk0bsSNDQzKKAyoUEc6o6yLbTk9llZb_KxyvKyz2vFLNpc9kR6zacAg0s1EIVfbjXWrGIUbmS0Sj7SellzyWHpCpymlLe7ycorAaxmUez9kZM Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: a8209f1d63904867a0c74297c01a12c0 Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-TestVolumeBootPattern-148227680 Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a8209f1d63904867a0c74297c01a12c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a8209f1d63904867a0c74297c01a12c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a8209f1d63904867a0c74297c01a12c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a8209f1d63904867a0c74297c01a12c0", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-TestVolumeBootPattern-148227680 Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: a8209f1d63904867a0c74297c01a12c0 Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-TestVolumeBootPattern-148227680 Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-TestVolumeBootPattern-148227680-project Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: f4c9167954974c6a8908f2d61cb9aa5a Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-TestVolumeBootPattern-148227680-project Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance dc6957a7-ce06-4dcb-90c0-74ef32fe7416 could not be found. Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'dc6957a7-ce06-4dcb-90c0-74ef32fe7416'} Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc6957a7-ce06-4dcb-90c0-74ef32fe7416 could not be found. Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc6957a7-ce06-4dcb-90c0-74ef32fe7416 could not be found. Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:48:06.995570 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:48:06.999689 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:48:06.999689 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:48:06.999689 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:48:06.999689 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:48:06.999689 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:48:06.999689 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc6957a7-ce06-4dcb-90c0-74ef32fe7416 could not be found. Jul 28 10:48:06.999689 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:48:07.005679 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-cd565143-f7ee-45be-9332-bd65f6471726 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Returning 404 to user: Instance dc6957a7-ce06-4dcb-90c0-74ef32fe7416 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:48:07.014235 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-cd565143-f7ee-45be-9332-bd65f6471726 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "GET /compute/v2.1/servers/dc6957a7-ce06-4dcb-90c0-74ef32fe7416" status: 404 len: 111 microversion: 2.1 time: 0.175153 Jul 28 10:48:07.028096 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 622/1229] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:48:06 2022] GET /compute/v2.1/servers/dc6957a7-ce06-4dcb-90c0-74ef32fe7416 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:48:21.616933 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:48:21.617731 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:48:21.618397 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:48:22.047040 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-74ff6846-f771-42ad-ba49-3c498550725f tempest-ServerGroup264TestJSON-2013711069 tempest-ServerGroup264TestJSON-2013711069-project] Action: 'create', calling method: .version_select at 0x7fa94bba8ee0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:48:22.150424 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-74ff6846-f771-42ad-ba49-3c498550725f tempest-ServerGroup264TestJSON-2013711069 tempest-ServerGroup264TestJSON-2013711069-project] Getting quotas for project b079561a56894573a022735f831b8baf. Resources: {'server_groups'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:48:22.173295 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-74ff6846-f771-42ad-ba49-3c498550725f tempest-ServerGroup264TestJSON-2013711069 tempest-ServerGroup264TestJSON-2013711069-project] Getting quotas for user f0e95d9021fe43bbb249eb1c3d80289c and project b079561a56894573a022735f831b8baf. Resources: {'server_groups'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:48:22.324049 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-74ff6846-f771-42ad-ba49-3c498550725f tempest-ServerGroup264TestJSON-2013711069 tempest-ServerGroup264TestJSON-2013711069-project] Getting quotas for project b079561a56894573a022735f831b8baf. Resources: {'server_groups'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:48:22.331541 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-74ff6846-f771-42ad-ba49-3c498550725f tempest-ServerGroup264TestJSON-2013711069 tempest-ServerGroup264TestJSON-2013711069-project] Getting quotas for user f0e95d9021fe43bbb249eb1c3d80289c and project b079561a56894573a022735f831b8baf. Resources: {'server_groups'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:48:22.385329 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-74ff6846-f771-42ad-ba49-3c498550725f tempest-ServerGroup264TestJSON-2013711069 tempest-ServerGroup264TestJSON-2013711069-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.758419 Jul 28 10:48:22.386220 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 608/1230] 10.222.0.46 () {62 vars in 1214 bytes} [Thu Jul 28 10:48:21 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:48:22.397891 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2584cae0-83c7-466c-9b9f-f8ca4c5efa4a tempest-ServerGroup264TestJSON-2013711069 tempest-ServerGroup264TestJSON-2013711069-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:22.472203 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:48:22.475600 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=6 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:48:22.477635 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:48:22.477635 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=12 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:48:22.481589 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-2584cae0-83c7-466c-9b9f-f8ca4c5efa4a tempest-ServerGroup264TestJSON-2013711069 tempest-ServerGroup264TestJSON-2013711069-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.088283 Jul 28 10:48:22.487772 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 623/1231] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jul 28 10:48:22 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:48:22.496635 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3445038c-c15a-4f64-8a4a-dae648f85c9d tempest-ServerGroup264TestJSON-2013711069 tempest-ServerGroup264TestJSON-2013711069-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:22.537964 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3445038c-c15a-4f64-8a4a-dae648f85c9d tempest-ServerGroup264TestJSON-2013711069 tempest-ServerGroup264TestJSON-2013711069-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups/ed260eba-c36a-4792-b381-039b01e389ee" status: 200 len: 235 microversion: 2.64 time: 0.044941 Jul 28 10:48:22.541191 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 609/1232] 10.222.0.46 () {60 vars in 1304 bytes} [Thu Jul 28 10:48:22 2022] GET /compute/v2.1/os-server-groups/ed260eba-c36a-4792-b381-039b01e389ee => generated 235 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:48:22.550572 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-25a74d3b-eb2e-43dd-ae2f-9d002a80c119 tempest-ServerGroup264TestJSON-2013711069 tempest-ServerGroup264TestJSON-2013711069-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:22.639107 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-25a74d3b-eb2e-43dd-ae2f-9d002a80c119 tempest-ServerGroup264TestJSON-2013711069 tempest-ServerGroup264TestJSON-2013711069-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/ed260eba-c36a-4792-b381-039b01e389ee" status: 204 len: 0 microversion: 2.64 time: 0.093407 Jul 28 10:48:22.640231 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 624/1233] 10.222.0.46 () {60 vars in 1307 bytes} [Thu Jul 28 10:48:22 2022] DELETE /compute/v2.1/os-server-groups/ed260eba-c36a-4792-b381-039b01e389ee => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:48:22.649197 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-32d4ded5-58f5-4534-b12a-4e0ff8991b1c tempest-ServerGroup264TestJSON-2013711069 tempest-ServerGroup264TestJSON-2013711069-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:22.670501 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-32d4ded5-58f5-4534-b12a-4e0ff8991b1c tempest-ServerGroup264TestJSON-2013711069 tempest-ServerGroup264TestJSON-2013711069-project] HTTP exception thrown: Instance group ed260eba-c36a-4792-b381-039b01e389ee could not be found. Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-32d4ded5-58f5-4534-b12a-4e0ff8991b1c tempest-ServerGroup264TestJSON-2013711069 tempest-ServerGroup264TestJSON-2013711069-project] Request method failure captured: Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: request: DELETE /compute/v2.1/os-server-groups/ed260eba-c36a-4792-b381-039b01e389ee HTTP/1.1 Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4ml1eMThhjprtruyRwZ8bQ8xlSWdSakd3AhUo1CdZj7CdIe6eR7xIAgfb_W4WkRZxxiYzqPrC-oYTFJe8aZTP5qzqzQdKA2KOaalI4HMFFg3k3H-nFw6V4XoYLiyH_Nhd_dg1NkLJaYV5VHPs6wiRBRoSpqSypGoNt3-rHo_uRrdgR8 Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: X-Openstack-Nova-Api-Version: 2.64 Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: b079561a56894573a022735f831b8baf Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServerGroup264TestJSON-2013711069 Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b079561a56894573a022735f831b8baf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b079561a56894573a022735f831b8baf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b079561a56894573a022735f831b8baf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b079561a56894573a022735f831b8baf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServerGroup264TestJSON-2013711069 Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: b079561a56894573a022735f831b8baf Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServerGroup264TestJSON-2013711069 Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServerGroup264TestJSON-2013711069-project Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: f0e95d9021fe43bbb249eb1c3d80289c Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServerGroup264TestJSON-2013711069-project Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance group ed260eba-c36a-4792-b381-039b01e389ee could not be found. Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'ed260eba-c36a-4792-b381-039b01e389ee'} Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ed260eba-c36a-4792-b381-039b01e389ee could not be found. Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ed260eba-c36a-4792-b381-039b01e389ee could not be found. Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:48:22.698464 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:48:22.704246 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:48:22.704246 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:48:22.704246 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:48:22.704246 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:48:22.704246 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ed260eba-c36a-4792-b381-039b01e389ee could not be found. Jul 28 10:48:22.704246 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:48:22.705582 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-32d4ded5-58f5-4534-b12a-4e0ff8991b1c tempest-ServerGroup264TestJSON-2013711069 tempest-ServerGroup264TestJSON-2013711069-project] Returning 404 to user: Instance group ed260eba-c36a-4792-b381-039b01e389ee could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:48:22.706765 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-32d4ded5-58f5-4534-b12a-4e0ff8991b1c tempest-ServerGroup264TestJSON-2013711069 tempest-ServerGroup264TestJSON-2013711069-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/ed260eba-c36a-4792-b381-039b01e389ee" status: 404 len: 117 microversion: 2.64 time: 0.061649 Jul 28 10:48:22.707491 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 610/1234] 10.222.0.46 () {60 vars in 1307 bytes} [Thu Jul 28 10:48:22 2022] DELETE /compute/v2.1/os-server-groups/ed260eba-c36a-4792-b381-039b01e389ee => generated 117 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:48:46.329781 n-d-850468-6 devstack@n-api.service[119463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:48:46.330504 n-d-850468-6 devstack@n-api.service[119463]: Thu Jul 28 10:48:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 10:49:01.549267 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=3 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:01.866931 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f2c1be43-260a-4d41-9573-fcc1d6c4eb9c tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Action: 'create', calling method: .version_select at 0x7fa94b8e7940>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-917297023", "policies": ["affinity"]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:49:01.916302 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-f2c1be43-260a-4d41-9573-fcc1d6c4eb9c tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_groups'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:49:01.939353 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-f2c1be43-260a-4d41-9573-fcc1d6c4eb9c tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for user 6cbc81f644eb4cc3a2a9d0f73ed7b1e1 and project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_groups'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:49:02.063847 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-f2c1be43-260a-4d41-9573-fcc1d6c4eb9c tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_groups'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:49:02.075605 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-f2c1be43-260a-4d41-9573-fcc1d6c4eb9c tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for user 6cbc81f644eb4cc3a2a9d0f73ed7b1e1 and project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_groups'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:49:02.110891 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f2c1be43-260a-4d41-9573-fcc1d6c4eb9c tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.562242 Jul 28 10:49:02.122058 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3b0c1bb2-25f9-44ce-acef-9401c86738da tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Action: 'create', calling method: .version_select at 0x7fa94b82c670>, body: {"server_group": {"name": "tempest-server-group-1093736931", "policies": ["affinity"]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:49:02.132593 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 625/1235] 10.222.0.46 () {60 vars in 1174 bytes} [Thu Jul 28 10:49:01 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:49:02.147156 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=8 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:02.147836 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:02.167703 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-3b0c1bb2-25f9-44ce-acef-9401c86738da tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_groups'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:49:02.179831 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-3b0c1bb2-25f9-44ce-acef-9401c86738da tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for user 6cbc81f644eb4cc3a2a9d0f73ed7b1e1 and project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_groups'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:49:02.288310 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-3b0c1bb2-25f9-44ce-acef-9401c86738da tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_groups'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:49:02.307594 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-3b0c1bb2-25f9-44ce-acef-9401c86738da tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for user 6cbc81f644eb4cc3a2a9d0f73ed7b1e1 and project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_groups'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:49:02.347086 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3b0c1bb2-25f9-44ce-acef-9401c86738da tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.228713 Jul 28 10:49:02.358366 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-504013d5-80bd-41cd-934f-c9bb2f8773b4 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Action: 'create', calling method: .version_select at 0x7fa94b8e7310>, body: {"server_group": {"name": "tempest-server-group-1093736931", "policies": ["affinity"]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:49:02.365843 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 611/1236] 10.222.0.46 () {60 vars in 1173 bytes} [Thu Jul 28 10:49:02 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:49:02.393018 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-504013d5-80bd-41cd-934f-c9bb2f8773b4 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_groups'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:49:02.419557 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-504013d5-80bd-41cd-934f-c9bb2f8773b4 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for user 6cbc81f644eb4cc3a2a9d0f73ed7b1e1 and project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_groups'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:49:02.506844 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-504013d5-80bd-41cd-934f-c9bb2f8773b4 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_groups'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:49:02.519298 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-504013d5-80bd-41cd-934f-c9bb2f8773b4 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for user 6cbc81f644eb4cc3a2a9d0f73ed7b1e1 and project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_groups'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:49:02.568534 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-504013d5-80bd-41cd-934f-c9bb2f8773b4 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.207873 Jul 28 10:49:02.569207 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 626/1237] 10.222.0.46 () {60 vars in 1173 bytes} [Thu Jul 28 10:49:02 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:49:02.580141 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1371ff0d-bb43-46b3-a555-04854253d499 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:02.658203 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-1371ff0d-bb43-46b3-a555-04854253d499 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/9bc68cc4-a38b-4bb5-a771-9f463a255aea" status: 204 len: 0 microversion: 2.1 time: 0.082392 Jul 28 10:49:02.669764 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 612/1238] 10.222.0.46 () {58 vars in 1266 bytes} [Thu Jul 28 10:49:02 2022] DELETE /compute/v2.1/os-server-groups/9bc68cc4-a38b-4bb5-a771-9f463a255aea => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:49:02.675057 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-473150b3-9313-41d7-9151-416059190943 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:02.709566 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-473150b3-9313-41d7-9151-416059190943 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.037245 Jul 28 10:49:02.721820 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ed2af639-d668-4112-9176-5b9637e49029 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:02.725092 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 627/1239] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:49:02 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:49:02.762738 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ed2af639-d668-4112-9176-5b9637e49029 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/b5419162-c66e-494a-b448-a2a9cd3606c8" status: 204 len: 0 microversion: 2.1 time: 0.044427 Jul 28 10:49:02.763636 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 613/1240] 10.222.0.46 () {58 vars in 1266 bytes} [Thu Jul 28 10:49:02 2022] DELETE /compute/v2.1/os-server-groups/b5419162-c66e-494a-b448-a2a9cd3606c8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:49:02.775846 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f6127204-0d7f-4352-a594-07a6640a8d0e tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:02.863156 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f6127204-0d7f-4352-a594-07a6640a8d0e tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.091867 Jul 28 10:49:02.863655 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 628/1241] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:49:02 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:49:02.882168 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-56019067-39fe-4eb0-9216-3994ba68a8ac tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Action: 'create', calling method: .version_select at 0x7fa94b8350d0>, body: {"server_group": {"name": "tempest-server-group-1961177447", "policies": ["affinity"]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:49:02.954351 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-56019067-39fe-4eb0-9216-3994ba68a8ac tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_groups'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:49:03.064458 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-56019067-39fe-4eb0-9216-3994ba68a8ac tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for user 6cbc81f644eb4cc3a2a9d0f73ed7b1e1 and project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_groups'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:49:03.312510 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-56019067-39fe-4eb0-9216-3994ba68a8ac tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_groups'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:49:03.338480 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-56019067-39fe-4eb0-9216-3994ba68a8ac tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for user 6cbc81f644eb4cc3a2a9d0f73ed7b1e1 and project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_groups'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:49:03.404054 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-56019067-39fe-4eb0-9216-3994ba68a8ac tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.530701 Jul 28 10:49:03.404728 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 614/1242] 10.222.0.46 () {60 vars in 1173 bytes} [Thu Jul 28 10:49:02 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:49:03.417260 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-12141920-af75-46a8-a44a-498748348081 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:03.501300 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-12141920-af75-46a8-a44a-498748348081 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/bb68b337-335f-4e43-aa8f-27cadf80a5f7" status: 204 len: 0 microversion: 2.1 time: 0.080274 Jul 28 10:49:03.504838 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 629/1243] 10.222.0.46 () {58 vars in 1266 bytes} [Thu Jul 28 10:49:03 2022] DELETE /compute/v2.1/os-server-groups/bb68b337-335f-4e43-aa8f-27cadf80a5f7 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:49:03.518938 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e1ded1c3-fddf-402b-9d73-c8d6eddc175d tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:03.553493 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e1ded1c3-fddf-402b-9d73-c8d6eddc175d tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.042680 Jul 28 10:49:03.558247 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 615/1244] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:49:03 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:49:03.574225 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ba5b752e-704c-496a-bb1e-01c3f4cecea3 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Action: 'create', calling method: .version_select at 0x7fa94b937af0>, body: {"server_group": {"name": "tempest-server-group-1927925989", "policies": ["anti-affinity"]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:49:03.635983 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-ba5b752e-704c-496a-bb1e-01c3f4cecea3 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_groups'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:49:03.702922 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-ba5b752e-704c-496a-bb1e-01c3f4cecea3 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for user 6cbc81f644eb4cc3a2a9d0f73ed7b1e1 and project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_groups'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:49:03.914692 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-ba5b752e-704c-496a-bb1e-01c3f4cecea3 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_groups'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:49:03.943723 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-ba5b752e-704c-496a-bb1e-01c3f4cecea3 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for user 6cbc81f644eb4cc3a2a9d0f73ed7b1e1 and project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_groups'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:49:04.016996 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ba5b752e-704c-496a-bb1e-01c3f4cecea3 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.446686 Jul 28 10:49:04.020569 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 630/1245] 10.222.0.46 () {60 vars in 1173 bytes} [Thu Jul 28 10:49:03 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:49:04.030834 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-019b1f14-3ec3-42a9-aafb-f3d8f2b28816 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:04.097188 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-019b1f14-3ec3-42a9-aafb-f3d8f2b28816 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/f54b2cb0-7925-4797-9201-2989b7ce12c2" status: 204 len: 0 microversion: 2.1 time: 0.072816 Jul 28 10:49:04.098854 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 616/1246] 10.222.0.46 () {58 vars in 1266 bytes} [Thu Jul 28 10:49:04 2022] DELETE /compute/v2.1/os-server-groups/f54b2cb0-7925-4797-9201-2989b7ce12c2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:49:04.106748 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f97e564a-c180-4b68-9fce-d5b69adeb146 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:04.134033 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f97e564a-c180-4b68-9fce-d5b69adeb146 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.025556 Jul 28 10:49:04.134681 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 631/1247] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:49:04 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:49:04.226300 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-667716544", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "9d91b0ac-6ef7-4fe4-bce7-a861d380e332"}]}, "os:scheduler_hints": {"group": "63fb0abd-80a1-4b29-866e-399df11f8cc9"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:49:04.304205 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] validate_networks() for [('9d91b0ac-6ef7-4fe4-bce7-a861d380e332', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:49:06.128139 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:49:06.128841 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:49:06.129025 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:49:06.130032 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:49:06.130834 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:49:06.176509 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:06.177057 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:06.178062 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:06.178597 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:06.228785 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:49:06.242239 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for user 6cbc81f644eb4cc3a2a9d0f73ed7b1e1 and project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:49:06.277968 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:49:06.283958 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] [instance: 4a7646e9-306f-40d0-bbcb-6486fd79d651] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:49:06.423651 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119463) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 28 10:49:06.429046 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=9 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:06.472834 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_group_members'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:49:06.490463 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for user 6cbc81f644eb4cc3a2a9d0f73ed7b1e1 and project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_group_members'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:49:06.590581 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_group_members'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:49:06.605255 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Getting quotas for user 6cbc81f644eb4cc3a2a9d0f73ed7b1e1 and project a9d0fafe4ed04237b3a41f025b98eb79. Resources: {'server_group_members'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:49:06.669649 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-2170f1eb-23b8-435e-a37c-73860a16dada tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.447933 Jul 28 10:49:06.671933 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 617/1248] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:49:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 10:49:06.694653 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-923f9699-1b8c-48cb-884f-43db9d5abd1f tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:06.696566 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-923f9699-1b8c-48cb-884f-43db9d5abd1f tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] [instance: 4a7646e9-306f-40d0-bbcb-6486fd79d651] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:49:06.941767 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-923f9699-1b8c-48cb-884f-43db9d5abd1f tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbc81f644eb4cc3a2a9d0f73ed7b1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0fafe4ed04237b3a41f025b98eb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:49:06.954684 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-923f9699-1b8c-48cb-884f-43db9d5abd1f tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "GET /compute/v2.1/servers/4a7646e9-306f-40d0-bbcb-6486fd79d651" status: 200 len: 1212 microversion: 2.1 time: 0.274325 Jul 28 10:49:06.958952 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 632/1249] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:49:06 2022] GET /compute/v2.1/servers/4a7646e9-306f-40d0-bbcb-6486fd79d651 => generated 1212 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:49:07.444020 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-2106331930", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "db601ed9-c8cd-448b-882a-6fd2833791e2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "60cc7037-2405-4fb9-943a-b808862d4369"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:49:07.603802 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] validate_networks() for [('60cc7037-2405-4fb9-943a-b808862d4369', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:49:07.984044 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a215adbf-440a-4376-9bf2-fe8c66bea652 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:07.985260 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a215adbf-440a-4376-9bf2-fe8c66bea652 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] [instance: 4a7646e9-306f-40d0-bbcb-6486fd79d651] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:49:07.994626 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:07.999738 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a215adbf-440a-4376-9bf2-fe8c66bea652 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:08.000478 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a215adbf-440a-4376-9bf2-fe8c66bea652 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:08.001401 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a215adbf-440a-4376-9bf2-fe8c66bea652 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:08.002877 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a215adbf-440a-4376-9bf2-fe8c66bea652 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:08.117901 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a215adbf-440a-4376-9bf2-fe8c66bea652 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:08.118261 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a215adbf-440a-4376-9bf2-fe8c66bea652 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:08.120340 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-a215adbf-440a-4376-9bf2-fe8c66bea652 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lazy-loading 'fault' on Instance uuid 4a7646e9-306f-40d0-bbcb-6486fd79d651 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:49:08.226829 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-a215adbf-440a-4376-9bf2-fe8c66bea652 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbc81f644eb4cc3a2a9d0f73ed7b1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0fafe4ed04237b3a41f025b98eb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:49:08.243050 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a215adbf-440a-4376-9bf2-fe8c66bea652 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "GET /compute/v2.1/servers/4a7646e9-306f-40d0-bbcb-6486fd79d651" status: 200 len: 1285 microversion: 2.1 time: 0.262793 Jul 28 10:49:08.245323 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 633/1250] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:49:07 2022] GET /compute/v2.1/servers/4a7646e9-306f-40d0-bbcb-6486fd79d651 => generated 1285 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:49:08.266520 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2a3b52e7-d4c9-47d5-a25e-5b6113b296e6 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:08.267354 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-2a3b52e7-d4c9-47d5-a25e-5b6113b296e6 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] [instance: 4a7646e9-306f-40d0-bbcb-6486fd79d651] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:49:08.274754 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2a3b52e7-d4c9-47d5-a25e-5b6113b296e6 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:08.275535 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2a3b52e7-d4c9-47d5-a25e-5b6113b296e6 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:08.277023 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2a3b52e7-d4c9-47d5-a25e-5b6113b296e6 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:08.277779 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2a3b52e7-d4c9-47d5-a25e-5b6113b296e6 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:08.338272 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-2a3b52e7-d4c9-47d5-a25e-5b6113b296e6 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] [instance: 4a7646e9-306f-40d0-bbcb-6486fd79d651] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:49:08.511974 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-2a3b52e7-d4c9-47d5-a25e-5b6113b296e6 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] [instance: 4a7646e9-306f-40d0-bbcb-6486fd79d651] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:49:08.512788 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2a3b52e7-d4c9-47d5-a25e-5b6113b296e6 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:08.513236 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2a3b52e7-d4c9-47d5-a25e-5b6113b296e6 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:08.513670 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-2a3b52e7-d4c9-47d5-a25e-5b6113b296e6 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] [instance: 4a7646e9-306f-40d0-bbcb-6486fd79d651] instance's host None is down, deleting from database Jul 28 10:49:08.531719 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-2a3b52e7-d4c9-47d5-a25e-5b6113b296e6 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] [instance: 4a7646e9-306f-40d0-bbcb-6486fd79d651] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:49:08.622348 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-2a3b52e7-d4c9-47d5-a25e-5b6113b296e6 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] [instance: 4a7646e9-306f-40d0-bbcb-6486fd79d651] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:49:08.632767 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-2a3b52e7-d4c9-47d5-a25e-5b6113b296e6 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] [instance: 4a7646e9-306f-40d0-bbcb-6486fd79d651] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:49:09.077280 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-2a3b52e7-d4c9-47d5-a25e-5b6113b296e6 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4a7646e9-306f-40d0-bbcb-6486fd79d651" status: 204 len: 0 microversion: 2.1 time: 0.815391 Jul 28 10:49:09.080945 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 634/1251] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:49:08 2022] DELETE /compute/v2.1/servers/4a7646e9-306f-40d0-bbcb-6486fd79d651 => generated 0 bytes in 819 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 10:49:09.091039 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f8b38db3-6736-4be9-b9cf-8467f6ae1ce3 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:09.091881 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-f8b38db3-6736-4be9-b9cf-8467f6ae1ce3 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] [instance: 4a7646e9-306f-40d0-bbcb-6486fd79d651] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:49:09.106924 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:49:09.108066 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:49:09.108804 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:49:09.110015 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:49:09.110585 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:49:09.121243 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f8b38db3-6736-4be9-b9cf-8467f6ae1ce3 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:09.121702 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f8b38db3-6736-4be9-b9cf-8467f6ae1ce3 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:09.122563 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f8b38db3-6736-4be9-b9cf-8467f6ae1ce3 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:09.123237 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f8b38db3-6736-4be9-b9cf-8467f6ae1ce3 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:09.131410 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:09.135245 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:09.137148 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:09.138378 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:09.194167 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-f8b38db3-6736-4be9-b9cf-8467f6ae1ce3 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] HTTP exception thrown: Instance 4a7646e9-306f-40d0-bbcb-6486fd79d651 could not be found. Jul 28 10:49:09.202127 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Getting quotas for project a8209f1d63904867a0c74297c01a12c0. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f8b38db3-6736-4be9-b9cf-8467f6ae1ce3 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Request method failure captured: Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/4a7646e9-306f-40d0-bbcb-6486fd79d651 HTTP/1.1 Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mmdy3DJ7mSEFdyrtggFA9Ywg43hRrQNpBRLBIiKo_XqHPfGzCuWB90eXU-0M5FXzcvWR3vyOxWNsyEDT_xWdl0frIDnixdaLlbrB63sdQaaKlO8tQeRT94Vy42UUwKbBtG5f-Qjy8vEnHWwVBtSfnnVgvEKAkwLFUjhLDNjLQUVcBo Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: a9d0fafe4ed04237b3a41f025b98eb79 Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ServerGroupTestJSON-1223399577 Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a9d0fafe4ed04237b3a41f025b98eb79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9d0fafe4ed04237b3a41f025b98eb79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9d0fafe4ed04237b3a41f025b98eb79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a9d0fafe4ed04237b3a41f025b98eb79", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ServerGroupTestJSON-1223399577 Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: a9d0fafe4ed04237b3a41f025b98eb79 Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ServerGroupTestJSON-1223399577 Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ServerGroupTestJSON-1223399577-project Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 6cbc81f644eb4cc3a2a9d0f73ed7b1e1 Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ServerGroupTestJSON-1223399577-project Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 4a7646e9-306f-40d0-bbcb-6486fd79d651 could not be found. Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '4a7646e9-306f-40d0-bbcb-6486fd79d651'} Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a7646e9-306f-40d0-bbcb-6486fd79d651 could not be found. Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a7646e9-306f-40d0-bbcb-6486fd79d651 could not be found. Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:49:09.203972 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.210425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:09.210425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:49:09.210425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:49:09.210425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:49:09.210425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:49:09.210425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a7646e9-306f-40d0-bbcb-6486fd79d651 could not be found. Jul 28 10:49:09.210425 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.210425 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f8b38db3-6736-4be9-b9cf-8467f6ae1ce3 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Returning 404 to user: Instance 4a7646e9-306f-40d0-bbcb-6486fd79d651 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:49:09.216289 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f8b38db3-6736-4be9-b9cf-8467f6ae1ce3 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "GET /compute/v2.1/servers/4a7646e9-306f-40d0-bbcb-6486fd79d651" status: 404 len: 111 microversion: 2.1 time: 0.130293 Jul 28 10:49:09.217898 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 635/1252] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:49:09 2022] GET /compute/v2.1/servers/4a7646e9-306f-40d0-bbcb-6486fd79d651 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:49:09.218938 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Getting quotas for user f4c9167954974c6a8908f2d61cb9aa5a and project a8209f1d63904867a0c74297c01a12c0. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:49:09.242402 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-61a4b018-2cff-4814-a058-0be5f41061be tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:09.324244 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.compute.server_groups [None req-61a4b018-2cff-4814-a058-0be5f41061be tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Querying cell 00000000-0000-0000-0000-000000000000(cell0) for 1 instances {{(pid=119464) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 28 10:49:09.325063 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-61a4b018-2cff-4814-a058-0be5f41061be tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:09.325514 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-61a4b018-2cff-4814-a058-0be5f41061be tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:09.380455 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-61a4b018-2cff-4814-a058-0be5f41061be tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.152466 Jul 28 10:49:09.380789 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:49:09.382489 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 636/1253] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:49:09 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:49:09.383410 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6f9dcc-3afb-4e52-81e8-4a26c510a702] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='db601ed9-c8cd-448b-882a-6fd2833791e2',volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:49:09.403056 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-dced6083-1ea7-43bd-8d9b-0dff0fd4f8b6 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:09.454666 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.compute.server_groups [None req-dced6083-1ea7-43bd-8d9b-0dff0fd4f8b6 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Querying cell 00000000-0000-0000-0000-000000000000(cell0) for 1 instances {{(pid=119464) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 28 10:49:09.455525 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-dced6083-1ea7-43bd-8d9b-0dff0fd4f8b6 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:09.455982 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-dced6083-1ea7-43bd-8d9b-0dff0fd4f8b6 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:09.498162 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-dced6083-1ea7-43bd-8d9b-0dff0fd4f8b6 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups/63fb0abd-80a1-4b29-866e-399df11f8cc9" status: 200 len: 183 microversion: 2.1 time: 0.098192 Jul 28 10:49:09.508802 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 637/1254] 10.222.0.46 () {58 vars in 1263 bytes} [Thu Jul 28 10:49:09 2022] GET /compute/v2.1/os-server-groups/63fb0abd-80a1-4b29-866e-399df11f8cc9 => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:49:09.529291 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-018a39bd-1a9f-4276-b13d-b57d7e36c41c tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:09.549436 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-018a39bd-1a9f-4276-b13d-b57d7e36c41c tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] HTTP exception thrown: Instance group f54b2cb0-7925-4797-9201-2989b7ce12c2 could not be found. Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-018a39bd-1a9f-4276-b13d-b57d7e36c41c tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Request method failure captured: Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: request: DELETE /compute/v2.1/os-server-groups/f54b2cb0-7925-4797-9201-2989b7ce12c2 HTTP/1.1 Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mmdy3DJ7mSEFdyrtggFA9Ywg43hRrQNpBRLBIiKo_XqHPfGzCuWB90eXU-0M5FXzcvWR3vyOxWNsyEDT_xWdl0frIDnixdaLlbrB63sdQaaKlO8tQeRT94Vy42UUwKbBtG5f-Qjy8vEnHWwVBtSfnnVgvEKAkwLFUjhLDNjLQUVcBo Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: a9d0fafe4ed04237b3a41f025b98eb79 Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ServerGroupTestJSON-1223399577 Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a9d0fafe4ed04237b3a41f025b98eb79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9d0fafe4ed04237b3a41f025b98eb79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9d0fafe4ed04237b3a41f025b98eb79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a9d0fafe4ed04237b3a41f025b98eb79", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ServerGroupTestJSON-1223399577 Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: a9d0fafe4ed04237b3a41f025b98eb79 Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ServerGroupTestJSON-1223399577 Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ServerGroupTestJSON-1223399577-project Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 6cbc81f644eb4cc3a2a9d0f73ed7b1e1 Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ServerGroupTestJSON-1223399577-project Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance group f54b2cb0-7925-4797-9201-2989b7ce12c2 could not be found. Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'f54b2cb0-7925-4797-9201-2989b7ce12c2'} Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f54b2cb0-7925-4797-9201-2989b7ce12c2 could not be found. Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f54b2cb0-7925-4797-9201-2989b7ce12c2 could not be found. Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.555644 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:09.565252 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:49:09.565252 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:49:09.565252 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:49:09.565252 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:49:09.565252 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f54b2cb0-7925-4797-9201-2989b7ce12c2 could not be found. Jul 28 10:49:09.565252 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.565252 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-018a39bd-1a9f-4276-b13d-b57d7e36c41c tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Returning 404 to user: Instance group f54b2cb0-7925-4797-9201-2989b7ce12c2 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:49:09.565252 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-018a39bd-1a9f-4276-b13d-b57d7e36c41c tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/f54b2cb0-7925-4797-9201-2989b7ce12c2" status: 404 len: 117 microversion: 2.1 time: 0.055045 Jul 28 10:49:09.570847 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 638/1255] 10.222.0.46 () {58 vars in 1266 bytes} [Thu Jul 28 10:49:09 2022] DELETE /compute/v2.1/os-server-groups/f54b2cb0-7925-4797-9201-2989b7ce12c2 => generated 117 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:49:09.585540 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6f21238b-53ba-4540-b775-5a5b9752c67d tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:09.610215 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-6f21238b-53ba-4540-b775-5a5b9752c67d tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] HTTP exception thrown: Instance group bb68b337-335f-4e43-aa8f-27cadf80a5f7 could not be found. Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6f21238b-53ba-4540-b775-5a5b9752c67d tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Request method failure captured: Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: request: DELETE /compute/v2.1/os-server-groups/bb68b337-335f-4e43-aa8f-27cadf80a5f7 HTTP/1.1 Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mmdy3DJ7mSEFdyrtggFA9Ywg43hRrQNpBRLBIiKo_XqHPfGzCuWB90eXU-0M5FXzcvWR3vyOxWNsyEDT_xWdl0frIDnixdaLlbrB63sdQaaKlO8tQeRT94Vy42UUwKbBtG5f-Qjy8vEnHWwVBtSfnnVgvEKAkwLFUjhLDNjLQUVcBo Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: a9d0fafe4ed04237b3a41f025b98eb79 Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ServerGroupTestJSON-1223399577 Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a9d0fafe4ed04237b3a41f025b98eb79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9d0fafe4ed04237b3a41f025b98eb79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9d0fafe4ed04237b3a41f025b98eb79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a9d0fafe4ed04237b3a41f025b98eb79", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ServerGroupTestJSON-1223399577 Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: a9d0fafe4ed04237b3a41f025b98eb79 Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ServerGroupTestJSON-1223399577 Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ServerGroupTestJSON-1223399577-project Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 6cbc81f644eb4cc3a2a9d0f73ed7b1e1 Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ServerGroupTestJSON-1223399577-project Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance group bb68b337-335f-4e43-aa8f-27cadf80a5f7 could not be found. Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'bb68b337-335f-4e43-aa8f-27cadf80a5f7'} Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group bb68b337-335f-4e43-aa8f-27cadf80a5f7 could not be found. Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group bb68b337-335f-4e43-aa8f-27cadf80a5f7 could not be found. Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.619853 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:09.623507 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:49:09.623507 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:49:09.623507 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:49:09.623507 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:49:09.623507 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group bb68b337-335f-4e43-aa8f-27cadf80a5f7 could not be found. Jul 28 10:49:09.623507 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.626271 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6f21238b-53ba-4540-b775-5a5b9752c67d tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Returning 404 to user: Instance group bb68b337-335f-4e43-aa8f-27cadf80a5f7 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:49:09.631733 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-6f21238b-53ba-4540-b775-5a5b9752c67d tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/bb68b337-335f-4e43-aa8f-27cadf80a5f7" status: 404 len: 117 microversion: 2.1 time: 0.058736 Jul 28 10:49:09.632592 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 639/1256] 10.222.0.46 () {58 vars in 1266 bytes} [Thu Jul 28 10:49:09 2022] DELETE /compute/v2.1/os-server-groups/bb68b337-335f-4e43-aa8f-27cadf80a5f7 => generated 117 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:49:09.652795 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e4e11da0-6357-465c-911e-ecb2e34134ad tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:09.682092 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-e4e11da0-6357-465c-911e-ecb2e34134ad tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] HTTP exception thrown: Instance group b5419162-c66e-494a-b448-a2a9cd3606c8 could not be found. Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e4e11da0-6357-465c-911e-ecb2e34134ad tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Request method failure captured: Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: request: DELETE /compute/v2.1/os-server-groups/b5419162-c66e-494a-b448-a2a9cd3606c8 HTTP/1.1 Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mmdy3DJ7mSEFdyrtggFA9Ywg43hRrQNpBRLBIiKo_XqHPfGzCuWB90eXU-0M5FXzcvWR3vyOxWNsyEDT_xWdl0frIDnixdaLlbrB63sdQaaKlO8tQeRT94Vy42UUwKbBtG5f-Qjy8vEnHWwVBtSfnnVgvEKAkwLFUjhLDNjLQUVcBo Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: a9d0fafe4ed04237b3a41f025b98eb79 Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ServerGroupTestJSON-1223399577 Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a9d0fafe4ed04237b3a41f025b98eb79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9d0fafe4ed04237b3a41f025b98eb79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9d0fafe4ed04237b3a41f025b98eb79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a9d0fafe4ed04237b3a41f025b98eb79", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ServerGroupTestJSON-1223399577 Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: a9d0fafe4ed04237b3a41f025b98eb79 Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ServerGroupTestJSON-1223399577 Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ServerGroupTestJSON-1223399577-project Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 6cbc81f644eb4cc3a2a9d0f73ed7b1e1 Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ServerGroupTestJSON-1223399577-project Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance group b5419162-c66e-494a-b448-a2a9cd3606c8 could not be found. Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'b5419162-c66e-494a-b448-a2a9cd3606c8'} Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b5419162-c66e-494a-b448-a2a9cd3606c8 could not be found. Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b5419162-c66e-494a-b448-a2a9cd3606c8 could not be found. Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.688278 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:09.692056 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:49:09.692056 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:49:09.692056 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:49:09.692056 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:49:09.692056 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b5419162-c66e-494a-b448-a2a9cd3606c8 could not be found. Jul 28 10:49:09.692056 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.692056 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e4e11da0-6357-465c-911e-ecb2e34134ad tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Returning 404 to user: Instance group b5419162-c66e-494a-b448-a2a9cd3606c8 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:49:09.695141 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e4e11da0-6357-465c-911e-ecb2e34134ad tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/b5419162-c66e-494a-b448-a2a9cd3606c8" status: 404 len: 117 microversion: 2.1 time: 0.052822 Jul 28 10:49:09.701307 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 640/1257] 10.222.0.46 () {58 vars in 1266 bytes} [Thu Jul 28 10:49:09 2022] DELETE /compute/v2.1/os-server-groups/b5419162-c66e-494a-b448-a2a9cd3606c8 => generated 117 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:49:09.726481 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f479643f-a1dd-4999-a7bc-dd04f34923c9 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:09.748283 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-f479643f-a1dd-4999-a7bc-dd04f34923c9 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] HTTP exception thrown: Instance group 9bc68cc4-a38b-4bb5-a771-9f463a255aea could not be found. Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f479643f-a1dd-4999-a7bc-dd04f34923c9 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Request method failure captured: Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: request: DELETE /compute/v2.1/os-server-groups/9bc68cc4-a38b-4bb5-a771-9f463a255aea HTTP/1.1 Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mmdy3DJ7mSEFdyrtggFA9Ywg43hRrQNpBRLBIiKo_XqHPfGzCuWB90eXU-0M5FXzcvWR3vyOxWNsyEDT_xWdl0frIDnixdaLlbrB63sdQaaKlO8tQeRT94Vy42UUwKbBtG5f-Qjy8vEnHWwVBtSfnnVgvEKAkwLFUjhLDNjLQUVcBo Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: a9d0fafe4ed04237b3a41f025b98eb79 Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ServerGroupTestJSON-1223399577 Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a9d0fafe4ed04237b3a41f025b98eb79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9d0fafe4ed04237b3a41f025b98eb79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9d0fafe4ed04237b3a41f025b98eb79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a9d0fafe4ed04237b3a41f025b98eb79", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ServerGroupTestJSON-1223399577 Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: a9d0fafe4ed04237b3a41f025b98eb79 Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ServerGroupTestJSON-1223399577 Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ServerGroupTestJSON-1223399577-project Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 6cbc81f644eb4cc3a2a9d0f73ed7b1e1 Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ServerGroupTestJSON-1223399577-project Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance group 9bc68cc4-a38b-4bb5-a771-9f463a255aea could not be found. Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '9bc68cc4-a38b-4bb5-a771-9f463a255aea'} Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9bc68cc4-a38b-4bb5-a771-9f463a255aea could not be found. Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9bc68cc4-a38b-4bb5-a771-9f463a255aea could not be found. Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.758930 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:09.763724 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:49:09.763724 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:49:09.763724 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:49:09.763724 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:49:09.763724 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9bc68cc4-a38b-4bb5-a771-9f463a255aea could not be found. Jul 28 10:49:09.763724 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:49:09.763724 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f479643f-a1dd-4999-a7bc-dd04f34923c9 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Returning 404 to user: Instance group 9bc68cc4-a38b-4bb5-a771-9f463a255aea could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:49:09.764270 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f479643f-a1dd-4999-a7bc-dd04f34923c9 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/9bc68cc4-a38b-4bb5-a771-9f463a255aea" status: 404 len: 117 microversion: 2.1 time: 0.054706 Jul 28 10:49:09.768735 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 641/1258] 10.222.0.46 () {58 vars in 1266 bytes} [Thu Jul 28 10:49:09 2022] DELETE /compute/v2.1/os-server-groups/9bc68cc4-a38b-4bb5-a771-9f463a255aea => generated 117 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:49:09.782984 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ffa74350-5cb2-4eec-a936-38aecabfdb50 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:09.876423 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ffa74350-5cb2-4eec-a936-38aecabfdb50 tempest-ServerGroupTestJSON-1223399577 tempest-ServerGroupTestJSON-1223399577-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/63fb0abd-80a1-4b29-866e-399df11f8cc9" status: 204 len: 0 microversion: 2.1 time: 0.104935 Jul 28 10:49:09.880495 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 642/1259] 10.222.0.46 () {58 vars in 1266 bytes} [Thu Jul 28 10:49:09 2022] DELETE /compute/v2.1/os-server-groups/63fb0abd-80a1-4b29-866e-399df11f8cc9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 10:49:09.902404 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a3b07d20-9833-4150-be17-465eb1d49ddf tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.462307 Jul 28 10:49:09.903174 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 618/1260] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:49:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:49:09.916109 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ae5f0b00-9002-4dcd-bcbf-042b4df54943 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:09.917323 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ae5f0b00-9002-4dcd-bcbf-042b4df54943 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6f9dcc-3afb-4e52-81e8-4a26c510a702] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:49:10.195538 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-ae5f0b00-9002-4dcd-bcbf-042b4df54943 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c9167954974c6a8908f2d61cb9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8209f1d63904867a0c74297c01a12c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:49:10.203527 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ae5f0b00-9002-4dcd-bcbf-042b4df54943 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "GET /compute/v2.1/servers/dc6f9dcc-3afb-4e52-81e8-4a26c510a702" status: 200 len: 1071 microversion: 2.1 time: 0.291967 Jul 28 10:49:10.223556 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 643/1261] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:49:09 2022] GET /compute/v2.1/servers/dc6f9dcc-3afb-4e52-81e8-4a26c510a702 => generated 1071 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:49:11.225647 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6f12e7da-75b0-481e-bc03-811f36ea3ce8 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:11.226298 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-6f12e7da-75b0-481e-bc03-811f36ea3ce8 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6f9dcc-3afb-4e52-81e8-4a26c510a702] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:49:11.241154 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6f12e7da-75b0-481e-bc03-811f36ea3ce8 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:11.241397 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6f12e7da-75b0-481e-bc03-811f36ea3ce8 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:11.253123 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6f12e7da-75b0-481e-bc03-811f36ea3ce8 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:11.253737 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6f12e7da-75b0-481e-bc03-811f36ea3ce8 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:11.396281 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6f12e7da-75b0-481e-bc03-811f36ea3ce8 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:11.396785 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6f12e7da-75b0-481e-bc03-811f36ea3ce8 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:11.397223 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-6f12e7da-75b0-481e-bc03-811f36ea3ce8 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lazy-loading 'fault' on Instance uuid dc6f9dcc-3afb-4e52-81e8-4a26c510a702 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:49:11.683522 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-6f12e7da-75b0-481e-bc03-811f36ea3ce8 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c9167954974c6a8908f2d61cb9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8209f1d63904867a0c74297c01a12c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:49:11.700395 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6f12e7da-75b0-481e-bc03-811f36ea3ce8 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "GET /compute/v2.1/servers/dc6f9dcc-3afb-4e52-81e8-4a26c510a702" status: 200 len: 1190 microversion: 2.1 time: 0.479737 Jul 28 10:49:11.717105 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 619/1262] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:49:11 2022] GET /compute/v2.1/servers/dc6f9dcc-3afb-4e52-81e8-4a26c510a702 => generated 1190 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:49:11.729243 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-008fd8ff-15ac-4dc1-b733-df391f5930ec tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:11.730189 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-008fd8ff-15ac-4dc1-b733-df391f5930ec tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6f9dcc-3afb-4e52-81e8-4a26c510a702] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:49:11.748036 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-008fd8ff-15ac-4dc1-b733-df391f5930ec tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:11.748496 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-008fd8ff-15ac-4dc1-b733-df391f5930ec tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:11.749363 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-008fd8ff-15ac-4dc1-b733-df391f5930ec tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:11.749816 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-008fd8ff-15ac-4dc1-b733-df391f5930ec tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:11.870910 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-008fd8ff-15ac-4dc1-b733-df391f5930ec tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6f9dcc-3afb-4e52-81e8-4a26c510a702] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:49:11.970417 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-008fd8ff-15ac-4dc1-b733-df391f5930ec tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6f9dcc-3afb-4e52-81e8-4a26c510a702] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:49:11.971237 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-008fd8ff-15ac-4dc1-b733-df391f5930ec tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:11.971686 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-008fd8ff-15ac-4dc1-b733-df391f5930ec tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:11.972129 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-008fd8ff-15ac-4dc1-b733-df391f5930ec tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6f9dcc-3afb-4e52-81e8-4a26c510a702] instance's host None is down, deleting from database Jul 28 10:49:11.990417 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-008fd8ff-15ac-4dc1-b733-df391f5930ec tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6f9dcc-3afb-4e52-81e8-4a26c510a702] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:49:12.103962 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-008fd8ff-15ac-4dc1-b733-df391f5930ec tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6f9dcc-3afb-4e52-81e8-4a26c510a702] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:49:12.115843 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-008fd8ff-15ac-4dc1-b733-df391f5930ec tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6f9dcc-3afb-4e52-81e8-4a26c510a702] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:49:12.984829 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=62,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:13.008875 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-008fd8ff-15ac-4dc1-b733-df391f5930ec tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dc6f9dcc-3afb-4e52-81e8-4a26c510a702" status: 204 len: 0 microversion: 2.1 time: 1.282895 Jul 28 10:49:13.014584 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 644/1263] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:49:11 2022] DELETE /compute/v2.1/servers/dc6f9dcc-3afb-4e52-81e8-4a26c510a702 => generated 0 bytes in 1287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:49:13.023458 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f0038b48-c003-4bf7-8350-d40f4bfe7700 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:13.024090 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f0038b48-c003-4bf7-8350-d40f4bfe7700 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: dc6f9dcc-3afb-4e52-81e8-4a26c510a702] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:49:13.052663 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f0038b48-c003-4bf7-8350-d40f4bfe7700 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:13.053120 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f0038b48-c003-4bf7-8350-d40f4bfe7700 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:13.053943 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f0038b48-c003-4bf7-8350-d40f4bfe7700 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:13.054371 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f0038b48-c003-4bf7-8350-d40f4bfe7700 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:13.114078 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-f0038b48-c003-4bf7-8350-d40f4bfe7700 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] HTTP exception thrown: Instance dc6f9dcc-3afb-4e52-81e8-4a26c510a702 could not be found. Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f0038b48-c003-4bf7-8350-d40f4bfe7700 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Request method failure captured: Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/dc6f9dcc-3afb-4e52-81e8-4a26c510a702 HTTP/1.1 Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mjyC3fTgoib6gZ84Pzs1H0WGFzATjUZ993aaue2Om9orB7eK_fh9xiT4QMXZtT_KdLk0bsSNDQzKKAyoUEc6o6yLbTk9llZb_KxyvKyz2vFLNpc9kR6zacAg0s1EIVfbjXWrGIUbmS0Sj7SellzyWHpCpymlLe7ycorAaxmUez9kZM Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: a8209f1d63904867a0c74297c01a12c0 Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-TestVolumeBootPattern-148227680 Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a8209f1d63904867a0c74297c01a12c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a8209f1d63904867a0c74297c01a12c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a8209f1d63904867a0c74297c01a12c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a8209f1d63904867a0c74297c01a12c0", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-TestVolumeBootPattern-148227680 Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: a8209f1d63904867a0c74297c01a12c0 Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-TestVolumeBootPattern-148227680 Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-TestVolumeBootPattern-148227680-project Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: f4c9167954974c6a8908f2d61cb9aa5a Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-TestVolumeBootPattern-148227680-project Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance dc6f9dcc-3afb-4e52-81e8-4a26c510a702 could not be found. Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'dc6f9dcc-3afb-4e52-81e8-4a26c510a702'} Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc6f9dcc-3afb-4e52-81e8-4a26c510a702 could not be found. Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc6f9dcc-3afb-4e52-81e8-4a26c510a702 could not be found. Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:49:13.126738 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:49:13.130823 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:13.130823 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:49:13.130823 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:49:13.130823 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:49:13.130823 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:49:13.130823 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc6f9dcc-3afb-4e52-81e8-4a26c510a702 could not be found. Jul 28 10:49:13.130823 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:49:13.130823 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f0038b48-c003-4bf7-8350-d40f4bfe7700 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Returning 404 to user: Instance dc6f9dcc-3afb-4e52-81e8-4a26c510a702 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:49:13.132289 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f0038b48-c003-4bf7-8350-d40f4bfe7700 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "GET /compute/v2.1/servers/dc6f9dcc-3afb-4e52-81e8-4a26c510a702" status: 404 len: 111 microversion: 2.1 time: 0.115589 Jul 28 10:49:13.138903 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 620/1264] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:49:13 2022] GET /compute/v2.1/servers/dc6f9dcc-3afb-4e52-81e8-4a26c510a702 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:49:19.073970 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fab347be-b750-485d-8a35-7c52376dc361 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Action: 'create', calling method: .version_select at 0x7fa94b6a2670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1363112004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+w9awUZhVVmDdcsAnSyqxB4t+XWp+9BD7UqRUB1G7ygS/2SvzgMcfZ56b6B7i4myISnkXe9jyCf2yWyFMnh1AHm+mD0f/hHUkVcsK6bdgdL8yN8gNhpERe2B0enMLa7g=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:49:19.164601 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-fab347be-b750-485d-8a35-7c52376dc361 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Getting quotas for project a8209f1d63904867a0c74297c01a12c0. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:49:19.227065 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-fab347be-b750-485d-8a35-7c52376dc361 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Getting quotas for user f4c9167954974c6a8908f2d61cb9aa5a and project a8209f1d63904867a0c74297c01a12c0. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:49:19.316927 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-fab347be-b750-485d-8a35-7c52376dc361 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.246840 Jul 28 10:49:19.317927 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 645/1265] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:49:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:49:40.115710 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:40.116834 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=36 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:40.117683 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:40.135364 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=14 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:40.457202 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-672000124", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:49:40.559116 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] validate_networks() for [('8dd64de7-d3ef-4836-aeb9-98704c2d4f49', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:49:41.583282 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:49:41.584865 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:49:41.584865 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:49:41.585491 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:49:41.586527 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:49:41.598010 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:41.598835 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:41.600020 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:41.600635 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:41.663511 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Getting quotas for project 65fc4fdf92684e2191cb2050849a4a28. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:49:41.678774 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Getting quotas for user 85b108eef54145a6952e554a69bf97cf and project 65fc4fdf92684e2191cb2050849a4a28. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:49:41.719150 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:49:41.724742 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 0c42c410-568b-42ba-b9ad-73748c0d9174] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:49:41.973031 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b5aa59e1-88b7-4c8b-8ff5-1578d894b983 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.863739 Jul 28 10:49:41.976191 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 621/1266] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:49:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 1868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 10:49:41.987048 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-90a2ae20-f06d-4789-bfac-1cc7703562dd tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:41.987678 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-90a2ae20-f06d-4789-bfac-1cc7703562dd tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 0c42c410-568b-42ba-b9ad-73748c0d9174] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:49:41.990019 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=32 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:41.990697 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:49:42.158752 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-90a2ae20-f06d-4789-bfac-1cc7703562dd tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b108eef54145a6952e554a69bf97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65fc4fdf92684e2191cb2050849a4a28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:49:42.172091 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-90a2ae20-f06d-4789-bfac-1cc7703562dd tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] 10.222.0.46 "GET /compute/v2.1/servers/0c42c410-568b-42ba-b9ad-73748c0d9174" status: 200 len: 1221 microversion: 2.1 time: 0.189041 Jul 28 10:49:42.172819 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 646/1267] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:49:41 2022] GET /compute/v2.1/servers/0c42c410-568b-42ba-b9ad-73748c0d9174 => generated 1221 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:49:42.290406 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1842353013", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:49:42.547392 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] validate_networks() for [('8dd64de7-d3ef-4836-aeb9-98704c2d4f49', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:49:44.360870 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:49:44.361505 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:49:44.361809 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:49:44.362352 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:49:44.363090 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:49:44.389647 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:44.400055 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:44.400945 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:44.401607 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:44.460258 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Getting quotas for project 65fc4fdf92684e2191cb2050849a4a28. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:49:44.467126 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Getting quotas for user 85b108eef54145a6952e554a69bf97cf and project 65fc4fdf92684e2191cb2050849a4a28. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:49:44.484574 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:49:44.488183 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 640b9e84-be9e-4bfd-bf01-e59c74e95a25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:49:44.601762 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-34bddea2-0347-4016-a5a7-1b00089a73c3 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.317296 Jul 28 10:49:44.602738 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 622/1268] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:49:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 2319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:49:44.615910 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a774fc1a-ea8c-4720-b4ba-100452e16d4b tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:44.616729 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a774fc1a-ea8c-4720-b4ba-100452e16d4b tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 640b9e84-be9e-4bfd-bf01-e59c74e95a25] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:49:44.822968 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-a774fc1a-ea8c-4720-b4ba-100452e16d4b tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b108eef54145a6952e554a69bf97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65fc4fdf92684e2191cb2050849a4a28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:49:44.837574 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a774fc1a-ea8c-4720-b4ba-100452e16d4b tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] 10.222.0.46 "GET /compute/v2.1/servers/640b9e84-be9e-4bfd-bf01-e59c74e95a25" status: 200 len: 1222 microversion: 2.1 time: 0.226865 Jul 28 10:49:44.838218 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 647/1269] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:49:44 2022] GET /compute/v2.1/servers/640b9e84-be9e-4bfd-bf01-e59c74e95a25 => generated 1222 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:49:45.869139 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a027dc23-4efe-476e-9a1d-61305df45400 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:45.870542 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-a027dc23-4efe-476e-9a1d-61305df45400 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 640b9e84-be9e-4bfd-bf01-e59c74e95a25] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:49:45.897329 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a027dc23-4efe-476e-9a1d-61305df45400 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:45.899607 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a027dc23-4efe-476e-9a1d-61305df45400 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:45.900665 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a027dc23-4efe-476e-9a1d-61305df45400 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:45.902811 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a027dc23-4efe-476e-9a1d-61305df45400 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:46.039930 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a027dc23-4efe-476e-9a1d-61305df45400 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:46.040717 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a027dc23-4efe-476e-9a1d-61305df45400 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:46.041920 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-a027dc23-4efe-476e-9a1d-61305df45400 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lazy-loading 'fault' on Instance uuid 640b9e84-be9e-4bfd-bf01-e59c74e95a25 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:49:46.141810 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-a027dc23-4efe-476e-9a1d-61305df45400 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b108eef54145a6952e554a69bf97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65fc4fdf92684e2191cb2050849a4a28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:49:46.157222 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a027dc23-4efe-476e-9a1d-61305df45400 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] 10.222.0.46 "GET /compute/v2.1/servers/640b9e84-be9e-4bfd-bf01-e59c74e95a25" status: 200 len: 1295 microversion: 2.1 time: 0.294929 Jul 28 10:49:46.172672 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 623/1270] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:49:45 2022] GET /compute/v2.1/servers/640b9e84-be9e-4bfd-bf01-e59c74e95a25 => generated 1295 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:49:46.183995 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-73a3add5-733e-4043-99f4-57298ba735a8 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:46.184560 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-73a3add5-733e-4043-99f4-57298ba735a8 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 640b9e84-be9e-4bfd-bf01-e59c74e95a25] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:49:46.195755 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-73a3add5-733e-4043-99f4-57298ba735a8 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:46.196923 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-73a3add5-733e-4043-99f4-57298ba735a8 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:46.198275 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-73a3add5-733e-4043-99f4-57298ba735a8 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:46.198895 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-73a3add5-733e-4043-99f4-57298ba735a8 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:46.267289 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-73a3add5-733e-4043-99f4-57298ba735a8 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 640b9e84-be9e-4bfd-bf01-e59c74e95a25] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:49:46.393763 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-73a3add5-733e-4043-99f4-57298ba735a8 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 640b9e84-be9e-4bfd-bf01-e59c74e95a25] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:49:46.394842 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-73a3add5-733e-4043-99f4-57298ba735a8 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:46.401604 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-73a3add5-733e-4043-99f4-57298ba735a8 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:46.402223 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-73a3add5-733e-4043-99f4-57298ba735a8 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 640b9e84-be9e-4bfd-bf01-e59c74e95a25] instance's host None is down, deleting from database Jul 28 10:49:46.415100 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-73a3add5-733e-4043-99f4-57298ba735a8 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 640b9e84-be9e-4bfd-bf01-e59c74e95a25] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:49:46.506708 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-73a3add5-733e-4043-99f4-57298ba735a8 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 640b9e84-be9e-4bfd-bf01-e59c74e95a25] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:49:46.513017 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-73a3add5-733e-4043-99f4-57298ba735a8 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 640b9e84-be9e-4bfd-bf01-e59c74e95a25] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:49:46.832674 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-73a3add5-733e-4043-99f4-57298ba735a8 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] 10.222.0.46 "DELETE /compute/v2.1/servers/640b9e84-be9e-4bfd-bf01-e59c74e95a25" status: 204 len: 0 microversion: 2.1 time: 0.653070 Jul 28 10:49:46.839370 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 648/1271] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:49:46 2022] DELETE /compute/v2.1/servers/640b9e84-be9e-4bfd-bf01-e59c74e95a25 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:49:46.858141 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-48d9a49c-c868-4f26-bda4-4ef69426fc12 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:46.859174 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-48d9a49c-c868-4f26-bda4-4ef69426fc12 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 640b9e84-be9e-4bfd-bf01-e59c74e95a25] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:49:46.876583 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-48d9a49c-c868-4f26-bda4-4ef69426fc12 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:46.877208 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-48d9a49c-c868-4f26-bda4-4ef69426fc12 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:46.877814 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-48d9a49c-c868-4f26-bda4-4ef69426fc12 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:46.898298 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-48d9a49c-c868-4f26-bda4-4ef69426fc12 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:46.950044 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-48d9a49c-c868-4f26-bda4-4ef69426fc12 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] HTTP exception thrown: Instance 640b9e84-be9e-4bfd-bf01-e59c74e95a25 could not be found. Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-48d9a49c-c868-4f26-bda4-4ef69426fc12 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Request method failure captured: Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/640b9e84-be9e-4bfd-bf01-e59c74e95a25 HTTP/1.1 Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mnD5crzMR6YU-nULJ2o_ktiBfdWXDqmsl9VNIUptTo0ql8HzUBfgpKl7lZmTtyikaggnMeMDh4H59oT4NyifaEzwlLGyNKC_Yk7PUDoie5m3Szd_mRaLRdj-iyOd6wM14-ALPGe3wB8bFZVG_Mk5ROi5rN52bwjAKvtL_SQwgf5eoQ Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 65fc4fdf92684e2191cb2050849a4a28 Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-777091699 Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/65fc4fdf92684e2191cb2050849a4a28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/65fc4fdf92684e2191cb2050849a4a28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/65fc4fdf92684e2191cb2050849a4a28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_65fc4fdf92684e2191cb2050849a4a28", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServerRescueNegativeTestJSON-777091699 Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 65fc4fdf92684e2191cb2050849a4a28 Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-777091699 Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServerRescueNegativeTestJSON-777091699-project Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 85b108eef54145a6952e554a69bf97cf Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServerRescueNegativeTestJSON-777091699-project Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 640b9e84-be9e-4bfd-bf01-e59c74e95a25 could not be found. Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '640b9e84-be9e-4bfd-bf01-e59c74e95a25'} Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 640b9e84-be9e-4bfd-bf01-e59c74e95a25 could not be found. Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 640b9e84-be9e-4bfd-bf01-e59c74e95a25 could not be found. Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:49:46.957761 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:49:46.962525 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:46.962525 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:49:46.962525 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:49:46.962525 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:49:46.962525 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:49:46.962525 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 640b9e84-be9e-4bfd-bf01-e59c74e95a25 could not be found. Jul 28 10:49:46.962525 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:49:46.962525 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-48d9a49c-c868-4f26-bda4-4ef69426fc12 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Returning 404 to user: Instance 640b9e84-be9e-4bfd-bf01-e59c74e95a25 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:49:46.963987 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-48d9a49c-c868-4f26-bda4-4ef69426fc12 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] 10.222.0.46 "GET /compute/v2.1/servers/640b9e84-be9e-4bfd-bf01-e59c74e95a25" status: 404 len: 111 microversion: 2.1 time: 0.122971 Jul 28 10:49:46.968700 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 624/1272] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:49:46 2022] GET /compute/v2.1/servers/640b9e84-be9e-4bfd-bf01-e59c74e95a25 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:49:46.976721 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e2280547-2579-4773-897c-25579edebdb4 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:46.981746 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-e2280547-2579-4773-897c-25579edebdb4 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 0c42c410-568b-42ba-b9ad-73748c0d9174] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:49:47.004931 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e2280547-2579-4773-897c-25579edebdb4 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:47.007736 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e2280547-2579-4773-897c-25579edebdb4 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:47.016121 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e2280547-2579-4773-897c-25579edebdb4 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:47.017553 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e2280547-2579-4773-897c-25579edebdb4 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:47.136838 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-e2280547-2579-4773-897c-25579edebdb4 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 0c42c410-568b-42ba-b9ad-73748c0d9174] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:49:47.265373 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-e2280547-2579-4773-897c-25579edebdb4 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 0c42c410-568b-42ba-b9ad-73748c0d9174] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:49:47.266557 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e2280547-2579-4773-897c-25579edebdb4 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:47.267136 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e2280547-2579-4773-897c-25579edebdb4 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:47.267735 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-e2280547-2579-4773-897c-25579edebdb4 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 0c42c410-568b-42ba-b9ad-73748c0d9174] instance's host None is down, deleting from database Jul 28 10:49:47.272537 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-e2280547-2579-4773-897c-25579edebdb4 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 0c42c410-568b-42ba-b9ad-73748c0d9174] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:49:47.328285 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-e2280547-2579-4773-897c-25579edebdb4 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 0c42c410-568b-42ba-b9ad-73748c0d9174] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:49:47.346590 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-e2280547-2579-4773-897c-25579edebdb4 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 0c42c410-568b-42ba-b9ad-73748c0d9174] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:49:47.831510 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e2280547-2579-4773-897c-25579edebdb4 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0c42c410-568b-42ba-b9ad-73748c0d9174" status: 204 len: 0 microversion: 2.1 time: 0.861028 Jul 28 10:49:47.835571 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 649/1273] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:49:46 2022] DELETE /compute/v2.1/servers/0c42c410-568b-42ba-b9ad-73748c0d9174 => generated 0 bytes in 863 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:49:47.841063 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-65909c73-f05f-4b4d-bce2-db9ad0850f67 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:49:47.841850 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-65909c73-f05f-4b4d-bce2-db9ad0850f67 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] [instance: 0c42c410-568b-42ba-b9ad-73748c0d9174] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:49:47.853556 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-65909c73-f05f-4b4d-bce2-db9ad0850f67 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:47.858471 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-65909c73-f05f-4b4d-bce2-db9ad0850f67 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:47.859697 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-65909c73-f05f-4b4d-bce2-db9ad0850f67 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:49:47.866785 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-65909c73-f05f-4b4d-bce2-db9ad0850f67 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:49:47.885903 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-65909c73-f05f-4b4d-bce2-db9ad0850f67 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] HTTP exception thrown: Instance 0c42c410-568b-42ba-b9ad-73748c0d9174 could not be found. Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-65909c73-f05f-4b4d-bce2-db9ad0850f67 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Request method failure captured: Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/0c42c410-568b-42ba-b9ad-73748c0d9174 HTTP/1.1 Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mnD5crzMR6YU-nULJ2o_ktiBfdWXDqmsl9VNIUptTo0ql8HzUBfgpKl7lZmTtyikaggnMeMDh4H59oT4NyifaEzwlLGyNKC_Yk7PUDoie5m3Szd_mRaLRdj-iyOd6wM14-ALPGe3wB8bFZVG_Mk5ROi5rN52bwjAKvtL_SQwgf5eoQ Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 65fc4fdf92684e2191cb2050849a4a28 Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-777091699 Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/65fc4fdf92684e2191cb2050849a4a28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/65fc4fdf92684e2191cb2050849a4a28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/65fc4fdf92684e2191cb2050849a4a28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_65fc4fdf92684e2191cb2050849a4a28", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServerRescueNegativeTestJSON-777091699 Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 65fc4fdf92684e2191cb2050849a4a28 Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-777091699 Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServerRescueNegativeTestJSON-777091699-project Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 85b108eef54145a6952e554a69bf97cf Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServerRescueNegativeTestJSON-777091699-project Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 0c42c410-568b-42ba-b9ad-73748c0d9174 could not be found. Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '0c42c410-568b-42ba-b9ad-73748c0d9174'} Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c42c410-568b-42ba-b9ad-73748c0d9174 could not be found. Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c42c410-568b-42ba-b9ad-73748c0d9174 could not be found. Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:49:47.887940 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:49:47.897448 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:49:47.897448 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:49:47.897448 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:49:47.897448 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:49:47.897448 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:49:47.897448 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c42c410-568b-42ba-b9ad-73748c0d9174 could not be found. Jul 28 10:49:47.897448 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:49:47.899364 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-65909c73-f05f-4b4d-bce2-db9ad0850f67 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Returning 404 to user: Instance 0c42c410-568b-42ba-b9ad-73748c0d9174 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:49:47.902518 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-65909c73-f05f-4b4d-bce2-db9ad0850f67 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] 10.222.0.46 "GET /compute/v2.1/servers/0c42c410-568b-42ba-b9ad-73748c0d9174" status: 404 len: 111 microversion: 2.1 time: 0.065821 Jul 28 10:49:47.903346 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 625/1274] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:49:47 2022] GET /compute/v2.1/servers/0c42c410-568b-42ba-b9ad-73748c0d9174 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:50:02.379254 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e2280547-2579-4773-897c-25579edebdb4 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:50:02.381111 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e2280547-2579-4773-897c-25579edebdb4 tempest-ServerRescueNegativeTestJSON-777091699 tempest-ServerRescueNegativeTestJSON-777091699-project] 10.222.0.46 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002163 Jul 28 10:50:02.382267 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 650/1275] 10.222.0.46 () {56 vars in 886 bytes} [Thu Jul 28 10:50:02 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 28 10:50:06.094100 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-219573636", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1363112004", "security_groups": [{"name": "tempest-secgroup-smoke-614501866"}], "block_device_mapping_v2": [{"uuid": "4803d67f-74ce-4b3e-b9b4-076361f26c3e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "60cc7037-2405-4fb9-943a-b808862d4369"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:50:06.141924 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:50:06.143469 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=12 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:50:06.144389 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=6 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:50:06.147530 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=16 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:50:06.394677 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] validate_networks() for [('60cc7037-2405-4fb9-943a-b808862d4369', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:50:06.603823 n-d-850468-6 devstack@n-api.service[119464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:50:06.604532 n-d-850468-6 devstack@n-api.service[119464]: Thu Jul 28 10:50:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 10:50:07.177014 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:50:07.177559 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:50:07.178178 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:50:07.178693 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:50:07.179309 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:50:07.196426 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:50:07.196876 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:50:07.199749 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:50:07.200205 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:50:07.265722 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Getting quotas for project a8209f1d63904867a0c74297c01a12c0. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:50:07.286209 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Getting quotas for user f4c9167954974c6a8908f2d61cb9aa5a and project a8209f1d63904867a0c74297c01a12c0. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:50:07.449638 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:50:07.453486 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: d0bcebca-fa12-4fb9-8a90-2856f9054216] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4803d67f-74ce-4b3e-b9b4-076361f26c3e',volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:50:07.779820 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3adfed6a-8422-473b-9b64-0f539e25befb tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.690985 Jul 28 10:50:07.788725 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:50:07.790644 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:50:07.791446 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=48,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:50:07.796426 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6ef31fc1-cc2b-41b4-8358-6550f5498bf7 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:50:07.797393 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-6ef31fc1-cc2b-41b4-8358-6550f5498bf7 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: d0bcebca-fa12-4fb9-8a90-2856f9054216] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:50:07.800384 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 626/1276] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:50:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:50:08.007136 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-6ef31fc1-cc2b-41b4-8358-6550f5498bf7 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c9167954974c6a8908f2d61cb9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8209f1d63904867a0c74297c01a12c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:50:08.014905 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-6ef31fc1-cc2b-41b4-8358-6550f5498bf7 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "GET /compute/v2.1/servers/d0bcebca-fa12-4fb9-8a90-2856f9054216" status: 200 len: 1094 microversion: 2.1 time: 0.226851 Jul 28 10:50:08.015502 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 651/1277] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:50:07 2022] GET /compute/v2.1/servers/d0bcebca-fa12-4fb9-8a90-2856f9054216 => generated 1094 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:50:08.589277 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ccec4e78-c34b-43a5-8e82-9e3e07e0104f tempest-ComputeTenantNetworksTest-1571589938 tempest-ComputeTenantNetworksTest-1571589938-project] Calling method '.version_select at 0x7fa94b7f38b0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:50:08.913522 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ccec4e78-c34b-43a5-8e82-9e3e07e0104f tempest-ComputeTenantNetworksTest-1571589938 tempest-ComputeTenantNetworksTest-1571589938-project] 10.222.0.46 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.961962 Jul 28 10:50:08.914775 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 627/1278] 10.222.0.46 () {58 vars in 1158 bytes} [Thu Jul 28 10:50:07 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:50:08.925999 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c13e90af-8b60-459f-916c-f163cc710ef7 tempest-ComputeTenantNetworksTest-1571589938 tempest-ComputeTenantNetworksTest-1571589938-project] Calling method '.version_select at 0x7fa94b6033a0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:50:09.043160 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2d3e8b38-d82a-456e-9ac4-32766ed188a2 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:50:09.044821 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-2d3e8b38-d82a-456e-9ac4-32766ed188a2 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: d0bcebca-fa12-4fb9-8a90-2856f9054216] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:50:09.070649 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2d3e8b38-d82a-456e-9ac4-32766ed188a2 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:50:09.071106 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2d3e8b38-d82a-456e-9ac4-32766ed188a2 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:50:09.072009 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2d3e8b38-d82a-456e-9ac4-32766ed188a2 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:50:09.072579 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2d3e8b38-d82a-456e-9ac4-32766ed188a2 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:50:09.142988 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2d3e8b38-d82a-456e-9ac4-32766ed188a2 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:50:09.143516 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2d3e8b38-d82a-456e-9ac4-32766ed188a2 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:50:09.155554 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-2d3e8b38-d82a-456e-9ac4-32766ed188a2 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lazy-loading 'fault' on Instance uuid d0bcebca-fa12-4fb9-8a90-2856f9054216 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:50:09.188816 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c13e90af-8b60-459f-916c-f163cc710ef7 tempest-ComputeTenantNetworksTest-1571589938 tempest-ComputeTenantNetworksTest-1571589938-project] 10.222.0.46 "GET /compute/v2.1/os-tenant-networks/3f0be291-645b-49c8-86b8-bf443592bbdb" status: 200 len: 139 microversion: 2.1 time: 0.267050 Jul 28 10:50:09.189728 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 652/1279] 10.222.0.46 () {58 vars in 1269 bytes} [Thu Jul 28 10:50:08 2022] GET /compute/v2.1/os-tenant-networks/3f0be291-645b-49c8-86b8-bf443592bbdb => generated 139 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:50:09.273251 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-2d3e8b38-d82a-456e-9ac4-32766ed188a2 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c9167954974c6a8908f2d61cb9aa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8209f1d63904867a0c74297c01a12c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:50:09.299014 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-2d3e8b38-d82a-456e-9ac4-32766ed188a2 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "GET /compute/v2.1/servers/d0bcebca-fa12-4fb9-8a90-2856f9054216" status: 200 len: 1213 microversion: 2.1 time: 0.262116 Jul 28 10:50:09.322180 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ffb454ce-5f4b-42c3-a93e-4f2efe4b2fca tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:50:09.322881 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ffb454ce-5f4b-42c3-a93e-4f2efe4b2fca tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: d0bcebca-fa12-4fb9-8a90-2856f9054216] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:50:09.328254 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 628/1280] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:50:09 2022] GET /compute/v2.1/servers/d0bcebca-fa12-4fb9-8a90-2856f9054216 => generated 1213 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:50:09.332100 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ffb454ce-5f4b-42c3-a93e-4f2efe4b2fca tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:50:09.332785 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ffb454ce-5f4b-42c3-a93e-4f2efe4b2fca tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:50:09.333773 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ffb454ce-5f4b-42c3-a93e-4f2efe4b2fca tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:50:09.334534 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ffb454ce-5f4b-42c3-a93e-4f2efe4b2fca tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:50:09.371105 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ffb454ce-5f4b-42c3-a93e-4f2efe4b2fca tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: d0bcebca-fa12-4fb9-8a90-2856f9054216] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:50:09.452801 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ffb454ce-5f4b-42c3-a93e-4f2efe4b2fca tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: d0bcebca-fa12-4fb9-8a90-2856f9054216] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:50:09.455072 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ffb454ce-5f4b-42c3-a93e-4f2efe4b2fca tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:50:09.457739 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ffb454ce-5f4b-42c3-a93e-4f2efe4b2fca tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:50:09.459328 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-ffb454ce-5f4b-42c3-a93e-4f2efe4b2fca tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: d0bcebca-fa12-4fb9-8a90-2856f9054216] instance's host None is down, deleting from database Jul 28 10:50:09.475600 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-ffb454ce-5f4b-42c3-a93e-4f2efe4b2fca tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: d0bcebca-fa12-4fb9-8a90-2856f9054216] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:50:09.642857 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-ffb454ce-5f4b-42c3-a93e-4f2efe4b2fca tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: d0bcebca-fa12-4fb9-8a90-2856f9054216] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:50:09.656753 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-ffb454ce-5f4b-42c3-a93e-4f2efe4b2fca tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: d0bcebca-fa12-4fb9-8a90-2856f9054216] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:50:10.489352 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ffb454ce-5f4b-42c3-a93e-4f2efe4b2fca tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d0bcebca-fa12-4fb9-8a90-2856f9054216" status: 204 len: 0 microversion: 2.1 time: 1.169708 Jul 28 10:50:10.490653 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 653/1281] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:50:09 2022] DELETE /compute/v2.1/servers/d0bcebca-fa12-4fb9-8a90-2856f9054216 => generated 0 bytes in 1172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:50:10.500030 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-01fac629-cb4e-491a-946d-3d530c8ca8e0 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:50:10.500773 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-01fac629-cb4e-491a-946d-3d530c8ca8e0 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] [instance: d0bcebca-fa12-4fb9-8a90-2856f9054216] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:50:10.542584 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-01fac629-cb4e-491a-946d-3d530c8ca8e0 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:50:10.544806 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-01fac629-cb4e-491a-946d-3d530c8ca8e0 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:50:10.550444 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-01fac629-cb4e-491a-946d-3d530c8ca8e0 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:50:10.561485 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-01fac629-cb4e-491a-946d-3d530c8ca8e0 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:50:10.602876 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-01fac629-cb4e-491a-946d-3d530c8ca8e0 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] HTTP exception thrown: Instance d0bcebca-fa12-4fb9-8a90-2856f9054216 could not be found. Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-01fac629-cb4e-491a-946d-3d530c8ca8e0 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Request method failure captured: Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/d0bcebca-fa12-4fb9-8a90-2856f9054216 HTTP/1.1 Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mjyC3fTgoib6gZ84Pzs1H0WGFzATjUZ993aaue2Om9orB7eK_fh9xiT4QMXZtT_KdLk0bsSNDQzKKAyoUEc6o6yLbTk9llZb_KxyvKyz2vFLNpc9kR6zacAg0s1EIVfbjXWrGIUbmS0Sj7SellzyWHpCpymlLe7ycorAaxmUez9kZM Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: a8209f1d63904867a0c74297c01a12c0 Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-TestVolumeBootPattern-148227680 Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a8209f1d63904867a0c74297c01a12c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a8209f1d63904867a0c74297c01a12c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a8209f1d63904867a0c74297c01a12c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a8209f1d63904867a0c74297c01a12c0", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-TestVolumeBootPattern-148227680 Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: a8209f1d63904867a0c74297c01a12c0 Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-TestVolumeBootPattern-148227680 Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-TestVolumeBootPattern-148227680-project Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: f4c9167954974c6a8908f2d61cb9aa5a Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-TestVolumeBootPattern-148227680-project Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance d0bcebca-fa12-4fb9-8a90-2856f9054216 could not be found. Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'd0bcebca-fa12-4fb9-8a90-2856f9054216'} Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0bcebca-fa12-4fb9-8a90-2856f9054216 could not be found. Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0bcebca-fa12-4fb9-8a90-2856f9054216 could not be found. Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:50:10.604710 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:50:10.610478 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:50:10.610478 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:50:10.610478 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:50:10.610478 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:50:10.610478 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:50:10.610478 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0bcebca-fa12-4fb9-8a90-2856f9054216 could not be found. Jul 28 10:50:10.610478 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:50:10.612270 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-01fac629-cb4e-491a-946d-3d530c8ca8e0 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Returning 404 to user: Instance d0bcebca-fa12-4fb9-8a90-2856f9054216 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:50:10.613363 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-01fac629-cb4e-491a-946d-3d530c8ca8e0 tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "GET /compute/v2.1/servers/d0bcebca-fa12-4fb9-8a90-2856f9054216" status: 404 len: 111 microversion: 2.1 time: 0.119259 Jul 28 10:50:10.638435 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 629/1282] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:50:10 2022] GET /compute/v2.1/servers/d0bcebca-fa12-4fb9-8a90-2856f9054216 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:50:18.051571 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7c60c5df-f4e1-4a2a-8a17-986da17720ff tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] Calling method '.version_select at 0x7fa94b603040>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:50:18.066455 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:50:18.105773 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7c60c5df-f4e1-4a2a-8a17-986da17720ff tempest-TestVolumeBootPattern-148227680 tempest-TestVolumeBootPattern-148227680-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1363112004" status: 202 len: 0 microversion: 2.1 time: 0.064442 Jul 28 10:50:18.110452 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 654/1283] 10.222.0.46 () {58 vars in 1263 bytes} [Thu Jul 28 10:50:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1363112004 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:51:10.643681 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-529141064", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "d4b63012-3588-495e-88d6-d3e8599e6e7c"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:51:10.659320 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:10.661141 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=6 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:10.662113 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:10.662880 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=12 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:11.331179 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] validate_networks() for [('d4b63012-3588-495e-88d6-d3e8599e6e7c', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:51:12.582342 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:51:12.585829 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:51:12.586688 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:51:12.587306 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:51:12.587928 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:51:12.621582 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:12.624878 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:12.626829 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:12.635269 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:12.700303 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Getting quotas for project 4a7e2a98d353473da7a4706dc48f8798. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:51:12.712980 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Getting quotas for user f167f1e09ac54e5696ad6402f2af816e and project 4a7e2a98d353473da7a4706dc48f8798. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:51:12.748764 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:51:12.755377 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: a1ee9e37-b4ed-42e5-b024-37609db5817e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:51:12.906797 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a1f925c2-1e8d-4fdf-b319-5ece426c9a09 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.271134 Jul 28 10:51:12.923524 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 630/1284] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:51:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2289 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:51:12.939563 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-cc6f76ab-0776-4fad-a6e5-9ce04b1ecf16 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:12.940872 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-cc6f76ab-0776-4fad-a6e5-9ce04b1ecf16 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: a1ee9e37-b4ed-42e5-b024-37609db5817e] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:51:12.971251 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:12.975321 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:13.749354 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-cc6f76ab-0776-4fad-a6e5-9ce04b1ecf16 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f167f1e09ac54e5696ad6402f2af816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e2a98d353473da7a4706dc48f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:51:13.770727 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-cc6f76ab-0776-4fad-a6e5-9ce04b1ecf16 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] 10.222.0.46 "GET /compute/v2.1/servers/a1ee9e37-b4ed-42e5-b024-37609db5817e" status: 200 len: 1218 microversion: 2.1 time: 0.836610 Jul 28 10:51:13.774273 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 655/1285] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:51:12 2022] GET /compute/v2.1/servers/a1ee9e37-b4ed-42e5-b024-37609db5817e => generated 1218 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:51:14.797221 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5d7bdb24-64a6-49b2-87b1-9b1404ac29ea tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:14.798849 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-5d7bdb24-64a6-49b2-87b1-9b1404ac29ea tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: a1ee9e37-b4ed-42e5-b024-37609db5817e] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:51:14.823651 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5d7bdb24-64a6-49b2-87b1-9b1404ac29ea tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:14.825666 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5d7bdb24-64a6-49b2-87b1-9b1404ac29ea tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:14.834356 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5d7bdb24-64a6-49b2-87b1-9b1404ac29ea tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:14.838234 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5d7bdb24-64a6-49b2-87b1-9b1404ac29ea tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:14.959848 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5d7bdb24-64a6-49b2-87b1-9b1404ac29ea tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:14.960444 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5d7bdb24-64a6-49b2-87b1-9b1404ac29ea tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:14.961036 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-5d7bdb24-64a6-49b2-87b1-9b1404ac29ea tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lazy-loading 'fault' on Instance uuid a1ee9e37-b4ed-42e5-b024-37609db5817e {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:51:15.066178 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-5d7bdb24-64a6-49b2-87b1-9b1404ac29ea tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f167f1e09ac54e5696ad6402f2af816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e2a98d353473da7a4706dc48f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:51:15.079749 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-5d7bdb24-64a6-49b2-87b1-9b1404ac29ea tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] 10.222.0.46 "GET /compute/v2.1/servers/a1ee9e37-b4ed-42e5-b024-37609db5817e" status: 200 len: 1291 microversion: 2.1 time: 0.287575 Jul 28 10:51:15.080884 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 631/1286] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:51:14 2022] GET /compute/v2.1/servers/a1ee9e37-b4ed-42e5-b024-37609db5817e => generated 1291 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:51:15.107658 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-46203f24-de73-4d47-9a40-1363354e5e11 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:15.109298 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-46203f24-de73-4d47-9a40-1363354e5e11 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: a1ee9e37-b4ed-42e5-b024-37609db5817e] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:51:15.123015 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-46203f24-de73-4d47-9a40-1363354e5e11 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:15.123780 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-46203f24-de73-4d47-9a40-1363354e5e11 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:15.124790 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-46203f24-de73-4d47-9a40-1363354e5e11 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:15.125478 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-46203f24-de73-4d47-9a40-1363354e5e11 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:15.170101 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-46203f24-de73-4d47-9a40-1363354e5e11 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: a1ee9e37-b4ed-42e5-b024-37609db5817e] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:51:15.298454 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-46203f24-de73-4d47-9a40-1363354e5e11 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: a1ee9e37-b4ed-42e5-b024-37609db5817e] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:51:15.300441 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-46203f24-de73-4d47-9a40-1363354e5e11 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:15.300911 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-46203f24-de73-4d47-9a40-1363354e5e11 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:15.302045 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-46203f24-de73-4d47-9a40-1363354e5e11 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: a1ee9e37-b4ed-42e5-b024-37609db5817e] instance's host None is down, deleting from database Jul 28 10:51:15.306796 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-46203f24-de73-4d47-9a40-1363354e5e11 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: a1ee9e37-b4ed-42e5-b024-37609db5817e] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:51:15.905610 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-46203f24-de73-4d47-9a40-1363354e5e11 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: a1ee9e37-b4ed-42e5-b024-37609db5817e] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:51:15.912825 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-46203f24-de73-4d47-9a40-1363354e5e11 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: a1ee9e37-b4ed-42e5-b024-37609db5817e] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:51:16.234485 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-46203f24-de73-4d47-9a40-1363354e5e11 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a1ee9e37-b4ed-42e5-b024-37609db5817e" status: 204 len: 0 microversion: 2.1 time: 1.134909 Jul 28 10:51:16.238524 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 656/1287] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:51:15 2022] DELETE /compute/v2.1/servers/a1ee9e37-b4ed-42e5-b024-37609db5817e => generated 0 bytes in 1142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:51:16.258201 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0c9dad7a-1aea-4e20-8ead-d5c8701afbfd tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:16.259807 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-0c9dad7a-1aea-4e20-8ead-d5c8701afbfd tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: a1ee9e37-b4ed-42e5-b024-37609db5817e] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:51:16.282655 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0c9dad7a-1aea-4e20-8ead-d5c8701afbfd tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:16.283128 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0c9dad7a-1aea-4e20-8ead-d5c8701afbfd tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:16.285381 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0c9dad7a-1aea-4e20-8ead-d5c8701afbfd tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:16.286149 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0c9dad7a-1aea-4e20-8ead-d5c8701afbfd tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:16.337366 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-0c9dad7a-1aea-4e20-8ead-d5c8701afbfd tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] HTTP exception thrown: Instance a1ee9e37-b4ed-42e5-b024-37609db5817e could not be found. Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0c9dad7a-1aea-4e20-8ead-d5c8701afbfd tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Request method failure captured: Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/a1ee9e37-b4ed-42e5-b024-37609db5817e HTTP/1.1 Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mmY73jwRA_8Cw6k_ReyQ34SiurVRByKxLZSFxAI0fqUMrK2jZkbdLcc68I7apm6NNN89HmVdtgTcMxc6B84jqbKY0MV0V-v9YLOYY9YUvpkvKZ8l4JQwdmqxqe853dMVerqU9UBVSVa1XhnpDp36TX5M5jpiRw53ptELjtiatUxvK0 Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 4a7e2a98d353473da7a4706dc48f8798 Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-VolumesSnapshotTestJSON-554729903 Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4a7e2a98d353473da7a4706dc48f8798"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4a7e2a98d353473da7a4706dc48f8798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4a7e2a98d353473da7a4706dc48f8798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4a7e2a98d353473da7a4706dc48f8798", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-VolumesSnapshotTestJSON-554729903 Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 4a7e2a98d353473da7a4706dc48f8798 Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-554729903 Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-VolumesSnapshotTestJSON-554729903-project Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: f167f1e09ac54e5696ad6402f2af816e Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-VolumesSnapshotTestJSON-554729903-project Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance a1ee9e37-b4ed-42e5-b024-37609db5817e could not be found. Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'a1ee9e37-b4ed-42e5-b024-37609db5817e'} Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1ee9e37-b4ed-42e5-b024-37609db5817e could not be found. Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1ee9e37-b4ed-42e5-b024-37609db5817e could not be found. Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:51:16.340793 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:51:16.344865 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:51:16.344865 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:51:16.344865 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:51:16.344865 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:51:16.344865 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:51:16.344865 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1ee9e37-b4ed-42e5-b024-37609db5817e could not be found. Jul 28 10:51:16.344865 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:51:16.344865 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0c9dad7a-1aea-4e20-8ead-d5c8701afbfd tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Returning 404 to user: Instance a1ee9e37-b4ed-42e5-b024-37609db5817e could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:51:16.350664 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-0c9dad7a-1aea-4e20-8ead-d5c8701afbfd tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] 10.222.0.46 "GET /compute/v2.1/servers/a1ee9e37-b4ed-42e5-b024-37609db5817e" status: 404 len: 111 microversion: 2.1 time: 0.107009 Jul 28 10:51:16.351495 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 632/1288] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:51:16 2022] GET /compute/v2.1/servers/a1ee9e37-b4ed-42e5-b024-37609db5817e => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:51:28.572359 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:28.573381 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:28.574131 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:28.578996 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-765601680", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "d4b63012-3588-495e-88d6-d3e8599e6e7c"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:51:28.703468 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] validate_networks() for [('d4b63012-3588-495e-88d6-d3e8599e6e7c', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:51:30.094024 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:51:30.095066 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:51:30.095727 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:51:30.096298 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:51:30.096868 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:51:30.111598 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:30.116320 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:30.117302 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:30.117945 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:30.157268 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Getting quotas for project 4a7e2a98d353473da7a4706dc48f8798. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:51:30.171401 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Getting quotas for user f167f1e09ac54e5696ad6402f2af816e and project 4a7e2a98d353473da7a4706dc48f8798. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:51:30.204261 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:51:30.206784 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: d347836e-361a-4019-8912-a17093afc91b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:51:30.313527 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ff1566c9-5bce-4545-b423-e4f65333e6d3 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.741848 Jul 28 10:51:30.327714 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 657/1289] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:51:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:51:30.334596 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-73713f5f-e325-4324-8c7d-146e3b10d943 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:30.335311 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-73713f5f-e325-4324-8c7d-146e3b10d943 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: d347836e-361a-4019-8912-a17093afc91b] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:51:30.340321 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:30.341038 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=6 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:30.374575 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:30.378223 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=12 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:30.653365 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-73713f5f-e325-4324-8c7d-146e3b10d943 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f167f1e09ac54e5696ad6402f2af816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e2a98d353473da7a4706dc48f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:51:30.660884 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-73713f5f-e325-4324-8c7d-146e3b10d943 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] 10.222.0.46 "GET /compute/v2.1/servers/d347836e-361a-4019-8912-a17093afc91b" status: 200 len: 1218 microversion: 2.1 time: 0.331855 Jul 28 10:51:30.667430 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 633/1290] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:51:30 2022] GET /compute/v2.1/servers/d347836e-361a-4019-8912-a17093afc91b => generated 1218 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:51:31.691662 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5ecd0b37-a88c-4394-b9e7-ef2eac1b1c18 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:31.692461 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5ecd0b37-a88c-4394-b9e7-ef2eac1b1c18 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: d347836e-361a-4019-8912-a17093afc91b] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:51:31.699649 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5ecd0b37-a88c-4394-b9e7-ef2eac1b1c18 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:31.715162 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5ecd0b37-a88c-4394-b9e7-ef2eac1b1c18 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:31.721816 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5ecd0b37-a88c-4394-b9e7-ef2eac1b1c18 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:31.722289 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5ecd0b37-a88c-4394-b9e7-ef2eac1b1c18 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:31.854996 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5ecd0b37-a88c-4394-b9e7-ef2eac1b1c18 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:31.855516 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5ecd0b37-a88c-4394-b9e7-ef2eac1b1c18 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:31.855995 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-5ecd0b37-a88c-4394-b9e7-ef2eac1b1c18 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lazy-loading 'fault' on Instance uuid d347836e-361a-4019-8912-a17093afc91b {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:51:31.990607 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-5ecd0b37-a88c-4394-b9e7-ef2eac1b1c18 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f167f1e09ac54e5696ad6402f2af816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e2a98d353473da7a4706dc48f8798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:51:31.998334 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-5ecd0b37-a88c-4394-b9e7-ef2eac1b1c18 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] 10.222.0.46 "GET /compute/v2.1/servers/d347836e-361a-4019-8912-a17093afc91b" status: 200 len: 1291 microversion: 2.1 time: 0.311374 Jul 28 10:51:31.998925 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 658/1291] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:51:31 2022] GET /compute/v2.1/servers/d347836e-361a-4019-8912-a17093afc91b => generated 1291 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:51:32.026422 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-68535588-a311-43a2-8981-4f96b48fc81f tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:32.026986 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-68535588-a311-43a2-8981-4f96b48fc81f tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: d347836e-361a-4019-8912-a17093afc91b] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:51:32.039854 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-68535588-a311-43a2-8981-4f96b48fc81f tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:32.040318 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-68535588-a311-43a2-8981-4f96b48fc81f tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:32.056570 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-68535588-a311-43a2-8981-4f96b48fc81f tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:32.059123 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-68535588-a311-43a2-8981-4f96b48fc81f tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:32.204942 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-68535588-a311-43a2-8981-4f96b48fc81f tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: d347836e-361a-4019-8912-a17093afc91b] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:51:32.301058 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-68535588-a311-43a2-8981-4f96b48fc81f tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: d347836e-361a-4019-8912-a17093afc91b] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:51:32.302337 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-68535588-a311-43a2-8981-4f96b48fc81f tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:32.303125 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-68535588-a311-43a2-8981-4f96b48fc81f tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:32.303858 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-68535588-a311-43a2-8981-4f96b48fc81f tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: d347836e-361a-4019-8912-a17093afc91b] instance's host None is down, deleting from database Jul 28 10:51:32.307756 n-d-850468-6 devstack@n-api.service[119463]: ERROR oslo.messaging._drivers.impl_rabbit [None req-68535588-a311-43a2-8981-4f96b48fc81f tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [48b1d3b3-5eca-466a-9d9b-d9a821be2de5] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 10:51:33.217140 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-943369478", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "bcbaa112-6986-4cb8-b479-7b414e4135a1"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:51:33.277179 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] validate_networks() for [('bcbaa112-6986-4cb8-b479-7b414e4135a1', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:51:33.316021 n-d-850468-6 devstack@n-api.service[119463]: INFO oslo.messaging._drivers.impl_rabbit [None req-68535588-a311-43a2-8981-4f96b48fc81f tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [48b1d3b3-5eca-466a-9d9b-d9a821be2de5] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 45310. Jul 28 10:51:33.321980 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-68535588-a311-43a2-8981-4f96b48fc81f tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: d347836e-361a-4019-8912-a17093afc91b] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:51:33.529051 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-68535588-a311-43a2-8981-4f96b48fc81f tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: d347836e-361a-4019-8912-a17093afc91b] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:51:33.538569 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-68535588-a311-43a2-8981-4f96b48fc81f tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: d347836e-361a-4019-8912-a17093afc91b] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:51:34.287248 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:51:34.287728 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:51:34.288196 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:51:34.288607 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:51:34.289020 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:51:34.307259 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:34.307749 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:34.309833 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:34.313460 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:34.352160 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Getting quotas for project cab6813553674335bb5bcc780ddb0b6a. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:51:34.360964 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-68535588-a311-43a2-8981-4f96b48fc81f tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d347836e-361a-4019-8912-a17093afc91b" status: 204 len: 0 microversion: 2.1 time: 2.339159 Jul 28 10:51:34.366996 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 634/1292] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:51:32 2022] DELETE /compute/v2.1/servers/d347836e-361a-4019-8912-a17093afc91b => generated 0 bytes in 2343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:51:34.367217 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Getting quotas for user 7542fb7a6ebc4ec8a8bcca7400d4d32a and project cab6813553674335bb5bcc780ddb0b6a. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:51:34.373112 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7cab114e-887a-44de-ad96-b83a9eb43944 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:34.373725 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-7cab114e-887a-44de-ad96-b83a9eb43944 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] [instance: d347836e-361a-4019-8912-a17093afc91b] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:51:34.387102 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7cab114e-887a-44de-ad96-b83a9eb43944 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:34.388194 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7cab114e-887a-44de-ad96-b83a9eb43944 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:34.388993 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7cab114e-887a-44de-ad96-b83a9eb43944 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:34.389435 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7cab114e-887a-44de-ad96-b83a9eb43944 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:34.401647 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:51:34.403924 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 9caa358e-04da-4040-8c13-0e38157cecd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:51:34.423674 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-7cab114e-887a-44de-ad96-b83a9eb43944 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] HTTP exception thrown: Instance d347836e-361a-4019-8912-a17093afc91b could not be found. Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7cab114e-887a-44de-ad96-b83a9eb43944 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Request method failure captured: Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/d347836e-361a-4019-8912-a17093afc91b HTTP/1.1 Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mmY73jwRA_8Cw6k_ReyQ34SiurVRByKxLZSFxAI0fqUMrK2jZkbdLcc68I7apm6NNN89HmVdtgTcMxc6B84jqbKY0MV0V-v9YLOYY9YUvpkvKZ8l4JQwdmqxqe853dMVerqU9UBVSVa1XhnpDp36TX5M5jpiRw53ptELjtiatUxvK0 Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 4a7e2a98d353473da7a4706dc48f8798 Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-VolumesSnapshotTestJSON-554729903 Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4a7e2a98d353473da7a4706dc48f8798"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4a7e2a98d353473da7a4706dc48f8798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4a7e2a98d353473da7a4706dc48f8798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4a7e2a98d353473da7a4706dc48f8798", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-VolumesSnapshotTestJSON-554729903 Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 4a7e2a98d353473da7a4706dc48f8798 Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-554729903 Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-VolumesSnapshotTestJSON-554729903-project Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: f167f1e09ac54e5696ad6402f2af816e Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-VolumesSnapshotTestJSON-554729903-project Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance d347836e-361a-4019-8912-a17093afc91b could not be found. Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'd347836e-361a-4019-8912-a17093afc91b'} Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d347836e-361a-4019-8912-a17093afc91b could not be found. Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d347836e-361a-4019-8912-a17093afc91b could not be found. Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:51:34.433714 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:51:34.437762 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:51:34.437762 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:51:34.437762 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:51:34.437762 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:51:34.437762 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:51:34.437762 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d347836e-361a-4019-8912-a17093afc91b could not be found. Jul 28 10:51:34.437762 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:51:34.440089 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7cab114e-887a-44de-ad96-b83a9eb43944 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] Returning 404 to user: Instance d347836e-361a-4019-8912-a17093afc91b could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:51:34.441161 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-7cab114e-887a-44de-ad96-b83a9eb43944 tempest-VolumesSnapshotTestJSON-554729903 tempest-VolumesSnapshotTestJSON-554729903-project] 10.222.0.46 "GET /compute/v2.1/servers/d347836e-361a-4019-8912-a17093afc91b" status: 404 len: 111 microversion: 2.1 time: 0.072971 Jul 28 10:51:34.442265 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 635/1293] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:51:34 2022] GET /compute/v2.1/servers/d347836e-361a-4019-8912-a17093afc91b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:51:34.550865 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-d11eae90-a976-492e-a58d-56cb025d6c0e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.343811 Jul 28 10:51:34.552857 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 659/1294] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:51:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:51:34.565320 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6ae99864-1196-425c-9d1a-b51f42443844 tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:34.566067 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-6ae99864-1196-425c-9d1a-b51f42443844 tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 9caa358e-04da-4040-8c13-0e38157cecd0] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:51:34.692944 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-6ae99864-1196-425c-9d1a-b51f42443844 tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7542fb7a6ebc4ec8a8bcca7400d4d32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab6813553674335bb5bcc780ddb0b6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:51:34.714348 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6ae99864-1196-425c-9d1a-b51f42443844 tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] 10.222.0.46 "GET /compute/v2.1/servers/9caa358e-04da-4040-8c13-0e38157cecd0" status: 200 len: 1213 microversion: 2.1 time: 0.145740 Jul 28 10:51:34.715007 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 636/1295] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:51:34 2022] GET /compute/v2.1/servers/9caa358e-04da-4040-8c13-0e38157cecd0 => generated 1213 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:51:35.738198 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7ea9538a-bddc-424b-994f-718c36f6b68f tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:35.738663 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-7ea9538a-bddc-424b-994f-718c36f6b68f tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 9caa358e-04da-4040-8c13-0e38157cecd0] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:51:35.751947 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7ea9538a-bddc-424b-994f-718c36f6b68f tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:35.752417 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7ea9538a-bddc-424b-994f-718c36f6b68f tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:35.756775 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7ea9538a-bddc-424b-994f-718c36f6b68f tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:35.757244 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7ea9538a-bddc-424b-994f-718c36f6b68f tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:35.860629 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7ea9538a-bddc-424b-994f-718c36f6b68f tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:35.863015 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7ea9538a-bddc-424b-994f-718c36f6b68f tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:35.865851 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-7ea9538a-bddc-424b-994f-718c36f6b68f tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lazy-loading 'fault' on Instance uuid 9caa358e-04da-4040-8c13-0e38157cecd0 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:51:36.077342 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-7ea9538a-bddc-424b-994f-718c36f6b68f tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7542fb7a6ebc4ec8a8bcca7400d4d32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab6813553674335bb5bcc780ddb0b6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:51:36.092575 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7ea9538a-bddc-424b-994f-718c36f6b68f tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] 10.222.0.46 "GET /compute/v2.1/servers/9caa358e-04da-4040-8c13-0e38157cecd0" status: 200 len: 1286 microversion: 2.1 time: 0.358571 Jul 28 10:51:36.111779 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 660/1296] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:51:35 2022] GET /compute/v2.1/servers/9caa358e-04da-4040-8c13-0e38157cecd0 => generated 1286 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:51:36.133700 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-77a2dbde-7c2d-4690-856f-ed4246b0236d tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:36.139492 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-77a2dbde-7c2d-4690-856f-ed4246b0236d tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 9caa358e-04da-4040-8c13-0e38157cecd0] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:51:36.209888 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-77a2dbde-7c2d-4690-856f-ed4246b0236d tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:36.210648 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-77a2dbde-7c2d-4690-856f-ed4246b0236d tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:36.218580 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-77a2dbde-7c2d-4690-856f-ed4246b0236d tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:36.223975 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-77a2dbde-7c2d-4690-856f-ed4246b0236d tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:36.331846 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-77a2dbde-7c2d-4690-856f-ed4246b0236d tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 9caa358e-04da-4040-8c13-0e38157cecd0] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:51:36.454016 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-77a2dbde-7c2d-4690-856f-ed4246b0236d tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 9caa358e-04da-4040-8c13-0e38157cecd0] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:51:36.454366 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-77a2dbde-7c2d-4690-856f-ed4246b0236d tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:36.455501 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-77a2dbde-7c2d-4690-856f-ed4246b0236d tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:36.455501 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-77a2dbde-7c2d-4690-856f-ed4246b0236d tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 9caa358e-04da-4040-8c13-0e38157cecd0] instance's host None is down, deleting from database Jul 28 10:51:36.460366 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-77a2dbde-7c2d-4690-856f-ed4246b0236d tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 9caa358e-04da-4040-8c13-0e38157cecd0] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:51:36.525927 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-77a2dbde-7c2d-4690-856f-ed4246b0236d tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 9caa358e-04da-4040-8c13-0e38157cecd0] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:51:36.534805 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-77a2dbde-7c2d-4690-856f-ed4246b0236d tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 9caa358e-04da-4040-8c13-0e38157cecd0] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:51:36.829498 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-77a2dbde-7c2d-4690-856f-ed4246b0236d tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9caa358e-04da-4040-8c13-0e38157cecd0" status: 204 len: 0 microversion: 2.1 time: 0.709920 Jul 28 10:51:36.836566 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 637/1297] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:51:36 2022] DELETE /compute/v2.1/servers/9caa358e-04da-4040-8c13-0e38157cecd0 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:51:36.841834 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-45e4cf7d-8d3a-482b-b722-8a99da6abdec tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:36.843047 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-45e4cf7d-8d3a-482b-b722-8a99da6abdec tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 9caa358e-04da-4040-8c13-0e38157cecd0] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:51:36.853027 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-45e4cf7d-8d3a-482b-b722-8a99da6abdec tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:36.854525 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-45e4cf7d-8d3a-482b-b722-8a99da6abdec tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:36.858868 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-45e4cf7d-8d3a-482b-b722-8a99da6abdec tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:36.859452 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-45e4cf7d-8d3a-482b-b722-8a99da6abdec tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:36.896465 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-45e4cf7d-8d3a-482b-b722-8a99da6abdec tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] HTTP exception thrown: Instance 9caa358e-04da-4040-8c13-0e38157cecd0 could not be found. Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-45e4cf7d-8d3a-482b-b722-8a99da6abdec tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Request method failure captured: Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/9caa358e-04da-4040-8c13-0e38157cecd0 HTTP/1.1 Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mowfi2fTkjvHQ6wIfNvZjzJNPuHf4w7R7UXOU_k-INSkbMsarn69RnJjuRsFqSV7zVkALqvNMMtW1XYVKb5zAA7IVlbKuHiOTkisiFAeiTKBmDWx2uIHlUa9wuq7Y44ReUV70_MD2TXPEImXE0OioC0B4HcWNqmK0-UVIy7lHaYft4 Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: cab6813553674335bb5bcc780ddb0b6a Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-VolumesActionsTest-509784763 Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cab6813553674335bb5bcc780ddb0b6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cab6813553674335bb5bcc780ddb0b6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cab6813553674335bb5bcc780ddb0b6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cab6813553674335bb5bcc780ddb0b6a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-VolumesActionsTest-509784763 Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: cab6813553674335bb5bcc780ddb0b6a Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-VolumesActionsTest-509784763 Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-VolumesActionsTest-509784763-project Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 7542fb7a6ebc4ec8a8bcca7400d4d32a Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-VolumesActionsTest-509784763-project Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 9caa358e-04da-4040-8c13-0e38157cecd0 could not be found. Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '9caa358e-04da-4040-8c13-0e38157cecd0'} Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9caa358e-04da-4040-8c13-0e38157cecd0 could not be found. Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9caa358e-04da-4040-8c13-0e38157cecd0 could not be found. Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:51:36.910305 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:51:36.915945 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:51:36.915945 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:51:36.915945 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:51:36.915945 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:51:36.915945 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:51:36.915945 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9caa358e-04da-4040-8c13-0e38157cecd0 could not be found. Jul 28 10:51:36.915945 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:51:36.915945 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-45e4cf7d-8d3a-482b-b722-8a99da6abdec tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Returning 404 to user: Instance 9caa358e-04da-4040-8c13-0e38157cecd0 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:51:36.915945 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-45e4cf7d-8d3a-482b-b722-8a99da6abdec tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] 10.222.0.46 "GET /compute/v2.1/servers/9caa358e-04da-4040-8c13-0e38157cecd0" status: 404 len: 111 microversion: 2.1 time: 0.063079 Jul 28 10:51:36.915945 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 661/1298] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:51:36 2022] GET /compute/v2.1/servers/9caa358e-04da-4040-8c13-0e38157cecd0 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:51:37.098119 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1116253034", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "bcbaa112-6986-4cb8-b479-7b414e4135a1"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:51:37.205103 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] validate_networks() for [('bcbaa112-6986-4cb8-b479-7b414e4135a1', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:51:37.907706 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:51:37.908095 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:51:37.908797 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:51:37.909388 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:51:37.910043 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:51:37.928482 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:37.935223 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:37.936291 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:37.936911 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:37.977764 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Getting quotas for project cab6813553674335bb5bcc780ddb0b6a. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:51:37.997306 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Getting quotas for user 7542fb7a6ebc4ec8a8bcca7400d4d32a and project cab6813553674335bb5bcc780ddb0b6a. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:51:38.027100 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:51:38.029682 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 303e4c8d-adac-4a15-836e-27e135de3817] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:51:38.126299 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-40ec5c11-869b-4951-ba48-bbb614d5067a tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.033301 Jul 28 10:51:38.136587 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 638/1299] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:51:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:51:38.149628 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-62349d67-4897-4152-b4bd-e2afc807b26b tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:38.151469 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-62349d67-4897-4152-b4bd-e2afc807b26b tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 303e4c8d-adac-4a15-836e-27e135de3817] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:51:38.384410 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-62349d67-4897-4152-b4bd-e2afc807b26b tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7542fb7a6ebc4ec8a8bcca7400d4d32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab6813553674335bb5bcc780ddb0b6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:51:38.396460 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-62349d67-4897-4152-b4bd-e2afc807b26b tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] 10.222.0.46 "GET /compute/v2.1/servers/303e4c8d-adac-4a15-836e-27e135de3817" status: 200 len: 1214 microversion: 2.1 time: 0.254003 Jul 28 10:51:38.401302 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 662/1300] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:51:38 2022] GET /compute/v2.1/servers/303e4c8d-adac-4a15-836e-27e135de3817 => generated 1214 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:51:39.422309 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1e8ef40a-61f4-485d-a467-2471bfca596e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:39.428727 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1e8ef40a-61f4-485d-a467-2471bfca596e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 303e4c8d-adac-4a15-836e-27e135de3817] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:51:39.449783 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1e8ef40a-61f4-485d-a467-2471bfca596e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:39.451818 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1e8ef40a-61f4-485d-a467-2471bfca596e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:39.453968 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1e8ef40a-61f4-485d-a467-2471bfca596e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:39.454724 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1e8ef40a-61f4-485d-a467-2471bfca596e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:39.494929 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1e8ef40a-61f4-485d-a467-2471bfca596e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:39.495992 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1e8ef40a-61f4-485d-a467-2471bfca596e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:39.496659 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-1e8ef40a-61f4-485d-a467-2471bfca596e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lazy-loading 'fault' on Instance uuid 303e4c8d-adac-4a15-836e-27e135de3817 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:51:39.724705 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-1e8ef40a-61f4-485d-a467-2471bfca596e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7542fb7a6ebc4ec8a8bcca7400d4d32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cab6813553674335bb5bcc780ddb0b6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:51:39.750716 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-1e8ef40a-61f4-485d-a467-2471bfca596e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] 10.222.0.46 "GET /compute/v2.1/servers/303e4c8d-adac-4a15-836e-27e135de3817" status: 200 len: 1287 microversion: 2.1 time: 0.332567 Jul 28 10:51:39.751602 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 639/1301] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:51:39 2022] GET /compute/v2.1/servers/303e4c8d-adac-4a15-836e-27e135de3817 => generated 1287 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:51:39.778838 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b91f6efa-1296-4990-a46c-3bc139f6c67c tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:39.789518 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b91f6efa-1296-4990-a46c-3bc139f6c67c tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 303e4c8d-adac-4a15-836e-27e135de3817] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:51:39.829374 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b91f6efa-1296-4990-a46c-3bc139f6c67c tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:39.837217 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b91f6efa-1296-4990-a46c-3bc139f6c67c tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:39.839376 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b91f6efa-1296-4990-a46c-3bc139f6c67c tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:39.840287 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b91f6efa-1296-4990-a46c-3bc139f6c67c tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:39.898941 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b91f6efa-1296-4990-a46c-3bc139f6c67c tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 303e4c8d-adac-4a15-836e-27e135de3817] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:51:40.040332 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b91f6efa-1296-4990-a46c-3bc139f6c67c tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 303e4c8d-adac-4a15-836e-27e135de3817] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:51:40.042115 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b91f6efa-1296-4990-a46c-3bc139f6c67c tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:40.042568 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b91f6efa-1296-4990-a46c-3bc139f6c67c tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:40.043376 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-b91f6efa-1296-4990-a46c-3bc139f6c67c tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 303e4c8d-adac-4a15-836e-27e135de3817] instance's host None is down, deleting from database Jul 28 10:51:40.053999 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-b91f6efa-1296-4990-a46c-3bc139f6c67c tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 303e4c8d-adac-4a15-836e-27e135de3817] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:51:40.151905 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-b91f6efa-1296-4990-a46c-3bc139f6c67c tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 303e4c8d-adac-4a15-836e-27e135de3817] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:51:40.159000 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-b91f6efa-1296-4990-a46c-3bc139f6c67c tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 303e4c8d-adac-4a15-836e-27e135de3817] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:51:40.466144 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b91f6efa-1296-4990-a46c-3bc139f6c67c tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] 10.222.0.46 "DELETE /compute/v2.1/servers/303e4c8d-adac-4a15-836e-27e135de3817" status: 204 len: 0 microversion: 2.1 time: 0.695143 Jul 28 10:51:40.470160 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 663/1302] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:51:39 2022] DELETE /compute/v2.1/servers/303e4c8d-adac-4a15-836e-27e135de3817 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:51:40.475683 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6f456123-f590-4928-8de8-623aab9ed35e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:40.476546 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-6f456123-f590-4928-8de8-623aab9ed35e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] [instance: 303e4c8d-adac-4a15-836e-27e135de3817] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:51:40.486709 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6f456123-f590-4928-8de8-623aab9ed35e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:40.487525 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6f456123-f590-4928-8de8-623aab9ed35e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:40.488545 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6f456123-f590-4928-8de8-623aab9ed35e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:40.496077 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-6f456123-f590-4928-8de8-623aab9ed35e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:40.581050 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-6f456123-f590-4928-8de8-623aab9ed35e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] HTTP exception thrown: Instance 303e4c8d-adac-4a15-836e-27e135de3817 could not be found. Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6f456123-f590-4928-8de8-623aab9ed35e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Request method failure captured: Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/303e4c8d-adac-4a15-836e-27e135de3817 HTTP/1.1 Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mowfi2fTkjvHQ6wIfNvZjzJNPuHf4w7R7UXOU_k-INSkbMsarn69RnJjuRsFqSV7zVkALqvNMMtW1XYVKb5zAA7IVlbKuHiOTkisiFAeiTKBmDWx2uIHlUa9wuq7Y44ReUV70_MD2TXPEImXE0OioC0B4HcWNqmK0-UVIy7lHaYft4 Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: cab6813553674335bb5bcc780ddb0b6a Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-VolumesActionsTest-509784763 Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cab6813553674335bb5bcc780ddb0b6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cab6813553674335bb5bcc780ddb0b6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cab6813553674335bb5bcc780ddb0b6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cab6813553674335bb5bcc780ddb0b6a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-VolumesActionsTest-509784763 Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: cab6813553674335bb5bcc780ddb0b6a Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-VolumesActionsTest-509784763 Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-VolumesActionsTest-509784763-project Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 7542fb7a6ebc4ec8a8bcca7400d4d32a Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-VolumesActionsTest-509784763-project Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 303e4c8d-adac-4a15-836e-27e135de3817 could not be found. Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '303e4c8d-adac-4a15-836e-27e135de3817'} Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 303e4c8d-adac-4a15-836e-27e135de3817 could not be found. Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 303e4c8d-adac-4a15-836e-27e135de3817 could not be found. Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:51:40.584529 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:51:40.590742 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:51:40.590742 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:51:40.590742 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:51:40.590742 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:51:40.590742 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:51:40.590742 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 303e4c8d-adac-4a15-836e-27e135de3817 could not be found. Jul 28 10:51:40.590742 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:51:40.595490 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6f456123-f590-4928-8de8-623aab9ed35e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] Returning 404 to user: Instance 303e4c8d-adac-4a15-836e-27e135de3817 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:51:40.600574 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-6f456123-f590-4928-8de8-623aab9ed35e tempest-VolumesActionsTest-509784763 tempest-VolumesActionsTest-509784763-project] 10.222.0.46 "GET /compute/v2.1/servers/303e4c8d-adac-4a15-836e-27e135de3817" status: 404 len: 111 microversion: 2.1 time: 0.129316 Jul 28 10:51:40.601568 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 664/1303] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:51:40 2022] GET /compute/v2.1/servers/303e4c8d-adac-4a15-836e-27e135de3817 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:51:40.884835 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1770752495", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "8f19b80d-f40a-4415-93b3-1889796e3314"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:51:40.974696 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] validate_networks() for [('8f19b80d-f40a-4415-93b3-1889796e3314', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:51:41.689732 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:51:41.690899 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:51:41.691387 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:51:41.691795 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:51:41.692205 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:51:41.710095 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:41.710855 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:41.713172 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:41.713817 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:41.722735 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=62,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:41.740427 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Getting quotas for project 9151e6fd4bf54723b5084e67bc3edaac. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:51:41.754375 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Getting quotas for user b5e59fdfc65548548e3a8ad132fe5b5d and project 9151e6fd4bf54723b5084e67bc3edaac. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:51:41.774141 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:51:41.777138 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] [instance: 07c39c2b-1df4-4e84-af2a-5c5e66fe8898] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:51:41.895137 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e7e0e3d8-2ace-4e63-8dbf-c6c1529098b6 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.770335 Jul 28 10:51:41.907319 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-02a23a92-85e4-4c6d-9d76-f071fecf2290 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:41.908560 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-02a23a92-85e4-4c6d-9d76-f071fecf2290 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] [instance: 07c39c2b-1df4-4e84-af2a-5c5e66fe8898] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:51:41.922008 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 640/1304] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:51:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:51:42.736851 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-02a23a92-85e4-4c6d-9d76-f071fecf2290 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e59fdfc65548548e3a8ad132fe5b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9151e6fd4bf54723b5084e67bc3edaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:51:42.751622 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-02a23a92-85e4-4c6d-9d76-f071fecf2290 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] 10.222.0.46 "GET /compute/v2.1/servers/07c39c2b-1df4-4e84-af2a-5c5e66fe8898" status: 200 len: 1215 microversion: 2.1 time: 0.848492 Jul 28 10:51:42.755261 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 665/1305] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:51:41 2022] GET /compute/v2.1/servers/07c39c2b-1df4-4e84-af2a-5c5e66fe8898 => generated 1215 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:51:43.782758 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-896ec85f-ddb3-46ad-8444-29e9f95fe7eb tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:43.783443 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-896ec85f-ddb3-46ad-8444-29e9f95fe7eb tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] [instance: 07c39c2b-1df4-4e84-af2a-5c5e66fe8898] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:51:43.798066 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-896ec85f-ddb3-46ad-8444-29e9f95fe7eb tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:43.803741 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-896ec85f-ddb3-46ad-8444-29e9f95fe7eb tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:43.805055 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-896ec85f-ddb3-46ad-8444-29e9f95fe7eb tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:43.805522 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-896ec85f-ddb3-46ad-8444-29e9f95fe7eb tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:43.906654 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-896ec85f-ddb3-46ad-8444-29e9f95fe7eb tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:43.907111 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-896ec85f-ddb3-46ad-8444-29e9f95fe7eb tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:43.907650 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-896ec85f-ddb3-46ad-8444-29e9f95fe7eb tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lazy-loading 'fault' on Instance uuid 07c39c2b-1df4-4e84-af2a-5c5e66fe8898 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:51:44.083720 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-896ec85f-ddb3-46ad-8444-29e9f95fe7eb tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e59fdfc65548548e3a8ad132fe5b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9151e6fd4bf54723b5084e67bc3edaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:51:44.094227 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-896ec85f-ddb3-46ad-8444-29e9f95fe7eb tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] 10.222.0.46 "GET /compute/v2.1/servers/07c39c2b-1df4-4e84-af2a-5c5e66fe8898" status: 200 len: 1288 microversion: 2.1 time: 0.317190 Jul 28 10:51:44.096814 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 641/1306] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:51:43 2022] GET /compute/v2.1/servers/07c39c2b-1df4-4e84-af2a-5c5e66fe8898 => generated 1288 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:51:44.116166 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-df82fe86-13ed-4b41-b786-a5458539a5ce tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:44.116718 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-df82fe86-13ed-4b41-b786-a5458539a5ce tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] [instance: 07c39c2b-1df4-4e84-af2a-5c5e66fe8898] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:51:44.123756 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-df82fe86-13ed-4b41-b786-a5458539a5ce tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:44.124188 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-df82fe86-13ed-4b41-b786-a5458539a5ce tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:44.141256 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-df82fe86-13ed-4b41-b786-a5458539a5ce tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:44.141720 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-df82fe86-13ed-4b41-b786-a5458539a5ce tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:44.234713 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-df82fe86-13ed-4b41-b786-a5458539a5ce tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] [instance: 07c39c2b-1df4-4e84-af2a-5c5e66fe8898] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:51:44.370753 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:44.402670 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-df82fe86-13ed-4b41-b786-a5458539a5ce tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] [instance: 07c39c2b-1df4-4e84-af2a-5c5e66fe8898] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:51:44.403490 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-df82fe86-13ed-4b41-b786-a5458539a5ce tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:44.409695 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-df82fe86-13ed-4b41-b786-a5458539a5ce tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:44.410711 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-df82fe86-13ed-4b41-b786-a5458539a5ce tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] [instance: 07c39c2b-1df4-4e84-af2a-5c5e66fe8898] instance's host None is down, deleting from database Jul 28 10:51:44.419093 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-df82fe86-13ed-4b41-b786-a5458539a5ce tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] [instance: 07c39c2b-1df4-4e84-af2a-5c5e66fe8898] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:51:44.506771 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-df82fe86-13ed-4b41-b786-a5458539a5ce tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] [instance: 07c39c2b-1df4-4e84-af2a-5c5e66fe8898] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:51:44.515623 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-df82fe86-13ed-4b41-b786-a5458539a5ce tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] [instance: 07c39c2b-1df4-4e84-af2a-5c5e66fe8898] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:51:44.864458 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=72,nova_cell0:UPDATE=22,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:51:44.878064 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-df82fe86-13ed-4b41-b786-a5458539a5ce tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] 10.222.0.46 "DELETE /compute/v2.1/servers/07c39c2b-1df4-4e84-af2a-5c5e66fe8898" status: 204 len: 0 microversion: 2.1 time: 0.766546 Jul 28 10:51:44.880567 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 666/1307] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:51:44 2022] DELETE /compute/v2.1/servers/07c39c2b-1df4-4e84-af2a-5c5e66fe8898 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:51:44.891094 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b2ee9595-0f0d-409c-99e1-6ed150a206f2 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:44.892724 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b2ee9595-0f0d-409c-99e1-6ed150a206f2 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] [instance: 07c39c2b-1df4-4e84-af2a-5c5e66fe8898] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:51:44.908707 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b2ee9595-0f0d-409c-99e1-6ed150a206f2 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:44.909704 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b2ee9595-0f0d-409c-99e1-6ed150a206f2 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:44.913717 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b2ee9595-0f0d-409c-99e1-6ed150a206f2 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:44.914550 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b2ee9595-0f0d-409c-99e1-6ed150a206f2 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:44.955040 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-b2ee9595-0f0d-409c-99e1-6ed150a206f2 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] HTTP exception thrown: Instance 07c39c2b-1df4-4e84-af2a-5c5e66fe8898 could not be found. Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b2ee9595-0f0d-409c-99e1-6ed150a206f2 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Request method failure captured: Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/07c39c2b-1df4-4e84-af2a-5c5e66fe8898 HTTP/1.1 Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mo4doIcZFJUj6q9M7hz07N77xXwyb8Te50hKKj9dCLZdrKO13G8JswBynzG6cEZXztvHt7x1n3nNUpfiD_agh5FhExZsKN8NdrcZ8P89M0-IRdXkX32G8GT8IP3VFXE4-ftntSUpVS4tVcj0p4COj9wuJRwikbuYOGlF3iUpT6noRI Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 9151e6fd4bf54723b5084e67bc3edaac Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-TestServerAdvancedOps-406672977 Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9151e6fd4bf54723b5084e67bc3edaac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9151e6fd4bf54723b5084e67bc3edaac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9151e6fd4bf54723b5084e67bc3edaac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9151e6fd4bf54723b5084e67bc3edaac", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-TestServerAdvancedOps-406672977 Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 9151e6fd4bf54723b5084e67bc3edaac Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-TestServerAdvancedOps-406672977 Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-TestServerAdvancedOps-406672977-project Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: b5e59fdfc65548548e3a8ad132fe5b5d Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-TestServerAdvancedOps-406672977-project Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 07c39c2b-1df4-4e84-af2a-5c5e66fe8898 could not be found. Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '07c39c2b-1df4-4e84-af2a-5c5e66fe8898'} Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07c39c2b-1df4-4e84-af2a-5c5e66fe8898 could not be found. Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07c39c2b-1df4-4e84-af2a-5c5e66fe8898 could not be found. Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:51:44.961376 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:51:44.966553 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:51:44.966553 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:51:44.966553 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:51:44.966553 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:51:44.966553 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:51:44.966553 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07c39c2b-1df4-4e84-af2a-5c5e66fe8898 could not be found. Jul 28 10:51:44.966553 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:51:44.968351 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b2ee9595-0f0d-409c-99e1-6ed150a206f2 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] Returning 404 to user: Instance 07c39c2b-1df4-4e84-af2a-5c5e66fe8898 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:51:44.969688 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b2ee9595-0f0d-409c-99e1-6ed150a206f2 tempest-TestServerAdvancedOps-406672977 tempest-TestServerAdvancedOps-406672977-project] 10.222.0.46 "GET /compute/v2.1/servers/07c39c2b-1df4-4e84-af2a-5c5e66fe8898" status: 404 len: 111 microversion: 2.1 time: 0.083486 Jul 28 10:51:44.971432 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 642/1308] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:51:44 2022] GET /compute/v2.1/servers/07c39c2b-1df4-4e84-af2a-5c5e66fe8898 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:51:52.185396 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-cb0a4379-1fbc-4277-8537-790409f32136 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1759655970 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1759655970-project-admin] Calling method '.version_select at 0x7fa94b6a2dc0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:52.186246 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:51:52.186246 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:51:52.187439 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cb0a4379-1fbc-4277-8537-790409f32136 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1759655970 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1759655970-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:52.188097 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cb0a4379-1fbc-4277-8537-790409f32136 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1759655970 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1759655970-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:52.230955 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cb0a4379-1fbc-4277-8537-790409f32136 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1759655970 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1759655970-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:52.241147 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cb0a4379-1fbc-4277-8537-790409f32136 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1759655970 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1759655970-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:52.279084 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cb0a4379-1fbc-4277-8537-790409f32136 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1759655970 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1759655970-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:51:52.285722 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cb0a4379-1fbc-4277-8537-790409f32136 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1759655970 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1759655970-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:51:52.305314 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-cb0a4379-1fbc-4277-8537-790409f32136 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1759655970 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1759655970-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.537078 Jul 28 10:51:52.311657 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 667/1309] 10.222.0.46 () {58 vars in 1146 bytes} [Thu Jul 28 10:51:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:52:06.340093 n-d-850468-6 devstack@n-api.service[119463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:52:06.340691 n-d-850468-6 devstack@n-api.service[119463]: Thu Jul 28 10:52:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 10:53:10.354633 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:10.355660 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=16 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:10.356984 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:10.358048 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=10 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:10.731775 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1247851053", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "5b7dc00b-d639-441a-a8ac-9b9a93fd9940"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:53:10.845426 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] validate_networks() for [('5b7dc00b-d639-441a-a8ac-9b9a93fd9940', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:53:12.389631 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:53:12.391180 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:53:12.391623 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:53:12.392026 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:53:12.392447 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:53:12.404896 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:12.405733 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:12.407151 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:12.407955 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:12.429635 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Getting quotas for project 5b833e323b674c858e1a4e2b184fa6a1. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:53:12.435685 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Getting quotas for user f436d67d918b4255857f91bc62c33994 and project 5b833e323b674c858e1a4e2b184fa6a1. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:53:12.452542 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:53:12.455056 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] [instance: 7d9de609-e79d-44e4-a373-37630e0e9b8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:53:12.562761 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-dd1e3755-a97e-45dc-89d3-5ca95234cc51 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.215374 Jul 28 10:53:12.570521 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 643/1310] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:53:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:53:12.572417 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=16 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:12.573414 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:UPDATE=8,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:12.574475 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:12.575146 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=6 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:12.581345 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-bb4bf3af-232c-4d62-9073-3274fff542e1 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:53:12.584405 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-bb4bf3af-232c-4d62-9073-3274fff542e1 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] [instance: 7d9de609-e79d-44e4-a373-37630e0e9b8a] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:53:12.780282 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-bb4bf3af-232c-4d62-9073-3274fff542e1 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f436d67d918b4255857f91bc62c33994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b833e323b674c858e1a4e2b184fa6a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:53:12.790040 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-bb4bf3af-232c-4d62-9073-3274fff542e1 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] 10.222.0.46 "GET /compute/v2.1/servers/7d9de609-e79d-44e4-a373-37630e0e9b8a" status: 200 len: 1214 microversion: 2.1 time: 0.219408 Jul 28 10:53:12.790679 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 668/1311] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:53:12 2022] GET /compute/v2.1/servers/7d9de609-e79d-44e4-a373-37630e0e9b8a => generated 1214 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:53:13.820442 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-339873c9-baf5-4a9b-b5e3-2a078694c7c2 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:53:13.821645 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-339873c9-baf5-4a9b-b5e3-2a078694c7c2 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] [instance: 7d9de609-e79d-44e4-a373-37630e0e9b8a] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:53:13.829283 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-339873c9-baf5-4a9b-b5e3-2a078694c7c2 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:13.830170 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-339873c9-baf5-4a9b-b5e3-2a078694c7c2 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:13.831134 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-339873c9-baf5-4a9b-b5e3-2a078694c7c2 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:13.831741 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-339873c9-baf5-4a9b-b5e3-2a078694c7c2 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:13.894769 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-339873c9-baf5-4a9b-b5e3-2a078694c7c2 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:13.895685 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-339873c9-baf5-4a9b-b5e3-2a078694c7c2 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:13.896515 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-339873c9-baf5-4a9b-b5e3-2a078694c7c2 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lazy-loading 'fault' on Instance uuid 7d9de609-e79d-44e4-a373-37630e0e9b8a {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:53:13.971472 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-339873c9-baf5-4a9b-b5e3-2a078694c7c2 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f436d67d918b4255857f91bc62c33994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b833e323b674c858e1a4e2b184fa6a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:53:13.984741 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-339873c9-baf5-4a9b-b5e3-2a078694c7c2 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] 10.222.0.46 "GET /compute/v2.1/servers/7d9de609-e79d-44e4-a373-37630e0e9b8a" status: 200 len: 1287 microversion: 2.1 time: 0.169303 Jul 28 10:53:13.989074 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 644/1312] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:53:13 2022] GET /compute/v2.1/servers/7d9de609-e79d-44e4-a373-37630e0e9b8a => generated 1287 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:53:14.010710 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0ad0d429-c888-4b2e-8529-2657f6ac5c30 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:53:14.011305 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0ad0d429-c888-4b2e-8529-2657f6ac5c30 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] [instance: 7d9de609-e79d-44e4-a373-37630e0e9b8a] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:53:14.017956 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0ad0d429-c888-4b2e-8529-2657f6ac5c30 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:14.018415 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0ad0d429-c888-4b2e-8529-2657f6ac5c30 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:14.019502 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0ad0d429-c888-4b2e-8529-2657f6ac5c30 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:14.019987 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0ad0d429-c888-4b2e-8529-2657f6ac5c30 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:14.049192 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0ad0d429-c888-4b2e-8529-2657f6ac5c30 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] [instance: 7d9de609-e79d-44e4-a373-37630e0e9b8a] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:53:14.114780 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0ad0d429-c888-4b2e-8529-2657f6ac5c30 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] [instance: 7d9de609-e79d-44e4-a373-37630e0e9b8a] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:53:14.117301 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0ad0d429-c888-4b2e-8529-2657f6ac5c30 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:14.117814 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0ad0d429-c888-4b2e-8529-2657f6ac5c30 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:14.118606 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-0ad0d429-c888-4b2e-8529-2657f6ac5c30 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] [instance: 7d9de609-e79d-44e4-a373-37630e0e9b8a] instance's host None is down, deleting from database Jul 28 10:53:14.130210 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0ad0d429-c888-4b2e-8529-2657f6ac5c30 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] [instance: 7d9de609-e79d-44e4-a373-37630e0e9b8a] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:53:14.194674 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0ad0d429-c888-4b2e-8529-2657f6ac5c30 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] [instance: 7d9de609-e79d-44e4-a373-37630e0e9b8a] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:53:14.200661 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0ad0d429-c888-4b2e-8529-2657f6ac5c30 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] [instance: 7d9de609-e79d-44e4-a373-37630e0e9b8a] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:53:14.574762 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0ad0d429-c888-4b2e-8529-2657f6ac5c30 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7d9de609-e79d-44e4-a373-37630e0e9b8a" status: 204 len: 0 microversion: 2.1 time: 0.568882 Jul 28 10:53:14.576525 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 669/1313] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:53:14 2022] DELETE /compute/v2.1/servers/7d9de609-e79d-44e4-a373-37630e0e9b8a => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:53:14.585359 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a286049e-8013-4483-8712-b524c9d494c4 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:53:14.586001 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-a286049e-8013-4483-8712-b524c9d494c4 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] [instance: 7d9de609-e79d-44e4-a373-37630e0e9b8a] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:53:14.593540 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a286049e-8013-4483-8712-b524c9d494c4 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:14.594275 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a286049e-8013-4483-8712-b524c9d494c4 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:14.596001 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a286049e-8013-4483-8712-b524c9d494c4 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:14.597183 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a286049e-8013-4483-8712-b524c9d494c4 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:14.640258 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-a286049e-8013-4483-8712-b524c9d494c4 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] HTTP exception thrown: Instance 7d9de609-e79d-44e4-a373-37630e0e9b8a could not be found. Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a286049e-8013-4483-8712-b524c9d494c4 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Request method failure captured: Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/7d9de609-e79d-44e4-a373-37630e0e9b8a HTTP/1.1 Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mqTGMX0rIAYHeUB3zgd8j3PV5dSR11hRUHaTVauJIU0cB9DNjuYPXp95jhZ7hldav57UGo_TaQ8v-ZYUPqafZsiZ0pgDOGwTT_lS6MLOn_oqrSzL8R6i0dQi8x8tfc3xAHr58xN8CIyu3M6OtfgPH15-o4CelmzjoDuhtA8TH8PXu0 Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 5b833e323b674c858e1a4e2b184fa6a1 Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-VolumesActionsTest-744902944 Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5b833e323b674c858e1a4e2b184fa6a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5b833e323b674c858e1a4e2b184fa6a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5b833e323b674c858e1a4e2b184fa6a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5b833e323b674c858e1a4e2b184fa6a1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-VolumesActionsTest-744902944 Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 5b833e323b674c858e1a4e2b184fa6a1 Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-VolumesActionsTest-744902944 Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-VolumesActionsTest-744902944-project Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: f436d67d918b4255857f91bc62c33994 Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-VolumesActionsTest-744902944-project Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 7d9de609-e79d-44e4-a373-37630e0e9b8a could not be found. Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '7d9de609-e79d-44e4-a373-37630e0e9b8a'} Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d9de609-e79d-44e4-a373-37630e0e9b8a could not be found. Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d9de609-e79d-44e4-a373-37630e0e9b8a could not be found. Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:53:14.644845 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:53:14.650803 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:53:14.650803 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:53:14.650803 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:53:14.650803 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:53:14.650803 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:53:14.650803 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d9de609-e79d-44e4-a373-37630e0e9b8a could not be found. Jul 28 10:53:14.650803 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:53:14.653577 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a286049e-8013-4483-8712-b524c9d494c4 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] Returning 404 to user: Instance 7d9de609-e79d-44e4-a373-37630e0e9b8a could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:53:14.656811 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a286049e-8013-4483-8712-b524c9d494c4 tempest-VolumesActionsTest-744902944 tempest-VolumesActionsTest-744902944-project] 10.222.0.46 "GET /compute/v2.1/servers/7d9de609-e79d-44e4-a373-37630e0e9b8a" status: 404 len: 111 microversion: 2.1 time: 0.075673 Jul 28 10:53:14.658097 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 645/1314] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:53:14 2022] GET /compute/v2.1/servers/7d9de609-e79d-44e4-a373-37630e0e9b8a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:53:23.714094 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0e0d02cd-09da-428d-b4f5-330a238db49a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Action: 'create', calling method: .version_select at 0x7fa94b67de50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2051945413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdAMGdHQyE0kU+s5gfqADCKd+KZKxHOn6tutbX82UunRsd1nrVAfD0MfJ6Y9KgiHCsTzVxDwu/ClVtEPrI0JLhKHH70E3bwX0cshdR8zS6ShC9PYXgTp72X3CCG7Wyxlg=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:53:23.723672 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:23.760169 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-0e0d02cd-09da-428d-b4f5-330a238db49a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Getting quotas for project 2afe18d732e94005a0536deb0868c7e7. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:53:23.766050 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-0e0d02cd-09da-428d-b4f5-330a238db49a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Getting quotas for user 7d9de0e46d9e4e15bbb8017b7a60b06f and project 2afe18d732e94005a0536deb0868c7e7. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:53:23.811263 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0e0d02cd-09da-428d-b4f5-330a238db49a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.102117 Jul 28 10:53:23.811938 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 670/1315] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:53:23 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:53:27.545374 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1519546026", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "08adab22-a3e8-4ada-b6e7-11163b468c17"}], "key_name": "tempest-TestNetworkBasicOps-2051945413", "security_groups": [{"name": "tempest-secgroup-smoke-873389825"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:53:27.580005 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:27.581230 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=6 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:27.583048 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:27.586842 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=12 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:27.759097 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] validate_networks() for [('08adab22-a3e8-4ada-b6e7-11163b468c17', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:53:28.554509 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:53:28.555944 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:53:28.556585 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:53:28.557169 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:53:28.557748 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:53:28.574888 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:28.577949 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:28.580278 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:28.581475 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:28.627707 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Getting quotas for project 2afe18d732e94005a0536deb0868c7e7. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:53:28.648117 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Getting quotas for user 7d9de0e46d9e4e15bbb8017b7a60b06f and project 2afe18d732e94005a0536deb0868c7e7. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:53:28.671594 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:53:28.674613 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: e2873f10-aea0-4980-966f-b1b8def6e2ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:53:28.763221 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-4ca16a50-68c7-41b5-9655-e2c93661d2ae tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.221520 Jul 28 10:53:28.769682 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 646/1316] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:53:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:53:28.775682 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c131ee74-20bf-4835-8f7b-fc85610f105b tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:53:28.776300 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c131ee74-20bf-4835-8f7b-fc85610f105b tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: e2873f10-aea0-4980-966f-b1b8def6e2ef] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:53:28.792765 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:28.992998 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-c131ee74-20bf-4835-8f7b-fc85610f105b tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9de0e46d9e4e15bbb8017b7a60b06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afe18d732e94005a0536deb0868c7e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:53:29.009884 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c131ee74-20bf-4835-8f7b-fc85610f105b tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] 10.222.0.46 "GET /compute/v2.1/servers/e2873f10-aea0-4980-966f-b1b8def6e2ef" status: 200 len: 1249 microversion: 2.1 time: 0.232660 Jul 28 10:53:29.013074 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 671/1317] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:53:28 2022] GET /compute/v2.1/servers/e2873f10-aea0-4980-966f-b1b8def6e2ef => generated 1249 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:53:30.032331 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a4ce6d70-09e6-4f14-9767-93dd0892ed81 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:53:30.035074 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-a4ce6d70-09e6-4f14-9767-93dd0892ed81 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: e2873f10-aea0-4980-966f-b1b8def6e2ef] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:53:30.057337 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a4ce6d70-09e6-4f14-9767-93dd0892ed81 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:30.058258 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a4ce6d70-09e6-4f14-9767-93dd0892ed81 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:30.059438 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a4ce6d70-09e6-4f14-9767-93dd0892ed81 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:30.060393 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a4ce6d70-09e6-4f14-9767-93dd0892ed81 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:30.150245 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a4ce6d70-09e6-4f14-9767-93dd0892ed81 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:30.151426 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a4ce6d70-09e6-4f14-9767-93dd0892ed81 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:30.152289 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-a4ce6d70-09e6-4f14-9767-93dd0892ed81 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lazy-loading 'fault' on Instance uuid e2873f10-aea0-4980-966f-b1b8def6e2ef {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:53:30.233578 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-a4ce6d70-09e6-4f14-9767-93dd0892ed81 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9de0e46d9e4e15bbb8017b7a60b06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afe18d732e94005a0536deb0868c7e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:53:30.249371 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a4ce6d70-09e6-4f14-9767-93dd0892ed81 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] 10.222.0.46 "GET /compute/v2.1/servers/e2873f10-aea0-4980-966f-b1b8def6e2ef" status: 200 len: 1322 microversion: 2.1 time: 0.221054 Jul 28 10:53:30.268980 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 647/1318] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:53:30 2022] GET /compute/v2.1/servers/e2873f10-aea0-4980-966f-b1b8def6e2ef => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:53:30.278486 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-3650b107-646d-4acf-8f67-efb5351c02bc tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:53:30.279447 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-3650b107-646d-4acf-8f67-efb5351c02bc tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: e2873f10-aea0-4980-966f-b1b8def6e2ef] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:53:30.290746 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3650b107-646d-4acf-8f67-efb5351c02bc tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:30.290746 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3650b107-646d-4acf-8f67-efb5351c02bc tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:30.292063 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3650b107-646d-4acf-8f67-efb5351c02bc tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:30.292470 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3650b107-646d-4acf-8f67-efb5351c02bc tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:30.354382 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-3650b107-646d-4acf-8f67-efb5351c02bc tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: e2873f10-aea0-4980-966f-b1b8def6e2ef] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:53:30.469601 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-3650b107-646d-4acf-8f67-efb5351c02bc tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: e2873f10-aea0-4980-966f-b1b8def6e2ef] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:53:30.472063 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3650b107-646d-4acf-8f67-efb5351c02bc tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:30.477959 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-3650b107-646d-4acf-8f67-efb5351c02bc tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:30.479174 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-3650b107-646d-4acf-8f67-efb5351c02bc tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: e2873f10-aea0-4980-966f-b1b8def6e2ef] instance's host None is down, deleting from database Jul 28 10:53:30.488438 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-3650b107-646d-4acf-8f67-efb5351c02bc tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: e2873f10-aea0-4980-966f-b1b8def6e2ef] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:53:30.723237 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-3650b107-646d-4acf-8f67-efb5351c02bc tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: e2873f10-aea0-4980-966f-b1b8def6e2ef] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:53:30.741125 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-3650b107-646d-4acf-8f67-efb5351c02bc tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: e2873f10-aea0-4980-966f-b1b8def6e2ef] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:53:31.255944 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-3650b107-646d-4acf-8f67-efb5351c02bc tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e2873f10-aea0-4980-966f-b1b8def6e2ef" status: 204 len: 0 microversion: 2.1 time: 0.986976 Jul 28 10:53:31.259455 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 672/1319] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:53:30 2022] DELETE /compute/v2.1/servers/e2873f10-aea0-4980-966f-b1b8def6e2ef => generated 0 bytes in 989 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 10:53:31.266836 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-cb32ab2f-f258-4524-8611-2f7b22d38f1f tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:53:31.268417 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-cb32ab2f-f258-4524-8611-2f7b22d38f1f tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: e2873f10-aea0-4980-966f-b1b8def6e2ef] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:53:31.281006 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cb32ab2f-f258-4524-8611-2f7b22d38f1f tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:31.281597 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cb32ab2f-f258-4524-8611-2f7b22d38f1f tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:31.283060 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cb32ab2f-f258-4524-8611-2f7b22d38f1f tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:53:31.283867 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cb32ab2f-f258-4524-8611-2f7b22d38f1f tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:53:31.303928 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-cb32ab2f-f258-4524-8611-2f7b22d38f1f tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] HTTP exception thrown: Instance e2873f10-aea0-4980-966f-b1b8def6e2ef could not be found. Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-cb32ab2f-f258-4524-8611-2f7b22d38f1f tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Request method failure captured: Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/e2873f10-aea0-4980-966f-b1b8def6e2ef HTTP/1.1 Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mqUruWE-jcCyGi9PHiDUPjHjovK4G7_2oKNsIwIGU4ggQTwLJMjwH_0LUTOvfA0qRjBsldGqZaOSB2Du0QH4ipnCVVYUhTQLNGKVvSwx_-DPbAjSCaCUba0YGKOYjaghMgJd2NVVmedDKM4AmgGHzNsu6gkWeF8zLh7l3JZ5Oj10rg Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 2afe18d732e94005a0536deb0868c7e7 Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-TestNetworkBasicOps-1858618645 Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2afe18d732e94005a0536deb0868c7e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2afe18d732e94005a0536deb0868c7e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2afe18d732e94005a0536deb0868c7e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2afe18d732e94005a0536deb0868c7e7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-TestNetworkBasicOps-1858618645 Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 2afe18d732e94005a0536deb0868c7e7 Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-TestNetworkBasicOps-1858618645 Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-TestNetworkBasicOps-1858618645-project Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 7d9de0e46d9e4e15bbb8017b7a60b06f Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-TestNetworkBasicOps-1858618645-project Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance e2873f10-aea0-4980-966f-b1b8def6e2ef could not be found. Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'e2873f10-aea0-4980-966f-b1b8def6e2ef'} Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2873f10-aea0-4980-966f-b1b8def6e2ef could not be found. Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2873f10-aea0-4980-966f-b1b8def6e2ef could not be found. Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:53:31.305979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:53:31.311328 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:53:31.311328 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:53:31.311328 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:53:31.311328 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:53:31.311328 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:53:31.311328 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2873f10-aea0-4980-966f-b1b8def6e2ef could not be found. Jul 28 10:53:31.311328 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:53:31.314456 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-cb32ab2f-f258-4524-8611-2f7b22d38f1f tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Returning 404 to user: Instance e2873f10-aea0-4980-966f-b1b8def6e2ef could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:53:31.315534 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-cb32ab2f-f258-4524-8611-2f7b22d38f1f tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] 10.222.0.46 "GET /compute/v2.1/servers/e2873f10-aea0-4980-966f-b1b8def6e2ef" status: 404 len: 111 microversion: 2.1 time: 0.054758 Jul 28 10:53:31.316776 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 648/1320] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:53:31 2022] GET /compute/v2.1/servers/e2873f10-aea0-4980-966f-b1b8def6e2ef => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:53:31.646754 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-74468c96-3e61-4c1e-bc3c-7eccf9e19109 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Calling method '.version_select at 0x7fa94b603040>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:53:31.702913 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-74468c96-3e61-4c1e-bc3c-7eccf9e19109 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2051945413" status: 202 len: 0 microversion: 2.1 time: 0.060333 Jul 28 10:53:31.703809 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 673/1321] 10.222.0.46 () {58 vars in 1257 bytes} [Thu Jul 28 10:53:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2051945413 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:53:58.945078 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c6f9716c-4098-4db2-87e5-1b5917aa25a1 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Action: 'create', calling method: .version_select at 0x7fa94b799700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1624871826", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMq71X7Nn6olpo36AvV3LrASR7501vClOOGBDFROPJKBnPrKqtdDrPqKXHyGPm2Md9gOdsex96+77BhY4Q3xfFAQVUX5nU+zZLG8MnBuNLbwV5ZypTWCBJPXSAa+MpVMpA=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:53:58.962246 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:58.966008 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=6 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:58.968711 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:58.968711 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=12 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:53:59.003737 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-c6f9716c-4098-4db2-87e5-1b5917aa25a1 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Getting quotas for project 2afe18d732e94005a0536deb0868c7e7. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:53:59.014674 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-c6f9716c-4098-4db2-87e5-1b5917aa25a1 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Getting quotas for user 7d9de0e46d9e4e15bbb8017b7a60b06f and project 2afe18d732e94005a0536deb0868c7e7. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:53:59.083469 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c6f9716c-4098-4db2-87e5-1b5917aa25a1 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.143007 Jul 28 10:53:59.092037 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 649/1322] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:53:58 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:54:03.175360 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-295151853", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "c99758ad-27cc-48b9-a9e2-d5ddd43d0311"}], "key_name": "tempest-TestNetworkBasicOps-1624871826", "security_groups": [{"name": "tempest-secgroup-smoke-2017511097"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:54:03.200720 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=6 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:54:03.203457 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:54:03.204264 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:54:03.441429 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] validate_networks() for [('c99758ad-27cc-48b9-a9e2-d5ddd43d0311', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:54:04.138725 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:54:04.139396 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:54:04.139874 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:54:04.140341 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:54:04.140759 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:54:04.156248 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:04.157147 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:04.158455 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:04.159174 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:04.181509 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Getting quotas for project 2afe18d732e94005a0536deb0868c7e7. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:54:04.203132 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Getting quotas for user 7d9de0e46d9e4e15bbb8017b7a60b06f and project 2afe18d732e94005a0536deb0868c7e7. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:54:04.226184 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:54:04.226736 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: 4391b795-489d-48dc-b7e5-6749722e7376] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:54:04.311121 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-5a5f77f8-94d6-4b92-a680-2bd4b0e6e86a tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.141201 Jul 28 10:54:04.316125 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 674/1323] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:54:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:54:04.323618 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1f9aa9ea-44b0-436a-b9ce-2cae4cba3f56 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:54:04.324575 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1f9aa9ea-44b0-436a-b9ce-2cae4cba3f56 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: 4391b795-489d-48dc-b7e5-6749722e7376] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:54:04.413161 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-1f9aa9ea-44b0-436a-b9ce-2cae4cba3f56 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9de0e46d9e4e15bbb8017b7a60b06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afe18d732e94005a0536deb0868c7e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:54:04.422636 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-1f9aa9ea-44b0-436a-b9ce-2cae4cba3f56 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] 10.222.0.46 "GET /compute/v2.1/servers/4391b795-489d-48dc-b7e5-6749722e7376" status: 200 len: 1248 microversion: 2.1 time: 0.103079 Jul 28 10:54:04.423397 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 650/1324] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:54:04 2022] GET /compute/v2.1/servers/4391b795-489d-48dc-b7e5-6749722e7376 => generated 1248 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:54:05.449877 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-91e44b84-cac4-40e1-8ff3-113d2c8baf56 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:54:05.451303 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-91e44b84-cac4-40e1-8ff3-113d2c8baf56 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: 4391b795-489d-48dc-b7e5-6749722e7376] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:54:05.463441 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-91e44b84-cac4-40e1-8ff3-113d2c8baf56 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:05.463902 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-91e44b84-cac4-40e1-8ff3-113d2c8baf56 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:05.464684 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-91e44b84-cac4-40e1-8ff3-113d2c8baf56 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:05.465118 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-91e44b84-cac4-40e1-8ff3-113d2c8baf56 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:05.551055 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-91e44b84-cac4-40e1-8ff3-113d2c8baf56 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:05.554559 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-91e44b84-cac4-40e1-8ff3-113d2c8baf56 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:05.555088 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-91e44b84-cac4-40e1-8ff3-113d2c8baf56 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lazy-loading 'fault' on Instance uuid 4391b795-489d-48dc-b7e5-6749722e7376 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:54:05.641011 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-91e44b84-cac4-40e1-8ff3-113d2c8baf56 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9de0e46d9e4e15bbb8017b7a60b06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afe18d732e94005a0536deb0868c7e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:54:05.656703 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-91e44b84-cac4-40e1-8ff3-113d2c8baf56 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] 10.222.0.46 "GET /compute/v2.1/servers/4391b795-489d-48dc-b7e5-6749722e7376" status: 200 len: 1321 microversion: 2.1 time: 0.212891 Jul 28 10:54:05.657637 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 675/1325] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:54:05 2022] GET /compute/v2.1/servers/4391b795-489d-48dc-b7e5-6749722e7376 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:54:05.688239 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ca2e4f50-1229-4fe9-91e6-c33e7930a951 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:54:05.688895 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ca2e4f50-1229-4fe9-91e6-c33e7930a951 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: 4391b795-489d-48dc-b7e5-6749722e7376] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:54:05.699617 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ca2e4f50-1229-4fe9-91e6-c33e7930a951 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:05.700230 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ca2e4f50-1229-4fe9-91e6-c33e7930a951 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:05.702181 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ca2e4f50-1229-4fe9-91e6-c33e7930a951 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:05.702862 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ca2e4f50-1229-4fe9-91e6-c33e7930a951 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:05.737124 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ca2e4f50-1229-4fe9-91e6-c33e7930a951 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: 4391b795-489d-48dc-b7e5-6749722e7376] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:54:05.825317 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ca2e4f50-1229-4fe9-91e6-c33e7930a951 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: 4391b795-489d-48dc-b7e5-6749722e7376] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:54:05.828917 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ca2e4f50-1229-4fe9-91e6-c33e7930a951 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:05.830363 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ca2e4f50-1229-4fe9-91e6-c33e7930a951 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:05.830982 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-ca2e4f50-1229-4fe9-91e6-c33e7930a951 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: 4391b795-489d-48dc-b7e5-6749722e7376] instance's host None is down, deleting from database Jul 28 10:54:05.853741 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-ca2e4f50-1229-4fe9-91e6-c33e7930a951 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: 4391b795-489d-48dc-b7e5-6749722e7376] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:54:05.930255 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-ca2e4f50-1229-4fe9-91e6-c33e7930a951 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: 4391b795-489d-48dc-b7e5-6749722e7376] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:54:05.944445 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-ca2e4f50-1229-4fe9-91e6-c33e7930a951 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: 4391b795-489d-48dc-b7e5-6749722e7376] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:54:06.354918 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ca2e4f50-1229-4fe9-91e6-c33e7930a951 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4391b795-489d-48dc-b7e5-6749722e7376" status: 204 len: 0 microversion: 2.1 time: 0.677653 Jul 28 10:54:06.355796 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 651/1326] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:54:05 2022] DELETE /compute/v2.1/servers/4391b795-489d-48dc-b7e5-6749722e7376 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:54:06.367028 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-05be0c28-d506-4b85-9fde-e7a4d20e77f2 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:54:06.367919 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-05be0c28-d506-4b85-9fde-e7a4d20e77f2 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] [instance: 4391b795-489d-48dc-b7e5-6749722e7376] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:54:06.391480 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-05be0c28-d506-4b85-9fde-e7a4d20e77f2 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:06.391788 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-05be0c28-d506-4b85-9fde-e7a4d20e77f2 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:06.396230 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-05be0c28-d506-4b85-9fde-e7a4d20e77f2 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:06.396848 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-05be0c28-d506-4b85-9fde-e7a4d20e77f2 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:06.432753 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-05be0c28-d506-4b85-9fde-e7a4d20e77f2 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] HTTP exception thrown: Instance 4391b795-489d-48dc-b7e5-6749722e7376 could not be found. Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-05be0c28-d506-4b85-9fde-e7a4d20e77f2 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Request method failure captured: Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/4391b795-489d-48dc-b7e5-6749722e7376 HTTP/1.1 Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mqUruWE-jcCyGi9PHiDUPjHjovK4G7_2oKNsIwIGU4ggQTwLJMjwH_0LUTOvfA0qRjBsldGqZaOSB2Du0QH4ipnCVVYUhTQLNGKVvSwx_-DPbAjSCaCUba0YGKOYjaghMgJd2NVVmedDKM4AmgGHzNsu6gkWeF8zLh7l3JZ5Oj10rg Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 2afe18d732e94005a0536deb0868c7e7 Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-TestNetworkBasicOps-1858618645 Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2afe18d732e94005a0536deb0868c7e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2afe18d732e94005a0536deb0868c7e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2afe18d732e94005a0536deb0868c7e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2afe18d732e94005a0536deb0868c7e7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-TestNetworkBasicOps-1858618645 Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 2afe18d732e94005a0536deb0868c7e7 Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-TestNetworkBasicOps-1858618645 Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-TestNetworkBasicOps-1858618645-project Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 7d9de0e46d9e4e15bbb8017b7a60b06f Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-TestNetworkBasicOps-1858618645-project Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 4391b795-489d-48dc-b7e5-6749722e7376 could not be found. Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '4391b795-489d-48dc-b7e5-6749722e7376'} Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4391b795-489d-48dc-b7e5-6749722e7376 could not be found. Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4391b795-489d-48dc-b7e5-6749722e7376 could not be found. Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:54:06.435773 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:54:06.441532 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:54:06.441532 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:54:06.441532 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:54:06.441532 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:54:06.441532 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:54:06.441532 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4391b795-489d-48dc-b7e5-6749722e7376 could not be found. Jul 28 10:54:06.441532 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:54:06.441532 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-05be0c28-d506-4b85-9fde-e7a4d20e77f2 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Returning 404 to user: Instance 4391b795-489d-48dc-b7e5-6749722e7376 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:54:06.441532 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-05be0c28-d506-4b85-9fde-e7a4d20e77f2 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] 10.222.0.46 "GET /compute/v2.1/servers/4391b795-489d-48dc-b7e5-6749722e7376" status: 404 len: 111 microversion: 2.1 time: 0.077861 Jul 28 10:54:06.447150 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 676/1327] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:54:06 2022] GET /compute/v2.1/servers/4391b795-489d-48dc-b7e5-6749722e7376 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:54:06.768510 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5f004b30-01dd-4c2f-b1ed-0eb392c48464 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] Calling method '.version_select at 0x7fa94b7e0280>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:54:06.834219 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-5f004b30-01dd-4c2f-b1ed-0eb392c48464 tempest-TestNetworkBasicOps-1858618645 tempest-TestNetworkBasicOps-1858618645-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1624871826" status: 202 len: 0 microversion: 2.1 time: 0.072351 Jul 28 10:54:06.865902 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 652/1328] 10.222.0.46 () {58 vars in 1257 bytes} [Thu Jul 28 10:54:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1624871826 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:54:39.070964 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:54:39.071594 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=6 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:54:39.072394 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:54:39.073079 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=12 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:54:39.895851 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c0699883-6d5c-47d8-9d87-8573fe98c154 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Action: 'create', calling method: .version_select at 0x7fa94b6ff670>, body: {"keypair": {"name": "tempest-TestServerBasicOps-2027786687", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZPP9xxccHOIZX4U13v3INep7IwvNa5cwUmQL5SiUuHiX8+lpaY7SO6DSaBg8ODgesCfdjMJ6pHSVWFfbYWnsRS3EbMZmKRMVGwggEmuggN6ee96pJ7dEhmM2ZvD1eX0w=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:54:39.946391 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-c0699883-6d5c-47d8-9d87-8573fe98c154 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Getting quotas for project cf432b0760fa4d03a1b82cf80b3591d6. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:54:39.966679 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-c0699883-6d5c-47d8-9d87-8573fe98c154 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Getting quotas for user d494cfb133424c92862bc37c2ee17a89 and project cf432b0760fa4d03a1b82cf80b3591d6. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:54:40.059849 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c0699883-6d5c-47d8-9d87-8573fe98c154 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.994389 Jul 28 10:54:40.063999 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 677/1329] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:54:39 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:54:42.685915 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1355351913", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-2027786687", "security_groups": [{"name": "tempest-secgroup-smoke-1423463881"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "c121c6b0-2791-4d45-80bb-cd6e34690b50"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:54:42.707827 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=6 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:54:42.708940 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:54:42.709776 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:54:51.083039 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] validate_networks() for [('c121c6b0-2791-4d45-80bb-cd6e34690b50', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:54:52.087389 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Getting quotas for project cf432b0760fa4d03a1b82cf80b3591d6. Resources: dict_keys(['metadata_items']) {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:54:52.099631 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Getting quotas for user d494cfb133424c92862bc37c2ee17a89 and project cf432b0760fa4d03a1b82cf80b3591d6. Resources: dict_keys(['metadata_items']) {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:54:52.141768 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:54:52.144595 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:54:52.145290 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:54:52.147093 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:54:52.148629 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:54:52.172664 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:52.173938 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:52.174951 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:52.175584 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:52.213552 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Getting quotas for project cf432b0760fa4d03a1b82cf80b3591d6. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:54:52.220031 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Getting quotas for user d494cfb133424c92862bc37c2ee17a89 and project cf432b0760fa4d03a1b82cf80b3591d6. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:54:52.237813 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:54:52.240471 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] [instance: e687f8fb-d89b-4e00-8342-c79c326b3e50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:54:52.350047 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a1013bd0-e596-4be8-9c4e-ec3b44477f98 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 9.669967 Jul 28 10:54:52.352399 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 653/1330] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:54:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 9673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:54:52.358622 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:54:52.360424 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:54:52.366326 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-03a4e651-edac-40db-aa7d-34878eebaf72 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:54:52.367449 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-03a4e651-edac-40db-aa7d-34878eebaf72 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] [instance: e687f8fb-d89b-4e00-8342-c79c326b3e50] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:54:52.556447 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-03a4e651-edac-40db-aa7d-34878eebaf72 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd494cfb133424c92862bc37c2ee17a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf432b0760fa4d03a1b82cf80b3591d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:54:52.576235 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-03a4e651-edac-40db-aa7d-34878eebaf72 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] 10.222.0.46 "GET /compute/v2.1/servers/e687f8fb-d89b-4e00-8342-c79c326b3e50" status: 200 len: 1303 microversion: 2.1 time: 0.218295 Jul 28 10:54:52.579460 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 678/1331] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:54:52 2022] GET /compute/v2.1/servers/e687f8fb-d89b-4e00-8342-c79c326b3e50 => generated 1303 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:54:53.600447 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-9483c218-b935-425f-824f-a1b82f39d0fe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:54:53.601052 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-9483c218-b935-425f-824f-a1b82f39d0fe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] [instance: e687f8fb-d89b-4e00-8342-c79c326b3e50] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:54:53.610763 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9483c218-b935-425f-824f-a1b82f39d0fe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:53.622492 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9483c218-b935-425f-824f-a1b82f39d0fe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:53.623387 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9483c218-b935-425f-824f-a1b82f39d0fe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:53.623843 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9483c218-b935-425f-824f-a1b82f39d0fe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:53.658994 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9483c218-b935-425f-824f-a1b82f39d0fe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:53.659453 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9483c218-b935-425f-824f-a1b82f39d0fe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:53.660177 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-9483c218-b935-425f-824f-a1b82f39d0fe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lazy-loading 'fault' on Instance uuid e687f8fb-d89b-4e00-8342-c79c326b3e50 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:54:53.760343 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-9483c218-b935-425f-824f-a1b82f39d0fe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd494cfb133424c92862bc37c2ee17a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf432b0760fa4d03a1b82cf80b3591d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:54:53.768652 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-9483c218-b935-425f-824f-a1b82f39d0fe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] 10.222.0.46 "GET /compute/v2.1/servers/e687f8fb-d89b-4e00-8342-c79c326b3e50" status: 200 len: 1376 microversion: 2.1 time: 0.173054 Jul 28 10:54:53.774226 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 654/1332] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:54:53 2022] GET /compute/v2.1/servers/e687f8fb-d89b-4e00-8342-c79c326b3e50 => generated 1376 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:54:53.793109 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ac7e774c-97d3-4ef3-90d9-ea4d1818edbe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:54:53.793775 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ac7e774c-97d3-4ef3-90d9-ea4d1818edbe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] [instance: e687f8fb-d89b-4e00-8342-c79c326b3e50] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:54:53.806930 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ac7e774c-97d3-4ef3-90d9-ea4d1818edbe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:53.812817 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ac7e774c-97d3-4ef3-90d9-ea4d1818edbe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:53.817120 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ac7e774c-97d3-4ef3-90d9-ea4d1818edbe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:53.819375 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ac7e774c-97d3-4ef3-90d9-ea4d1818edbe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:53.855983 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ac7e774c-97d3-4ef3-90d9-ea4d1818edbe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] [instance: e687f8fb-d89b-4e00-8342-c79c326b3e50] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:54:53.950007 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ac7e774c-97d3-4ef3-90d9-ea4d1818edbe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] [instance: e687f8fb-d89b-4e00-8342-c79c326b3e50] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:54:53.951373 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ac7e774c-97d3-4ef3-90d9-ea4d1818edbe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:53.952054 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ac7e774c-97d3-4ef3-90d9-ea4d1818edbe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:53.952919 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-ac7e774c-97d3-4ef3-90d9-ea4d1818edbe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] [instance: e687f8fb-d89b-4e00-8342-c79c326b3e50] instance's host None is down, deleting from database Jul 28 10:54:53.958548 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-ac7e774c-97d3-4ef3-90d9-ea4d1818edbe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] [instance: e687f8fb-d89b-4e00-8342-c79c326b3e50] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:54:54.057736 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-ac7e774c-97d3-4ef3-90d9-ea4d1818edbe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] [instance: e687f8fb-d89b-4e00-8342-c79c326b3e50] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:54:54.066606 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-ac7e774c-97d3-4ef3-90d9-ea4d1818edbe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] [instance: e687f8fb-d89b-4e00-8342-c79c326b3e50] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:54:54.443940 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ac7e774c-97d3-4ef3-90d9-ea4d1818edbe tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e687f8fb-d89b-4e00-8342-c79c326b3e50" status: 204 len: 0 microversion: 2.1 time: 0.655511 Jul 28 10:54:54.447537 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 679/1333] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:54:53 2022] DELETE /compute/v2.1/servers/e687f8fb-d89b-4e00-8342-c79c326b3e50 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:54:54.454061 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-62f5feea-c1ea-4ba3-9843-fb322163b1a3 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:54:54.454712 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-62f5feea-c1ea-4ba3-9843-fb322163b1a3 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] [instance: e687f8fb-d89b-4e00-8342-c79c326b3e50] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:54:54.472443 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-62f5feea-c1ea-4ba3-9843-fb322163b1a3 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:54.472900 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-62f5feea-c1ea-4ba3-9843-fb322163b1a3 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:54.473696 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-62f5feea-c1ea-4ba3-9843-fb322163b1a3 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:54:54.474165 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-62f5feea-c1ea-4ba3-9843-fb322163b1a3 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:54:54.504367 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-62f5feea-c1ea-4ba3-9843-fb322163b1a3 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] HTTP exception thrown: Instance e687f8fb-d89b-4e00-8342-c79c326b3e50 could not be found. Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-62f5feea-c1ea-4ba3-9843-fb322163b1a3 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Request method failure captured: Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/e687f8fb-d89b-4e00-8342-c79c326b3e50 HTTP/1.1 Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mrklX_wMdZ0wyQ6hlTmFb3FJuTiM90AI2y0DeGp-yLLv5BpxShWB1_8jXC2kDnJWYNZ9p6OS9ANZDvypoPoIdIeNLH_JQMXGjbTZjSWMEs40NcEuB5oFov7BnVVPElGj5YwC7fT0OKTCidtS1prYkQbe7Ppyv8I_84fFJCDJOmeIJQ Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: cf432b0760fa4d03a1b82cf80b3591d6 Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-TestServerBasicOps-339383434 Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cf432b0760fa4d03a1b82cf80b3591d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cf432b0760fa4d03a1b82cf80b3591d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cf432b0760fa4d03a1b82cf80b3591d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cf432b0760fa4d03a1b82cf80b3591d6", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-TestServerBasicOps-339383434 Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: cf432b0760fa4d03a1b82cf80b3591d6 Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-TestServerBasicOps-339383434 Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-TestServerBasicOps-339383434-project Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: d494cfb133424c92862bc37c2ee17a89 Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-TestServerBasicOps-339383434-project Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance e687f8fb-d89b-4e00-8342-c79c326b3e50 could not be found. Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'e687f8fb-d89b-4e00-8342-c79c326b3e50'} Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e687f8fb-d89b-4e00-8342-c79c326b3e50 could not be found. Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e687f8fb-d89b-4e00-8342-c79c326b3e50 could not be found. Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:54:54.505979 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:54:54.511543 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:54:54.511543 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:54:54.511543 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:54:54.511543 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:54:54.511543 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:54:54.511543 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e687f8fb-d89b-4e00-8342-c79c326b3e50 could not be found. Jul 28 10:54:54.511543 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:54:54.512887 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-62f5feea-c1ea-4ba3-9843-fb322163b1a3 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Returning 404 to user: Instance e687f8fb-d89b-4e00-8342-c79c326b3e50 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:54:54.513951 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-62f5feea-c1ea-4ba3-9843-fb322163b1a3 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] 10.222.0.46 "GET /compute/v2.1/servers/e687f8fb-d89b-4e00-8342-c79c326b3e50" status: 404 len: 111 microversion: 2.1 time: 0.063812 Jul 28 10:54:54.515034 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 655/1334] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:54:54 2022] GET /compute/v2.1/servers/e687f8fb-d89b-4e00-8342-c79c326b3e50 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:54:55.184456 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6e8f71cf-0a59-434d-a0d3-6a137d0a0a54 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] Calling method '.version_select at 0x7fa94b9fe430>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:54:55.244265 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-6e8f71cf-0a59-434d-a0d3-6a137d0a0a54 tempest-TestServerBasicOps-339383434 tempest-TestServerBasicOps-339383434-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2027786687" status: 202 len: 0 microversion: 2.1 time: 0.063774 Jul 28 10:54:55.245106 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 680/1335] 10.222.0.46 () {58 vars in 1254 bytes} [Thu Jul 28 10:54:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2027786687 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:55:26.349038 n-d-850468-6 devstack@n-api.service[119463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:55:26.349729 n-d-850468-6 devstack@n-api.service[119463]: Thu Jul 28 10:55:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 10:56:08.229845 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:08.231340 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=10 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:08.231973 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:08.232597 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=12 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:08.595630 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-faa17f85-01ff-49a4-9cff-7e8caa012911 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Action: 'create', calling method: .version_select at 0x7fa94b7e0e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1062252464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkc2nvQ+APSE4OhGAUgO51LzwAXAt559ThiLbIcji+EAj/pgJiw1Wc1hYtN3zhJPDvegVHCwa/gD/KinOjRL1vtePweN0E6nOqrUBPMtStfy9S9jnUww26F2tWwToz8HA=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:56:08.613669 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-faa17f85-01ff-49a4-9cff-7e8caa012911 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Getting quotas for project adcea96b79484f4da85e12a5a6243528. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:56:08.620083 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-faa17f85-01ff-49a4-9cff-7e8caa012911 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Getting quotas for user b552f6b83cc04054b15dc310b9d478e0 and project adcea96b79484f4da85e12a5a6243528. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:56:08.678117 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-faa17f85-01ff-49a4-9cff-7e8caa012911 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.449660 Jul 28 10:56:08.679367 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 656/1336] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:56:08 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:56:22.678972 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:22.680429 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:22.681390 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:22.686435 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1542908337", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "7832bb58-5975-41c0-bffb-eb28ef7571b9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1062252464", "security_groups": [{"name": "tempest-secgroup-smoke-930027346"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:56:23.227824 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] validate_networks() for [('7832bb58-5975-41c0-bffb-eb28ef7571b9', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:56:24.141794 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:56:24.143146 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:56:24.143858 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:56:24.144765 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:56:24.145394 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:56:24.168813 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:24.171204 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:24.172587 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:24.174635 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:24.222747 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Getting quotas for project adcea96b79484f4da85e12a5a6243528. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:56:24.236032 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Getting quotas for user b552f6b83cc04054b15dc310b9d478e0 and project adcea96b79484f4da85e12a5a6243528. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:56:24.291767 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:56:24.294071 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: f5d80180-9215-442d-8af3-ac748191fa27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:56:24.436184 n-d-850468-6 devstack@n-api.service[119464]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [68020f9b-30e9-4323-add1-4f28de512980] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 10:56:25.447653 n-d-850468-6 devstack@n-api.service[119464]: INFO oslo.messaging._drivers.impl_rabbit [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [68020f9b-30e9-4323-add1-4f28de512980] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 51476. Jul 28 10:56:25.452371 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-fafb3f24-b046-4261-9371-360f2050a51f tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.774627 Jul 28 10:56:25.453037 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 681/1337] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:56:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 2776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:56:25.469207 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:25.469675 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:25.481204 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1dfc9429-f838-4e8d-8e76-cf7b50d74110 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:56:25.481849 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1dfc9429-f838-4e8d-8e76-cf7b50d74110 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: f5d80180-9215-442d-8af3-ac748191fa27] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:56:25.969953 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-1dfc9429-f838-4e8d-8e76-cf7b50d74110 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b552f6b83cc04054b15dc310b9d478e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcea96b79484f4da85e12a5a6243528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:56:25.980539 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-1dfc9429-f838-4e8d-8e76-cf7b50d74110 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "GET /compute/v2.1/servers/f5d80180-9215-442d-8af3-ac748191fa27" status: 200 len: 1267 microversion: 2.1 time: 0.519702 Jul 28 10:56:25.981123 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 657/1338] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:56:25 2022] GET /compute/v2.1/servers/f5d80180-9215-442d-8af3-ac748191fa27 => generated 1267 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:56:27.007061 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-55be984d-8b77-4d4b-a357-1a498a581f99 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:56:27.008380 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-55be984d-8b77-4d4b-a357-1a498a581f99 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: f5d80180-9215-442d-8af3-ac748191fa27] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:56:27.019178 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-55be984d-8b77-4d4b-a357-1a498a581f99 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:27.019858 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-55be984d-8b77-4d4b-a357-1a498a581f99 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:27.020790 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-55be984d-8b77-4d4b-a357-1a498a581f99 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:27.021368 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-55be984d-8b77-4d4b-a357-1a498a581f99 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:27.092397 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-55be984d-8b77-4d4b-a357-1a498a581f99 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:27.093300 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-55be984d-8b77-4d4b-a357-1a498a581f99 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:27.094020 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-55be984d-8b77-4d4b-a357-1a498a581f99 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lazy-loading 'fault' on Instance uuid f5d80180-9215-442d-8af3-ac748191fa27 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:56:27.145196 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-55be984d-8b77-4d4b-a357-1a498a581f99 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b552f6b83cc04054b15dc310b9d478e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcea96b79484f4da85e12a5a6243528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:56:27.156692 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-55be984d-8b77-4d4b-a357-1a498a581f99 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "GET /compute/v2.1/servers/f5d80180-9215-442d-8af3-ac748191fa27" status: 200 len: 1340 microversion: 2.1 time: 0.154759 Jul 28 10:56:27.158202 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 682/1339] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:56:26 2022] GET /compute/v2.1/servers/f5d80180-9215-442d-8af3-ac748191fa27 => generated 1340 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:56:27.178780 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4b1f2c22-1233-4e9d-a3dc-2c58eea3eb21 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:56:27.179898 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-4b1f2c22-1233-4e9d-a3dc-2c58eea3eb21 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: f5d80180-9215-442d-8af3-ac748191fa27] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:56:27.187635 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4b1f2c22-1233-4e9d-a3dc-2c58eea3eb21 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:27.188351 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4b1f2c22-1233-4e9d-a3dc-2c58eea3eb21 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:27.189372 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4b1f2c22-1233-4e9d-a3dc-2c58eea3eb21 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:27.190039 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4b1f2c22-1233-4e9d-a3dc-2c58eea3eb21 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:27.218252 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-4b1f2c22-1233-4e9d-a3dc-2c58eea3eb21 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: f5d80180-9215-442d-8af3-ac748191fa27] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:56:27.276875 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-4b1f2c22-1233-4e9d-a3dc-2c58eea3eb21 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: f5d80180-9215-442d-8af3-ac748191fa27] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:56:27.278152 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4b1f2c22-1233-4e9d-a3dc-2c58eea3eb21 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:27.278799 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4b1f2c22-1233-4e9d-a3dc-2c58eea3eb21 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:27.279685 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-4b1f2c22-1233-4e9d-a3dc-2c58eea3eb21 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: f5d80180-9215-442d-8af3-ac748191fa27] instance's host None is down, deleting from database Jul 28 10:56:27.284617 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-4b1f2c22-1233-4e9d-a3dc-2c58eea3eb21 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: f5d80180-9215-442d-8af3-ac748191fa27] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:56:27.339545 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-4b1f2c22-1233-4e9d-a3dc-2c58eea3eb21 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: f5d80180-9215-442d-8af3-ac748191fa27] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:56:27.364024 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-4b1f2c22-1233-4e9d-a3dc-2c58eea3eb21 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: f5d80180-9215-442d-8af3-ac748191fa27] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:56:27.741768 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-4b1f2c22-1233-4e9d-a3dc-2c58eea3eb21 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f5d80180-9215-442d-8af3-ac748191fa27" status: 204 len: 0 microversion: 2.1 time: 0.567101 Jul 28 10:56:27.743168 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 658/1340] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:56:27 2022] DELETE /compute/v2.1/servers/f5d80180-9215-442d-8af3-ac748191fa27 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:56:27.755177 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5b058dd6-fc56-40f7-9455-d0ba1a42b113 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:56:27.755799 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5b058dd6-fc56-40f7-9455-d0ba1a42b113 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: f5d80180-9215-442d-8af3-ac748191fa27] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:56:27.768691 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5b058dd6-fc56-40f7-9455-d0ba1a42b113 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:27.771604 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5b058dd6-fc56-40f7-9455-d0ba1a42b113 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:27.772523 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5b058dd6-fc56-40f7-9455-d0ba1a42b113 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:27.773106 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5b058dd6-fc56-40f7-9455-d0ba1a42b113 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:27.824203 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-5b058dd6-fc56-40f7-9455-d0ba1a42b113 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] HTTP exception thrown: Instance f5d80180-9215-442d-8af3-ac748191fa27 could not be found. Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5b058dd6-fc56-40f7-9455-d0ba1a42b113 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Request method failure captured: Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/f5d80180-9215-442d-8af3-ac748191fa27 HTTP/1.1 Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mtGnupAuJ5j5VVzPxMY3PYDqviQA1aNv7Pr0q71i7lSV_87gsAUZzY0CTL7r2MT8sKILCAqUFFqnyRJcbrXhna11yi47ICSZNANzyIs7dWb7ss69rOD_j9oCQczDLQA_hwLqn4JSOJtAVy2QCPNvqojSbBVDL3ZjdW4vpk6wOShJ2Q Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: adcea96b79484f4da85e12a5a6243528 Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1268348461 Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/adcea96b79484f4da85e12a5a6243528"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/adcea96b79484f4da85e12a5a6243528"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/adcea96b79484f4da85e12a5a6243528"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_adcea96b79484f4da85e12a5a6243528", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1268348461 Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: adcea96b79484f4da85e12a5a6243528 Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1268348461 Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-TestNetworkAdvancedServerOps-1268348461-project Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: b552f6b83cc04054b15dc310b9d478e0 Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1268348461-project Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance f5d80180-9215-442d-8af3-ac748191fa27 could not be found. Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'f5d80180-9215-442d-8af3-ac748191fa27'} Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d80180-9215-442d-8af3-ac748191fa27 could not be found. Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d80180-9215-442d-8af3-ac748191fa27 could not be found. Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:56:27.831568 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:56:27.835171 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:56:27.835171 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:56:27.835171 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:56:27.835171 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:56:27.835171 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:56:27.835171 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:56:27.835171 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d80180-9215-442d-8af3-ac748191fa27 could not be found. Jul 28 10:56:27.835171 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:56:27.852970 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5b058dd6-fc56-40f7-9455-d0ba1a42b113 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Returning 404 to user: Instance f5d80180-9215-442d-8af3-ac748191fa27 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:56:27.854599 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-5b058dd6-fc56-40f7-9455-d0ba1a42b113 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "GET /compute/v2.1/servers/f5d80180-9215-442d-8af3-ac748191fa27" status: 404 len: 111 microversion: 2.1 time: 0.107069 Jul 28 10:56:27.859454 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 683/1341] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:56:27 2022] GET /compute/v2.1/servers/f5d80180-9215-442d-8af3-ac748191fa27 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:56:34.382180 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f5635ddb-0cbf-4028-8bfb-bcb6628eadaa tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Calling method '.version_select at 0x7fa94b7e03a0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:56:34.410803 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f5635ddb-0cbf-4028-8bfb-bcb6628eadaa tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1062252464" status: 202 len: 0 microversion: 2.1 time: 0.031609 Jul 28 10:56:34.413848 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 659/1342] 10.222.0.46 () {58 vars in 1284 bytes} [Thu Jul 28 10:56:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1062252464 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:56:34.425309 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:34.426369 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=6 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:34.430548 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a21fd9e2-2e36-4f95-a401-6d937b4dc620 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Action: 'create', calling method: .version_select at 0x7fa94b6a28b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-577464888", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFG209b4/T236PArsGkwj7p1afa858JHxtZ3kWr2i9kF+456SRLBKaAcB1mQv6c1Fu86IHzab8yXVwgqleem7A1MVxbdNgJjxwKMS0Ph17XOSBwinaTq123dnOu1AOMNuw=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:56:34.472337 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-a21fd9e2-2e36-4f95-a401-6d937b4dc620 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Getting quotas for project adcea96b79484f4da85e12a5a6243528. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:56:34.477916 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-a21fd9e2-2e36-4f95-a401-6d937b4dc620 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Getting quotas for user b552f6b83cc04054b15dc310b9d478e0 and project adcea96b79484f4da85e12a5a6243528. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:56:34.517247 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a21fd9e2-2e36-4f95-a401-6d937b4dc620 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.092630 Jul 28 10:56:34.522602 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 684/1343] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:56:34 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:56:44.480872 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:44.482458 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:44.483290 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:44.488074 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2045961768", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "57399318-3b7b-4a8c-ab83-a13d4fca8e26"}], "key_name": "tempest-TestNetworkAdvancedServerOps-577464888", "security_groups": [{"name": "tempest-secgroup-smoke-1131196922"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:56:44.848281 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] validate_networks() for [('57399318-3b7b-4a8c-ab83-a13d4fca8e26', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:56:45.546627 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:56:45.547274 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:56:45.547501 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:56:45.548325 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:56:45.548796 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:56:45.563685 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:45.564500 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:45.565510 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:45.566154 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:45.589887 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Getting quotas for project adcea96b79484f4da85e12a5a6243528. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:56:45.597731 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Getting quotas for user b552f6b83cc04054b15dc310b9d478e0 and project adcea96b79484f4da85e12a5a6243528. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:56:45.613737 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:56:45.616217 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 52a0405a-8ce9-4edf-a668-80f461568e94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:56:45.723838 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-bb06b607-6c1f-48a7-9a18-e365ff0bfb90 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.244214 Jul 28 10:56:45.724709 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 660/1344] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:56:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 10:56:45.736031 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f9d7d111-dd9f-478a-ad98-79e1f2948c39 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:56:45.736642 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-f9d7d111-dd9f-478a-ad98-79e1f2948c39 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 52a0405a-8ce9-4edf-a668-80f461568e94] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:56:45.739902 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=12 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:45.740951 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:45.742451 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:56:45.836758 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-f9d7d111-dd9f-478a-ad98-79e1f2948c39 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b552f6b83cc04054b15dc310b9d478e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcea96b79484f4da85e12a5a6243528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:56:45.845591 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f9d7d111-dd9f-478a-ad98-79e1f2948c39 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "GET /compute/v2.1/servers/52a0405a-8ce9-4edf-a668-80f461568e94" status: 200 len: 1266 microversion: 2.1 time: 0.113312 Jul 28 10:56:45.848338 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 685/1345] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:56:45 2022] GET /compute/v2.1/servers/52a0405a-8ce9-4edf-a668-80f461568e94 => generated 1266 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:56:46.884708 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7d0054b9-d6f5-44bd-96a1-167843529325 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:56:46.888810 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-7d0054b9-d6f5-44bd-96a1-167843529325 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 52a0405a-8ce9-4edf-a668-80f461568e94] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:56:46.917988 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7d0054b9-d6f5-44bd-96a1-167843529325 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:46.918606 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7d0054b9-d6f5-44bd-96a1-167843529325 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:46.925283 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7d0054b9-d6f5-44bd-96a1-167843529325 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:46.925794 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7d0054b9-d6f5-44bd-96a1-167843529325 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:47.000691 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7d0054b9-d6f5-44bd-96a1-167843529325 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:47.001531 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7d0054b9-d6f5-44bd-96a1-167843529325 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:47.002220 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-7d0054b9-d6f5-44bd-96a1-167843529325 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lazy-loading 'fault' on Instance uuid 52a0405a-8ce9-4edf-a668-80f461568e94 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:56:47.062012 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-7d0054b9-d6f5-44bd-96a1-167843529325 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b552f6b83cc04054b15dc310b9d478e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcea96b79484f4da85e12a5a6243528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:56:47.075872 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-7d0054b9-d6f5-44bd-96a1-167843529325 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "GET /compute/v2.1/servers/52a0405a-8ce9-4edf-a668-80f461568e94" status: 200 len: 1339 microversion: 2.1 time: 0.207340 Jul 28 10:56:47.078653 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 661/1346] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:56:46 2022] GET /compute/v2.1/servers/52a0405a-8ce9-4edf-a668-80f461568e94 => generated 1339 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:56:47.104532 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f1455da2-a669-4bef-afb5-1b1d9e3460af tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:56:47.105137 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-f1455da2-a669-4bef-afb5-1b1d9e3460af tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 52a0405a-8ce9-4edf-a668-80f461568e94] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:56:47.118279 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f1455da2-a669-4bef-afb5-1b1d9e3460af tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:47.119017 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f1455da2-a669-4bef-afb5-1b1d9e3460af tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:47.119986 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f1455da2-a669-4bef-afb5-1b1d9e3460af tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:47.120612 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f1455da2-a669-4bef-afb5-1b1d9e3460af tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:47.167593 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-f1455da2-a669-4bef-afb5-1b1d9e3460af tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 52a0405a-8ce9-4edf-a668-80f461568e94] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:56:47.288618 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-f1455da2-a669-4bef-afb5-1b1d9e3460af tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 52a0405a-8ce9-4edf-a668-80f461568e94] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:56:47.292431 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f1455da2-a669-4bef-afb5-1b1d9e3460af tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:47.292935 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f1455da2-a669-4bef-afb5-1b1d9e3460af tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:47.293457 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-f1455da2-a669-4bef-afb5-1b1d9e3460af tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 52a0405a-8ce9-4edf-a668-80f461568e94] instance's host None is down, deleting from database Jul 28 10:56:47.304718 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-f1455da2-a669-4bef-afb5-1b1d9e3460af tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 52a0405a-8ce9-4edf-a668-80f461568e94] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:56:47.361892 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-f1455da2-a669-4bef-afb5-1b1d9e3460af tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 52a0405a-8ce9-4edf-a668-80f461568e94] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:56:47.369129 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-f1455da2-a669-4bef-afb5-1b1d9e3460af tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 52a0405a-8ce9-4edf-a668-80f461568e94] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:56:47.667978 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f1455da2-a669-4bef-afb5-1b1d9e3460af tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "DELETE /compute/v2.1/servers/52a0405a-8ce9-4edf-a668-80f461568e94" status: 204 len: 0 microversion: 2.1 time: 0.569010 Jul 28 10:56:47.670462 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 686/1347] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:56:47 2022] DELETE /compute/v2.1/servers/52a0405a-8ce9-4edf-a668-80f461568e94 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:56:47.679129 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-de474faa-5e27-4450-97c2-919d444a0b8b tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:56:47.679751 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-de474faa-5e27-4450-97c2-919d444a0b8b tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 52a0405a-8ce9-4edf-a668-80f461568e94] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:56:47.694225 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-de474faa-5e27-4450-97c2-919d444a0b8b tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:47.694970 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-de474faa-5e27-4450-97c2-919d444a0b8b tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:47.695932 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-de474faa-5e27-4450-97c2-919d444a0b8b tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:56:47.696578 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-de474faa-5e27-4450-97c2-919d444a0b8b tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:56:47.733047 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-de474faa-5e27-4450-97c2-919d444a0b8b tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] HTTP exception thrown: Instance 52a0405a-8ce9-4edf-a668-80f461568e94 could not be found. Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-de474faa-5e27-4450-97c2-919d444a0b8b tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Request method failure captured: Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/52a0405a-8ce9-4edf-a668-80f461568e94 HTTP/1.1 Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mtGnupAuJ5j5VVzPxMY3PYDqviQA1aNv7Pr0q71i7lSV_87gsAUZzY0CTL7r2MT8sKILCAqUFFqnyRJcbrXhna11yi47ICSZNANzyIs7dWb7ss69rOD_j9oCQczDLQA_hwLqn4JSOJtAVy2QCPNvqojSbBVDL3ZjdW4vpk6wOShJ2Q Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: adcea96b79484f4da85e12a5a6243528 Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1268348461 Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/adcea96b79484f4da85e12a5a6243528"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/adcea96b79484f4da85e12a5a6243528"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/adcea96b79484f4da85e12a5a6243528"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_adcea96b79484f4da85e12a5a6243528", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1268348461 Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: adcea96b79484f4da85e12a5a6243528 Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1268348461 Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-TestNetworkAdvancedServerOps-1268348461-project Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: b552f6b83cc04054b15dc310b9d478e0 Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1268348461-project Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 52a0405a-8ce9-4edf-a668-80f461568e94 could not be found. Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '52a0405a-8ce9-4edf-a668-80f461568e94'} Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52a0405a-8ce9-4edf-a668-80f461568e94 could not be found. Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52a0405a-8ce9-4edf-a668-80f461568e94 could not be found. Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:56:47.735616 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:56:47.739658 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:56:47.739658 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:56:47.739658 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:56:47.739658 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:56:47.739658 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:56:47.739658 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:56:47.739658 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52a0405a-8ce9-4edf-a668-80f461568e94 could not be found. Jul 28 10:56:47.739658 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:56:47.742933 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-de474faa-5e27-4450-97c2-919d444a0b8b tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Returning 404 to user: Instance 52a0405a-8ce9-4edf-a668-80f461568e94 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:56:47.743987 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-de474faa-5e27-4450-97c2-919d444a0b8b tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "GET /compute/v2.1/servers/52a0405a-8ce9-4edf-a668-80f461568e94" status: 404 len: 111 microversion: 2.1 time: 0.069130 Jul 28 10:56:47.750497 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 662/1348] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:56:47 2022] GET /compute/v2.1/servers/52a0405a-8ce9-4edf-a668-80f461568e94 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:56:53.459869 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-042eac8b-e968-4e83-9c6c-9cef85c22e06 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Calling method '.version_select at 0x7fa94b6a2700>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:56:53.511554 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-042eac8b-e968-4e83-9c6c-9cef85c22e06 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-577464888" status: 202 len: 0 microversion: 2.1 time: 0.056663 Jul 28 10:56:53.511554 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 687/1349] 10.222.0.46 () {58 vars in 1281 bytes} [Thu Jul 28 10:56:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-577464888 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:56:53.531136 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c04305a9-9a06-4632-a3ea-a87b5010ecb2 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Action: 'create', calling method: .version_select at 0x7fa94b7f33a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-406370710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9bGpEr4xqymYT7bJ7eeVpBOl32FBDuvKG0ZbUSu7mdtYTdHovNrhrMJJ4+5v2oXxgv27s2U3uKU0DhYDdz2ccMfpLSjGPsLzHV7a6/kk6ZcfU69WG6DGGlCArAYQGgaA=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:56:53.580586 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-c04305a9-9a06-4632-a3ea-a87b5010ecb2 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Getting quotas for project adcea96b79484f4da85e12a5a6243528. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:56:53.591818 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-c04305a9-9a06-4632-a3ea-a87b5010ecb2 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Getting quotas for user b552f6b83cc04054b15dc310b9d478e0 and project adcea96b79484f4da85e12a5a6243528. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:56:53.658571 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c04305a9-9a06-4632-a3ea-a87b5010ecb2 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.135029 Jul 28 10:56:53.659614 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 663/1350] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:56:53 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:57:02.229348 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:02.231031 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:02.238828 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1174903800", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "febec382-1c9f-4e16-aa90-e8d89922b6a0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-406370710", "security_groups": [{"name": "tempest-secgroup-smoke-1427149229"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:57:02.406873 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] validate_networks() for [('febec382-1c9f-4e16-aa90-e8d89922b6a0', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:57:03.850998 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:57:03.852258 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:57:03.852739 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:57:03.853152 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:57:03.853607 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:57:03.878963 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:03.879435 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:03.883522 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:03.884211 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:03.932430 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Getting quotas for project adcea96b79484f4da85e12a5a6243528. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:57:03.948263 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Getting quotas for user b552f6b83cc04054b15dc310b9d478e0 and project adcea96b79484f4da85e12a5a6243528. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:57:04.006292 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:57:04.010249 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 5726a9b7-e7ca-4516-9700-d57eb8d2f7ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:57:04.155576 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9cc7ca0a-6707-477b-a2eb-20f1bdf13882 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.922348 Jul 28 10:57:04.156571 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 688/1351] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:57:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:57:04.165065 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:04.165996 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=12 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:04.167355 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=10 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:04.168481 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:04.175747 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a89b3039-2dd8-4efb-8288-810c520426ac tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:57:04.177047 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-a89b3039-2dd8-4efb-8288-810c520426ac tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 5726a9b7-e7ca-4516-9700-d57eb8d2f7ed] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:57:04.372709 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-a89b3039-2dd8-4efb-8288-810c520426ac tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b552f6b83cc04054b15dc310b9d478e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcea96b79484f4da85e12a5a6243528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:57:04.381741 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a89b3039-2dd8-4efb-8288-810c520426ac tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "GET /compute/v2.1/servers/5726a9b7-e7ca-4516-9700-d57eb8d2f7ed" status: 200 len: 1266 microversion: 2.1 time: 0.216897 Jul 28 10:57:04.382757 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 664/1352] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:57:04 2022] GET /compute/v2.1/servers/5726a9b7-e7ca-4516-9700-d57eb8d2f7ed => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:57:05.410189 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-01370d7e-ff87-4536-a560-38bdefecf650 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:57:05.410189 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-01370d7e-ff87-4536-a560-38bdefecf650 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 5726a9b7-e7ca-4516-9700-d57eb8d2f7ed] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:57:05.430931 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-01370d7e-ff87-4536-a560-38bdefecf650 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:05.431394 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-01370d7e-ff87-4536-a560-38bdefecf650 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:05.436546 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-01370d7e-ff87-4536-a560-38bdefecf650 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:05.437017 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-01370d7e-ff87-4536-a560-38bdefecf650 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:05.515614 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-01370d7e-ff87-4536-a560-38bdefecf650 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:05.517154 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-01370d7e-ff87-4536-a560-38bdefecf650 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:05.520673 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-01370d7e-ff87-4536-a560-38bdefecf650 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lazy-loading 'fault' on Instance uuid 5726a9b7-e7ca-4516-9700-d57eb8d2f7ed {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:57:05.619131 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-01370d7e-ff87-4536-a560-38bdefecf650 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b552f6b83cc04054b15dc310b9d478e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcea96b79484f4da85e12a5a6243528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:57:05.634375 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-01370d7e-ff87-4536-a560-38bdefecf650 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "GET /compute/v2.1/servers/5726a9b7-e7ca-4516-9700-d57eb8d2f7ed" status: 200 len: 1339 microversion: 2.1 time: 0.230759 Jul 28 10:57:05.635343 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 689/1353] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:57:05 2022] GET /compute/v2.1/servers/5726a9b7-e7ca-4516-9700-d57eb8d2f7ed => generated 1339 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:57:05.660806 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-eb5ecac3-2840-4104-912e-2346b300e212 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:57:05.661851 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-eb5ecac3-2840-4104-912e-2346b300e212 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 5726a9b7-e7ca-4516-9700-d57eb8d2f7ed] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:57:05.670234 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-eb5ecac3-2840-4104-912e-2346b300e212 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:05.670890 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-eb5ecac3-2840-4104-912e-2346b300e212 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:05.676522 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-eb5ecac3-2840-4104-912e-2346b300e212 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:05.677323 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-eb5ecac3-2840-4104-912e-2346b300e212 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:05.737510 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-eb5ecac3-2840-4104-912e-2346b300e212 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 5726a9b7-e7ca-4516-9700-d57eb8d2f7ed] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:57:05.857936 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-eb5ecac3-2840-4104-912e-2346b300e212 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 5726a9b7-e7ca-4516-9700-d57eb8d2f7ed] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:57:05.858768 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-eb5ecac3-2840-4104-912e-2346b300e212 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:05.859218 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-eb5ecac3-2840-4104-912e-2346b300e212 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:05.859660 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-eb5ecac3-2840-4104-912e-2346b300e212 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 5726a9b7-e7ca-4516-9700-d57eb8d2f7ed] instance's host None is down, deleting from database Jul 28 10:57:05.873407 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-eb5ecac3-2840-4104-912e-2346b300e212 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 5726a9b7-e7ca-4516-9700-d57eb8d2f7ed] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:57:05.909721 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-eb5ecac3-2840-4104-912e-2346b300e212 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 5726a9b7-e7ca-4516-9700-d57eb8d2f7ed] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:57:05.917720 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-eb5ecac3-2840-4104-912e-2346b300e212 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 5726a9b7-e7ca-4516-9700-d57eb8d2f7ed] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:57:06.371856 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-eb5ecac3-2840-4104-912e-2346b300e212 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5726a9b7-e7ca-4516-9700-d57eb8d2f7ed" status: 204 len: 0 microversion: 2.1 time: 0.716190 Jul 28 10:57:06.373147 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 665/1354] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:57:05 2022] DELETE /compute/v2.1/servers/5726a9b7-e7ca-4516-9700-d57eb8d2f7ed => generated 0 bytes in 719 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:57:06.383156 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7a403732-b307-4815-97e9-0fb9c5a66deb tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:57:06.383982 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-7a403732-b307-4815-97e9-0fb9c5a66deb tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 5726a9b7-e7ca-4516-9700-d57eb8d2f7ed] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:57:06.390792 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7a403732-b307-4815-97e9-0fb9c5a66deb tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:06.391483 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7a403732-b307-4815-97e9-0fb9c5a66deb tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:06.392445 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7a403732-b307-4815-97e9-0fb9c5a66deb tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:06.393163 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-7a403732-b307-4815-97e9-0fb9c5a66deb tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:06.409646 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-7a403732-b307-4815-97e9-0fb9c5a66deb tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] HTTP exception thrown: Instance 5726a9b7-e7ca-4516-9700-d57eb8d2f7ed could not be found. Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7a403732-b307-4815-97e9-0fb9c5a66deb tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Request method failure captured: Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/5726a9b7-e7ca-4516-9700-d57eb8d2f7ed HTTP/1.1 Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mtGnupAuJ5j5VVzPxMY3PYDqviQA1aNv7Pr0q71i7lSV_87gsAUZzY0CTL7r2MT8sKILCAqUFFqnyRJcbrXhna11yi47ICSZNANzyIs7dWb7ss69rOD_j9oCQczDLQA_hwLqn4JSOJtAVy2QCPNvqojSbBVDL3ZjdW4vpk6wOShJ2Q Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: adcea96b79484f4da85e12a5a6243528 Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1268348461 Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/adcea96b79484f4da85e12a5a6243528"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/adcea96b79484f4da85e12a5a6243528"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/adcea96b79484f4da85e12a5a6243528"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_adcea96b79484f4da85e12a5a6243528", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1268348461 Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: adcea96b79484f4da85e12a5a6243528 Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1268348461 Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-TestNetworkAdvancedServerOps-1268348461-project Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: b552f6b83cc04054b15dc310b9d478e0 Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1268348461-project Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 5726a9b7-e7ca-4516-9700-d57eb8d2f7ed could not be found. Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '5726a9b7-e7ca-4516-9700-d57eb8d2f7ed'} Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5726a9b7-e7ca-4516-9700-d57eb8d2f7ed could not be found. Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5726a9b7-e7ca-4516-9700-d57eb8d2f7ed could not be found. Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:57:06.411530 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:57:06.416139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:57:06.416139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:57:06.416139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:57:06.416139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:57:06.416139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:57:06.416139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:57:06.416139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5726a9b7-e7ca-4516-9700-d57eb8d2f7ed could not be found. Jul 28 10:57:06.416139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:57:06.417422 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7a403732-b307-4815-97e9-0fb9c5a66deb tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Returning 404 to user: Instance 5726a9b7-e7ca-4516-9700-d57eb8d2f7ed could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:57:06.419041 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7a403732-b307-4815-97e9-0fb9c5a66deb tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "GET /compute/v2.1/servers/5726a9b7-e7ca-4516-9700-d57eb8d2f7ed" status: 404 len: 111 microversion: 2.1 time: 0.041543 Jul 28 10:57:06.424074 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 690/1355] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:57:06 2022] GET /compute/v2.1/servers/5726a9b7-e7ca-4516-9700-d57eb8d2f7ed => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:57:11.687803 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-170e86eb-e8f7-410c-991d-9198d9d2ab02 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Calling method '.version_select at 0x7fa94b7995e0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:57:11.755182 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-170e86eb-e8f7-410c-991d-9198d9d2ab02 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-406370710" status: 202 len: 0 microversion: 2.1 time: 0.072147 Jul 28 10:57:11.756124 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 666/1356] 10.222.0.46 () {58 vars in 1281 bytes} [Thu Jul 28 10:57:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-406370710 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:57:11.772542 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c60cc9ac-b09f-412d-9919-0e94cd6b9bd5 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Action: 'create', calling method: .version_select at 0x7fa94b6a21f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-86319139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8TfyOAbXvnhKHNPznuaNH2UBDHdPbME2Y/ujGGVBBnNX6G6D318Lqr8a1IOPrv2ykQUuESEdckFLwzDJ8mjPauoOw8CyZ4BXJeRjTvRVTEgblhgbK+skFd0tJdZdUteg=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:57:11.821268 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-c60cc9ac-b09f-412d-9919-0e94cd6b9bd5 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Getting quotas for project adcea96b79484f4da85e12a5a6243528. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:57:11.830962 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-c60cc9ac-b09f-412d-9919-0e94cd6b9bd5 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Getting quotas for user b552f6b83cc04054b15dc310b9d478e0 and project adcea96b79484f4da85e12a5a6243528. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:57:11.894943 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c60cc9ac-b09f-412d-9919-0e94cd6b9bd5 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.127690 Jul 28 10:57:11.895688 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 691/1357] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:57:11 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:57:19.554185 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:19.558928 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:19.571492 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1710932843", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "d207aaff-5038-4cde-bbc5-692183742e43"}], "key_name": "tempest-TestNetworkAdvancedServerOps-86319139", "security_groups": [{"name": "tempest-secgroup-smoke-689755954"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:57:19.720799 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] validate_networks() for [('d207aaff-5038-4cde-bbc5-692183742e43', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:57:20.245908 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:57:20.246577 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:57:20.247272 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:57:20.247916 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:57:20.248672 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:57:20.262829 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:20.263758 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:20.265331 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:20.266031 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:20.293323 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Getting quotas for project adcea96b79484f4da85e12a5a6243528. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:57:20.300909 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Getting quotas for user b552f6b83cc04054b15dc310b9d478e0 and project adcea96b79484f4da85e12a5a6243528. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:57:20.320554 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:57:20.324594 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 337984b5-a0a5-4703-a6e6-22dad12309db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:57:20.390656 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f80a2203-01f3-4373-bab6-2e1c961bf297 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.838506 Jul 28 10:57:20.397136 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 667/1358] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:57:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:57:20.403056 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-989cc421-2c03-407e-88be-d07f8eeda77d tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:57:20.403749 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-989cc421-2c03-407e-88be-d07f8eeda77d tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 337984b5-a0a5-4703-a6e6-22dad12309db] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:57:20.405685 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:20.412642 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=12 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:20.413602 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:20.555882 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-989cc421-2c03-407e-88be-d07f8eeda77d tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b552f6b83cc04054b15dc310b9d478e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcea96b79484f4da85e12a5a6243528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:57:20.565602 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-989cc421-2c03-407e-88be-d07f8eeda77d tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "GET /compute/v2.1/servers/337984b5-a0a5-4703-a6e6-22dad12309db" status: 200 len: 1265 microversion: 2.1 time: 0.167023 Jul 28 10:57:20.573963 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 692/1359] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:57:20 2022] GET /compute/v2.1/servers/337984b5-a0a5-4703-a6e6-22dad12309db => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:57:21.592840 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e0f59496-b433-4f38-bc63-ca94c4e95261 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:57:21.594476 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-e0f59496-b433-4f38-bc63-ca94c4e95261 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 337984b5-a0a5-4703-a6e6-22dad12309db] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:57:21.609797 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e0f59496-b433-4f38-bc63-ca94c4e95261 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:21.611442 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e0f59496-b433-4f38-bc63-ca94c4e95261 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:21.614609 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e0f59496-b433-4f38-bc63-ca94c4e95261 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:21.615231 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e0f59496-b433-4f38-bc63-ca94c4e95261 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:21.681389 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e0f59496-b433-4f38-bc63-ca94c4e95261 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:21.681989 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e0f59496-b433-4f38-bc63-ca94c4e95261 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:21.683020 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-e0f59496-b433-4f38-bc63-ca94c4e95261 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lazy-loading 'fault' on Instance uuid 337984b5-a0a5-4703-a6e6-22dad12309db {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:57:21.735043 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-e0f59496-b433-4f38-bc63-ca94c4e95261 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b552f6b83cc04054b15dc310b9d478e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcea96b79484f4da85e12a5a6243528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:57:21.744413 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e0f59496-b433-4f38-bc63-ca94c4e95261 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "GET /compute/v2.1/servers/337984b5-a0a5-4703-a6e6-22dad12309db" status: 200 len: 1338 microversion: 2.1 time: 0.157190 Jul 28 10:57:21.751352 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 668/1360] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:57:21 2022] GET /compute/v2.1/servers/337984b5-a0a5-4703-a6e6-22dad12309db => generated 1338 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:57:21.773831 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-178fc110-b363-4f36-802c-3fab75a36b09 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:57:21.781765 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-178fc110-b363-4f36-802c-3fab75a36b09 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 337984b5-a0a5-4703-a6e6-22dad12309db] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:57:21.797603 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-178fc110-b363-4f36-802c-3fab75a36b09 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:21.798287 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-178fc110-b363-4f36-802c-3fab75a36b09 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:21.799640 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-178fc110-b363-4f36-802c-3fab75a36b09 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:21.800425 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-178fc110-b363-4f36-802c-3fab75a36b09 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:21.847709 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-178fc110-b363-4f36-802c-3fab75a36b09 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 337984b5-a0a5-4703-a6e6-22dad12309db] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:57:21.950662 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-178fc110-b363-4f36-802c-3fab75a36b09 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 337984b5-a0a5-4703-a6e6-22dad12309db] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:57:21.952392 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-178fc110-b363-4f36-802c-3fab75a36b09 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:21.953386 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-178fc110-b363-4f36-802c-3fab75a36b09 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:21.954119 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-178fc110-b363-4f36-802c-3fab75a36b09 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 337984b5-a0a5-4703-a6e6-22dad12309db] instance's host None is down, deleting from database Jul 28 10:57:21.960418 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-178fc110-b363-4f36-802c-3fab75a36b09 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 337984b5-a0a5-4703-a6e6-22dad12309db] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:57:22.007407 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-178fc110-b363-4f36-802c-3fab75a36b09 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 337984b5-a0a5-4703-a6e6-22dad12309db] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:57:22.015000 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-178fc110-b363-4f36-802c-3fab75a36b09 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 337984b5-a0a5-4703-a6e6-22dad12309db] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:57:22.206169 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-178fc110-b363-4f36-802c-3fab75a36b09 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "DELETE /compute/v2.1/servers/337984b5-a0a5-4703-a6e6-22dad12309db" status: 204 len: 0 microversion: 2.1 time: 0.443434 Jul 28 10:57:22.207381 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 693/1361] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:57:21 2022] DELETE /compute/v2.1/servers/337984b5-a0a5-4703-a6e6-22dad12309db => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:57:22.218109 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0524770c-0724-44c8-8d5d-317639e79378 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:57:22.218962 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-0524770c-0724-44c8-8d5d-317639e79378 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] [instance: 337984b5-a0a5-4703-a6e6-22dad12309db] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:57:22.228687 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0524770c-0724-44c8-8d5d-317639e79378 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:22.230572 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0524770c-0724-44c8-8d5d-317639e79378 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:22.232655 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0524770c-0724-44c8-8d5d-317639e79378 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:22.235240 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-0524770c-0724-44c8-8d5d-317639e79378 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:22.296075 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-0524770c-0724-44c8-8d5d-317639e79378 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] HTTP exception thrown: Instance 337984b5-a0a5-4703-a6e6-22dad12309db could not be found. Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0524770c-0724-44c8-8d5d-317639e79378 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Request method failure captured: Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/337984b5-a0a5-4703-a6e6-22dad12309db HTTP/1.1 Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mtGnupAuJ5j5VVzPxMY3PYDqviQA1aNv7Pr0q71i7lSV_87gsAUZzY0CTL7r2MT8sKILCAqUFFqnyRJcbrXhna11yi47ICSZNANzyIs7dWb7ss69rOD_j9oCQczDLQA_hwLqn4JSOJtAVy2QCPNvqojSbBVDL3ZjdW4vpk6wOShJ2Q Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: adcea96b79484f4da85e12a5a6243528 Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1268348461 Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/adcea96b79484f4da85e12a5a6243528"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/adcea96b79484f4da85e12a5a6243528"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/adcea96b79484f4da85e12a5a6243528"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_adcea96b79484f4da85e12a5a6243528", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1268348461 Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: adcea96b79484f4da85e12a5a6243528 Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1268348461 Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-TestNetworkAdvancedServerOps-1268348461-project Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: b552f6b83cc04054b15dc310b9d478e0 Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1268348461-project Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 337984b5-a0a5-4703-a6e6-22dad12309db could not be found. Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '337984b5-a0a5-4703-a6e6-22dad12309db'} Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337984b5-a0a5-4703-a6e6-22dad12309db could not be found. Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337984b5-a0a5-4703-a6e6-22dad12309db could not be found. Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:57:22.301064 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:57:22.305299 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:57:22.305299 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:57:22.305299 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:57:22.305299 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:57:22.305299 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:57:22.305299 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:57:22.305299 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337984b5-a0a5-4703-a6e6-22dad12309db could not be found. Jul 28 10:57:22.305299 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 10:57:22.311764 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0524770c-0724-44c8-8d5d-317639e79378 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Returning 404 to user: Instance 337984b5-a0a5-4703-a6e6-22dad12309db could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:57:22.312955 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-0524770c-0724-44c8-8d5d-317639e79378 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "GET /compute/v2.1/servers/337984b5-a0a5-4703-a6e6-22dad12309db" status: 404 len: 111 microversion: 2.1 time: 0.100643 Jul 28 10:57:22.314176 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 669/1362] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:57:22 2022] GET /compute/v2.1/servers/337984b5-a0a5-4703-a6e6-22dad12309db => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:57:26.486311 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e3937f79-3cd6-435f-813a-6d34bb0c0616 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] Calling method '.version_select at 0x7fa94b6ff1f0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:57:26.519823 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e3937f79-3cd6-435f-813a-6d34bb0c0616 tempest-TestNetworkAdvancedServerOps-1268348461 tempest-TestNetworkAdvancedServerOps-1268348461-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-86319139" status: 202 len: 0 microversion: 2.1 time: 0.037905 Jul 28 10:57:26.520419 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 694/1363] 10.222.0.46 () {58 vars in 1278 bytes} [Thu Jul 28 10:57:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-86319139 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:57:52.093461 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0de45805-747a-4922-9ac5-724ed0c6e1e4 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Action: 'create', calling method: .version_select at 0x7fa94b7993a0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-86968480", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3ng+ohQP3O4wsBhXF69czavVJJTDaVqEUftPpjWkeyRw6TpD3unGEO9Pk2CK6hb9HDMFMGFn/6EHO/UXX4aU6rNCiJ7GiSz0jPa141qayFleO0VBJW8sqx04/a+nAVTA=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:57:52.099319 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:52.099979 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=6 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:52.100625 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:52.101331 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=12 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:52.116434 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-0de45805-747a-4922-9ac5-724ed0c6e1e4 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Getting quotas for project 65d229c432a448bba052b4ee6d934b60. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:57:52.123533 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-0de45805-747a-4922-9ac5-724ed0c6e1e4 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Getting quotas for user a5f9a34e5e8f4dbfb5cd85de39fa7cd8 and project 65d229c432a448bba052b4ee6d934b60. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:57:52.148521 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-0de45805-747a-4922-9ac5-724ed0c6e1e4 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.058870 Jul 28 10:57:52.149131 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 670/1364] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:57:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:57:53.237823 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=12 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:53.238751 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:53.239482 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:57:53.243960 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-493361794", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c7222b33-d0c9-468b-be44-f66a0b7631eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-86968480", "security_groups": [{"name": "tempest-secgroup-smoke-960982759"}], "networks": [{"uuid": "33c3325e-1ec3-4574-b026-82cb069e6cec"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:57:53.366040 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] validate_networks() for [('33c3325e-1ec3-4574-b026-82cb069e6cec', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 10:57:53.750995 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:57:53.751442 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:57:53.751928 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:57:53.752333 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:57:53.752725 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:57:53.762694 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:53.763211 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:53.764193 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:53.764700 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:53.782084 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Getting quotas for project 65d229c432a448bba052b4ee6d934b60. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:57:53.787315 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Getting quotas for user a5f9a34e5e8f4dbfb5cd85de39fa7cd8 and project 65d229c432a448bba052b4ee6d934b60. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:57:53.857029 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 10:57:53.859070 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] [instance: 878a5fcb-023c-4f4f-8285-e2c9eeeb896e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c7222b33-d0c9-468b-be44-f66a0b7631eb',volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 10:57:53.990025 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-dfd7ce45-87e7-4fab-b111-74ae4dd098a2 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.752832 Jul 28 10:57:53.990878 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 695/1365] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 10:57:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:57:54.003193 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-0ed48792-048c-450a-9854-f40cd7b94686 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:57:54.003813 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-0ed48792-048c-450a-9854-f40cd7b94686 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] [instance: 878a5fcb-023c-4f4f-8285-e2c9eeeb896e] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:57:54.071797 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-0ed48792-048c-450a-9854-f40cd7b94686 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f9a34e5e8f4dbfb5cd85de39fa7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d229c432a448bba052b4ee6d934b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:57:54.079241 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-0ed48792-048c-450a-9854-f40cd7b94686 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] 10.222.0.46 "GET /compute/v2.1/servers/878a5fcb-023c-4f4f-8285-e2c9eeeb896e" status: 200 len: 1096 microversion: 2.1 time: 0.080559 Jul 28 10:57:54.082619 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 671/1366] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:57:53 2022] GET /compute/v2.1/servers/878a5fcb-023c-4f4f-8285-e2c9eeeb896e => generated 1096 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:57:55.104736 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c61b54d0-edaa-482e-9ecb-b4c8762dba41 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:57:55.105782 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-c61b54d0-edaa-482e-9ecb-b4c8762dba41 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] [instance: 878a5fcb-023c-4f4f-8285-e2c9eeeb896e] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:57:55.116360 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c61b54d0-edaa-482e-9ecb-b4c8762dba41 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:55.117236 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c61b54d0-edaa-482e-9ecb-b4c8762dba41 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:55.118635 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c61b54d0-edaa-482e-9ecb-b4c8762dba41 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:55.120209 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c61b54d0-edaa-482e-9ecb-b4c8762dba41 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:55.156657 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c61b54d0-edaa-482e-9ecb-b4c8762dba41 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:55.157105 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c61b54d0-edaa-482e-9ecb-b4c8762dba41 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:55.157552 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-c61b54d0-edaa-482e-9ecb-b4c8762dba41 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lazy-loading 'fault' on Instance uuid 878a5fcb-023c-4f4f-8285-e2c9eeeb896e {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 10:57:55.200235 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-c61b54d0-edaa-482e-9ecb-b4c8762dba41 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f9a34e5e8f4dbfb5cd85de39fa7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d229c432a448bba052b4ee6d934b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:57:55.207895 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c61b54d0-edaa-482e-9ecb-b4c8762dba41 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] 10.222.0.46 "GET /compute/v2.1/servers/878a5fcb-023c-4f4f-8285-e2c9eeeb896e" status: 200 len: 1215 microversion: 2.1 time: 0.110748 Jul 28 10:57:55.208462 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 696/1367] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:57:55 2022] GET /compute/v2.1/servers/878a5fcb-023c-4f4f-8285-e2c9eeeb896e => generated 1215 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:57:55.227516 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b4e999b4-b9b6-45a7-b16c-8c90df57c6b0 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:57:55.228427 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b4e999b4-b9b6-45a7-b16c-8c90df57c6b0 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] [instance: 878a5fcb-023c-4f4f-8285-e2c9eeeb896e] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:57:55.235075 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b4e999b4-b9b6-45a7-b16c-8c90df57c6b0 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:55.235619 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b4e999b4-b9b6-45a7-b16c-8c90df57c6b0 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:55.236451 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b4e999b4-b9b6-45a7-b16c-8c90df57c6b0 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:55.236951 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b4e999b4-b9b6-45a7-b16c-8c90df57c6b0 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:55.264006 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b4e999b4-b9b6-45a7-b16c-8c90df57c6b0 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] [instance: 878a5fcb-023c-4f4f-8285-e2c9eeeb896e] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 10:57:55.311794 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b4e999b4-b9b6-45a7-b16c-8c90df57c6b0 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] [instance: 878a5fcb-023c-4f4f-8285-e2c9eeeb896e] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 10:57:55.312634 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b4e999b4-b9b6-45a7-b16c-8c90df57c6b0 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:55.313135 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b4e999b4-b9b6-45a7-b16c-8c90df57c6b0 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:55.313593 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-b4e999b4-b9b6-45a7-b16c-8c90df57c6b0 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] [instance: 878a5fcb-023c-4f4f-8285-e2c9eeeb896e] instance's host None is down, deleting from database Jul 28 10:57:55.317099 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-b4e999b4-b9b6-45a7-b16c-8c90df57c6b0 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] [instance: 878a5fcb-023c-4f4f-8285-e2c9eeeb896e] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 10:57:55.351827 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-b4e999b4-b9b6-45a7-b16c-8c90df57c6b0 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] [instance: 878a5fcb-023c-4f4f-8285-e2c9eeeb896e] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 10:57:55.358754 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-b4e999b4-b9b6-45a7-b16c-8c90df57c6b0 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] [instance: 878a5fcb-023c-4f4f-8285-e2c9eeeb896e] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 10:57:55.596448 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b4e999b4-b9b6-45a7-b16c-8c90df57c6b0 tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] 10.222.0.46 "DELETE /compute/v2.1/servers/878a5fcb-023c-4f4f-8285-e2c9eeeb896e" status: 204 len: 0 microversion: 2.1 time: 0.372732 Jul 28 10:57:55.597203 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 672/1368] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 10:57:55 2022] DELETE /compute/v2.1/servers/878a5fcb-023c-4f4f-8285-e2c9eeeb896e => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:57:55.605432 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fc98e220-fec5-4962-b380-326e40b0a82e tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:57:55.606184 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-fc98e220-fec5-4962-b380-326e40b0a82e tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] [instance: 878a5fcb-023c-4f4f-8285-e2c9eeeb896e] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 10:57:55.612192 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fc98e220-fec5-4962-b380-326e40b0a82e tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:55.612643 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fc98e220-fec5-4962-b380-326e40b0a82e tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:55.613400 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fc98e220-fec5-4962-b380-326e40b0a82e tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:57:55.613834 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fc98e220-fec5-4962-b380-326e40b0a82e tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:57:55.627276 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-fc98e220-fec5-4962-b380-326e40b0a82e tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] HTTP exception thrown: Instance 878a5fcb-023c-4f4f-8285-e2c9eeeb896e could not be found. Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fc98e220-fec5-4962-b380-326e40b0a82e tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Request method failure captured: Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/878a5fcb-023c-4f4f-8285-e2c9eeeb896e HTTP/1.1 Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mr7EUuzFP2Anxy6JASIi962pr5DidGVS95g9SLt6fITl1QLZiTeNA2CktiDANXKf-ONysYQgaQMT9RrHYYLKiGm8ZDSgtiBPFUlEpVwS_Q2_-70be6iWbIutJwIEmHEKON6bkd2bRNuTHqVF-55vsh89CTQoV6PNGb63EtV7TBfh2k Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 65d229c432a448bba052b4ee6d934b60 Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-TestVolumeBackupRestore-973817122 Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/65d229c432a448bba052b4ee6d934b60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/65d229c432a448bba052b4ee6d934b60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/65d229c432a448bba052b4ee6d934b60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_65d229c432a448bba052b4ee6d934b60", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-TestVolumeBackupRestore-973817122 Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 65d229c432a448bba052b4ee6d934b60 Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-TestVolumeBackupRestore-973817122 Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-TestVolumeBackupRestore-973817122-project Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: a5f9a34e5e8f4dbfb5cd85de39fa7cd8 Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-TestVolumeBackupRestore-973817122-project Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 878a5fcb-023c-4f4f-8285-e2c9eeeb896e could not be found. Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '878a5fcb-023c-4f4f-8285-e2c9eeeb896e'} Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 878a5fcb-023c-4f4f-8285-e2c9eeeb896e could not be found. Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 878a5fcb-023c-4f4f-8285-e2c9eeeb896e could not be found. Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 10:57:55.628806 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:57:55.633265 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 10:57:55.633265 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 10:57:55.633265 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 10:57:55.633265 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 10:57:55.633265 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 10:57:55.633265 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 878a5fcb-023c-4f4f-8285-e2c9eeeb896e could not be found. Jul 28 10:57:55.633265 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 10:57:55.633265 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fc98e220-fec5-4962-b380-326e40b0a82e tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Returning 404 to user: Instance 878a5fcb-023c-4f4f-8285-e2c9eeeb896e could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 10:57:55.633265 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-fc98e220-fec5-4962-b380-326e40b0a82e tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] 10.222.0.46 "GET /compute/v2.1/servers/878a5fcb-023c-4f4f-8285-e2c9eeeb896e" status: 404 len: 111 microversion: 2.1 time: 0.028606 Jul 28 10:57:55.633265 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 697/1369] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 10:57:55 2022] GET /compute/v2.1/servers/878a5fcb-023c-4f4f-8285-e2c9eeeb896e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:57:55.802334 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f83b9d2f-e24b-478e-945e-1d618830a51d tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] Calling method '.version_select at 0x7fa94b799c10>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:57:55.827006 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f83b9d2f-e24b-478e-945e-1d618830a51d tempest-TestVolumeBackupRestore-973817122 tempest-TestVolumeBackupRestore-973817122-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-86968480" status: 202 len: 0 microversion: 2.1 time: 0.028450 Jul 28 10:57:55.828126 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 673/1370] 10.222.0.46 () {58 vars in 1263 bytes} [Thu Jul 28 10:57:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-86968480 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:58:46.360144 n-d-850468-6 devstack@n-api.service[119463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:58:46.360805 n-d-850468-6 devstack@n-api.service[119463]: Thu Jul 28 10:58:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 10:59:44.232432 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:59:44.233177 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=6 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:59:44.236295 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:59:44.237115 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=12 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:59:44.414179 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-872a8d5d-41f7-468c-97a7-a3ecda979545 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-448110050", "availability_zone": "foo_zone"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:59:44.437549 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:59:44.437549 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:59:44.438672 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.aggregate [None req-872a8d5d-41f7-468c-97a7-a3ecda979545 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] Generated uuid 4d74ff79-788d-42b1-9a65-df6272e9ede1 for aggregate {{(pid=119464) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 10:59:44.475429 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-872a8d5d-41f7-468c-97a7-a3ecda979545 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.244264 Jul 28 10:59:44.476415 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 698/1371] 10.222.0.46 () {60 vars in 1164 bytes} [Thu Jul 28 10:59:44 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:59:44.486593 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=6 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:59:44.488549 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:59:44.489193 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 10:59:44.497016 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5117032d-3db3-4ea6-8593-8697398b5665 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:59:44.500266 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:59:44.500266 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:59:44.528877 n-d-850468-6 devstack@n-api.service[119463]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5117032d-3db3-4ea6-8593-8697398b5665 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] [67c3cb6a-7a0d-4728-bdf2-ba7e3b15d95e] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 10:59:45.536186 n-d-850468-6 devstack@n-api.service[119463]: INFO oslo.messaging._drivers.impl_rabbit [None req-5117032d-3db3-4ea6-8593-8697398b5665 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] [67c3cb6a-7a0d-4728-bdf2-ba7e3b15d95e] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 56188. Jul 28 10:59:45.543640 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-5117032d-3db3-4ea6-8593-8697398b5665 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 1.059675 Jul 28 10:59:45.544434 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 674/1372] 10.222.0.46 () {60 vars in 1194 bytes} [Thu Jul 28 10:59:44 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:59:45.555257 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fb70d10a-bd5e-4458-ad71-323aad53bbe5 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:59:45.557897 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:59:45.557897 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:59:45.559140 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fb70d10a-bd5e-4458-ad71-323aad53bbe5 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:59:45.559596 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fb70d10a-bd5e-4458-ad71-323aad53bbe5 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:59:45.560399 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fb70d10a-bd5e-4458-ad71-323aad53bbe5 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:59:45.560844 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fb70d10a-bd5e-4458-ad71-323aad53bbe5 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:59:45.585051 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-fb70d10a-bd5e-4458-ad71-323aad53bbe5 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.033422 Jul 28 10:59:45.585692 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 699/1373] 10.222.0.46 () {58 vars in 1176 bytes} [Thu Jul 28 10:59:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:59:45.598331 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6fdfe1fb-88d7-48c8-97a2-4966938d7685 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:59:45.599152 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:59:45.599152 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:59:45.607489 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6fdfe1fb-88d7-48c8-97a2-4966938d7685 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.013359 Jul 28 10:59:45.608060 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 675/1374] 10.222.0.46 () {58 vars in 1143 bytes} [Thu Jul 28 10:59:45 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:59:45.619275 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c15f056d-d9c6-461c-8947-afc7afa888cf tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850468-6"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:59:45.622086 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:59:45.622086 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:59:45.629972 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c15f056d-d9c6-461c-8947-afc7afa888cf tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:59:45.630428 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-c15f056d-d9c6-461c-8947-afc7afa888cf tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:59:45.898265 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c15f056d-d9c6-461c-8947-afc7afa888cf tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.282882 Jul 28 10:59:45.898842 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 700/1375] 10.222.0.46 () {60 vars in 1194 bytes} [Thu Jul 28 10:59:45 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:59:45.910540 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-473c0775-b3a8-46f4-a902-c35da60b47f5 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:59:45.911287 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:59:45.911287 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:59:45.919218 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-473c0775-b3a8-46f4-a902-c35da60b47f5 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.012743 Jul 28 10:59:45.919756 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 676/1376] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:59:45 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:59:45.930295 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d282ddb7-c6d6-4469-89a2-48d597467053 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-490586064", "availability_zone": "foo_zone"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:59:46.006895 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:59:46.006895 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:59:46.049071 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-d282ddb7-c6d6-4469-89a2-48d597467053 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.121994 Jul 28 10:59:46.054004 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 701/1377] 10.222.0.46 () {60 vars in 1173 bytes} [Thu Jul 28 10:59:45 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:59:46.063404 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-438e3ca7-d4f9-4cc5-9f84-41168de1eec8 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:59:46.066242 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:59:46.066242 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:59:46.092973 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-438e3ca7-d4f9-4cc5-9f84-41168de1eec8 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.035700 Jul 28 10:59:46.093579 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 677/1378] 10.222.0.46 () {60 vars in 1194 bytes} [Thu Jul 28 10:59:46 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:59:46.104577 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-64d1146e-0e4d-4b9d-a8c4-9b0f8d499855 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:59:46.105334 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:59:46.105334 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:59:46.113236 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-64d1146e-0e4d-4b9d-a8c4-9b0f8d499855 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.012541 Jul 28 10:59:46.114146 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 702/1379] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jul 28 10:59:46 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:59:46.125443 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-74d5f8a3-3cc7-4ba5-8700-0f574f750dc3 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850468-6"}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:59:46.127993 n-d-850468-6 devstack@n-api.service[119463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:59:46.127993 n-d-850468-6 devstack@n-api.service[119463]: warnings.warn(msg) Jul 28 10:59:46.139887 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-74d5f8a3-3cc7-4ba5-8700-0f574f750dc3 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 10:59:46.140344 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-74d5f8a3-3cc7-4ba5-8700-0f574f750dc3 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 10:59:46.338584 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-74d5f8a3-3cc7-4ba5-8700-0f574f750dc3 tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.216819 Jul 28 10:59:46.339188 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 678/1380] 10.222.0.46 () {60 vars in 1194 bytes} [Thu Jul 28 10:59:46 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:59:46.350171 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0c8eca61-8fd6-4a7d-b7f2-46d01f8070de tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:59:46.350902 n-d-850468-6 devstack@n-api.service[119464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:59:46.350902 n-d-850468-6 devstack@n-api.service[119464]: warnings.warn(msg) Jul 28 10:59:46.380902 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0c8eca61-8fd6-4a7d-b7f2-46d01f8070de tempest-TestAggregatesBasicOps-1770598169 tempest-TestAggregatesBasicOps-1770598169-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.034376 Jul 28 10:59:46.381471 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 703/1381] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Jul 28 10:59:46 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 10:59:55.844489 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-21f0f65a-0452-44c0-b252-c3d24912c910 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Action: 'create', calling method: .version_select at 0x7fa94b82c8b0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-917075118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGi0aXmtYjMpMnh4hmBuQS3pwFbWUThfe7Fzq7RPV+rT/qCv5oHLcZ/7IzfAENd++0MS1SlzrdC9t/w4coAsJDmU4r1FCEdd0muZC8BDmeMyJzoOJ1VAyx/Co5GJKr7S6g=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:59:55.860400 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-21f0f65a-0452-44c0-b252-c3d24912c910 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Getting quotas for project 66eb3492213c4a789f2bf3a4ea1dc75f. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 10:59:55.865462 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-21f0f65a-0452-44c0-b252-c3d24912c910 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Getting quotas for user 3ea0e2f13a8d4f9c82c39cd60833c7e0 and project 66eb3492213c4a789f2bf3a4ea1dc75f. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 10:59:55.890194 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-21f0f65a-0452-44c0-b252-c3d24912c910 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.212062 Jul 28 10:59:55.890791 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 679/1382] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 10:59:55 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:00:01.320187 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:01.321481 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=6 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:01.322912 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:01.327330 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1676134534-access_point-1269794094", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "028ff153-18bf-4aa7-87c2-08dac82124cd"}], "key_name": "tempest-TestSecurityGroupsBasicOps-917075118", "security_groups": [{"name": "tempest-secgroup_access--2136290607"}, {"name": "tempest-secgroup_general--1904222930"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:00:01.515722 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] validate_networks() for [('028ff153-18bf-4aa7-87c2-08dac82124cd', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:00:01.968312 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:00:01.968961 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:00:01.969461 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:00:01.970161 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:00:01.970575 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:00:01.981839 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:01.982444 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:01.983287 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:01.983715 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:02.004766 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Getting quotas for project 66eb3492213c4a789f2bf3a4ea1dc75f. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:00:02.010161 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Getting quotas for user 3ea0e2f13a8d4f9c82c39cd60833c7e0 and project 66eb3492213c4a789f2bf3a4ea1dc75f. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:00:02.023465 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:00:02.026355 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.utils [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1676134534-access_point-1269794094 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1676134534-ac Jul 28 11:00:02.027072 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] [instance: 02e4dc94-7932-4b0b-a20a-e092f35f3ed0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:00:02.079456 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-2af8cbed-dc81-4540-9e1c-10b0f3f67b47 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 0.759961 Jul 28 11:00:02.085934 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 704/1383] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 11:00:01 2022] POST /compute/v2.1/servers => generated 458 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:00:02.089220 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:02.096569 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-14e2bd04-e294-477b-a833-020905d460f3 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:02.097291 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-14e2bd04-e294-477b-a833-020905d460f3 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] [instance: 02e4dc94-7932-4b0b-a20a-e092f35f3ed0] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:02.170108 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-14e2bd04-e294-477b-a833-020905d460f3 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ea0e2f13a8d4f9c82c39cd60833c7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66eb3492213c4a789f2bf3a4ea1dc75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:00:02.177538 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-14e2bd04-e294-477b-a833-020905d460f3 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] 10.222.0.46 "GET /compute/v2.1/servers/02e4dc94-7932-4b0b-a20a-e092f35f3ed0" status: 200 len: 1294 microversion: 2.1 time: 0.089122 Jul 28 11:00:02.178372 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 680/1384] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:00:02 2022] GET /compute/v2.1/servers/02e4dc94-7932-4b0b-a20a-e092f35f3ed0 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:00:03.199124 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-127b23bb-2158-4397-8b40-eccc89979bd9 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:03.199874 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-127b23bb-2158-4397-8b40-eccc89979bd9 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] [instance: 02e4dc94-7932-4b0b-a20a-e092f35f3ed0] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:03.254381 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-127b23bb-2158-4397-8b40-eccc89979bd9 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ea0e2f13a8d4f9c82c39cd60833c7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66eb3492213c4a789f2bf3a4ea1dc75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:00:03.262029 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-127b23bb-2158-4397-8b40-eccc89979bd9 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] 10.222.0.46 "GET /compute/v2.1/servers/02e4dc94-7932-4b0b-a20a-e092f35f3ed0" status: 200 len: 1294 microversion: 2.1 time: 0.066780 Jul 28 11:00:03.262617 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 705/1385] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:00:03 2022] GET /compute/v2.1/servers/02e4dc94-7932-4b0b-a20a-e092f35f3ed0 => generated 1294 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:00:04.283616 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-448ac178-26c9-40d0-ad5a-ad2642c6b8cc tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:04.284337 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-448ac178-26c9-40d0-ad5a-ad2642c6b8cc tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] [instance: 02e4dc94-7932-4b0b-a20a-e092f35f3ed0] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:04.292004 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-448ac178-26c9-40d0-ad5a-ad2642c6b8cc tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:04.292460 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-448ac178-26c9-40d0-ad5a-ad2642c6b8cc tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:04.293428 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-448ac178-26c9-40d0-ad5a-ad2642c6b8cc tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:04.294325 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-448ac178-26c9-40d0-ad5a-ad2642c6b8cc tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:04.357363 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-448ac178-26c9-40d0-ad5a-ad2642c6b8cc tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ea0e2f13a8d4f9c82c39cd60833c7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66eb3492213c4a789f2bf3a4ea1dc75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:00:04.364905 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-448ac178-26c9-40d0-ad5a-ad2642c6b8cc tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] 10.222.0.46 "GET /compute/v2.1/servers/02e4dc94-7932-4b0b-a20a-e092f35f3ed0" status: 200 len: 1294 microversion: 2.1 time: 0.086039 Jul 28 11:00:04.365478 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 681/1386] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:00:04 2022] GET /compute/v2.1/servers/02e4dc94-7932-4b0b-a20a-e092f35f3ed0 => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:00:05.386946 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5b1c75a6-9690-4503-af38-204f62872b2d tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:05.387558 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5b1c75a6-9690-4503-af38-204f62872b2d tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] [instance: 02e4dc94-7932-4b0b-a20a-e092f35f3ed0] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:05.393792 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5b1c75a6-9690-4503-af38-204f62872b2d tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:05.394276 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5b1c75a6-9690-4503-af38-204f62872b2d tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:05.395052 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5b1c75a6-9690-4503-af38-204f62872b2d tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:05.395494 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5b1c75a6-9690-4503-af38-204f62872b2d tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:05.425490 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5b1c75a6-9690-4503-af38-204f62872b2d tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:05.425981 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5b1c75a6-9690-4503-af38-204f62872b2d tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:05.426436 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-5b1c75a6-9690-4503-af38-204f62872b2d tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lazy-loading 'fault' on Instance uuid 02e4dc94-7932-4b0b-a20a-e092f35f3ed0 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:00:05.469473 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-5b1c75a6-9690-4503-af38-204f62872b2d tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ea0e2f13a8d4f9c82c39cd60833c7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66eb3492213c4a789f2bf3a4ea1dc75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:00:05.476987 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-5b1c75a6-9690-4503-af38-204f62872b2d tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] 10.222.0.46 "GET /compute/v2.1/servers/02e4dc94-7932-4b0b-a20a-e092f35f3ed0" status: 200 len: 1367 microversion: 2.1 time: 0.094580 Jul 28 11:00:05.477703 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 706/1387] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:00:05 2022] GET /compute/v2.1/servers/02e4dc94-7932-4b0b-a20a-e092f35f3ed0 => generated 1367 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:00:05.497238 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b6a50073-8096-43fe-a8ae-39f3abe57de4 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:05.497740 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b6a50073-8096-43fe-a8ae-39f3abe57de4 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] [instance: 02e4dc94-7932-4b0b-a20a-e092f35f3ed0] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:05.504511 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b6a50073-8096-43fe-a8ae-39f3abe57de4 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:05.504961 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b6a50073-8096-43fe-a8ae-39f3abe57de4 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:05.505724 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b6a50073-8096-43fe-a8ae-39f3abe57de4 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:05.506190 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b6a50073-8096-43fe-a8ae-39f3abe57de4 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:05.531396 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b6a50073-8096-43fe-a8ae-39f3abe57de4 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] [instance: 02e4dc94-7932-4b0b-a20a-e092f35f3ed0] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:00:05.578701 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b6a50073-8096-43fe-a8ae-39f3abe57de4 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] [instance: 02e4dc94-7932-4b0b-a20a-e092f35f3ed0] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 11:00:05.579492 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b6a50073-8096-43fe-a8ae-39f3abe57de4 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:05.579934 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b6a50073-8096-43fe-a8ae-39f3abe57de4 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:05.580362 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-b6a50073-8096-43fe-a8ae-39f3abe57de4 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] [instance: 02e4dc94-7932-4b0b-a20a-e092f35f3ed0] instance's host None is down, deleting from database Jul 28 11:00:05.584667 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-b6a50073-8096-43fe-a8ae-39f3abe57de4 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] [instance: 02e4dc94-7932-4b0b-a20a-e092f35f3ed0] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 11:00:05.624654 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-b6a50073-8096-43fe-a8ae-39f3abe57de4 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] [instance: 02e4dc94-7932-4b0b-a20a-e092f35f3ed0] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 11:00:05.631062 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-b6a50073-8096-43fe-a8ae-39f3abe57de4 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] [instance: 02e4dc94-7932-4b0b-a20a-e092f35f3ed0] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:00:05.775180 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b6a50073-8096-43fe-a8ae-39f3abe57de4 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] 10.222.0.46 "DELETE /compute/v2.1/servers/02e4dc94-7932-4b0b-a20a-e092f35f3ed0" status: 204 len: 0 microversion: 2.1 time: 0.281608 Jul 28 11:00:05.775816 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 682/1388] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 11:00:05 2022] DELETE /compute/v2.1/servers/02e4dc94-7932-4b0b-a20a-e092f35f3ed0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:00:05.784993 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-14d82d55-da0f-4324-9db4-c8f9588dd1e8 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:05.785612 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-14d82d55-da0f-4324-9db4-c8f9588dd1e8 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] [instance: 02e4dc94-7932-4b0b-a20a-e092f35f3ed0] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:05.791835 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-14d82d55-da0f-4324-9db4-c8f9588dd1e8 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:05.792296 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-14d82d55-da0f-4324-9db4-c8f9588dd1e8 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:05.793075 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-14d82d55-da0f-4324-9db4-c8f9588dd1e8 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:05.793520 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-14d82d55-da0f-4324-9db4-c8f9588dd1e8 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:05.807048 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-14d82d55-da0f-4324-9db4-c8f9588dd1e8 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] HTTP exception thrown: Instance 02e4dc94-7932-4b0b-a20a-e092f35f3ed0 could not be found. Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-14d82d55-da0f-4324-9db4-c8f9588dd1e8 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Request method failure captured: Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/02e4dc94-7932-4b0b-a20a-e092f35f3ed0 HTTP/1.1 Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mwqPuOkjKEN7BxsyVeDXeRYviGFYPsMXS6FsKJPTgM_wmNgbYLC86WYbKDZfe3NUJWunHQ73OvGiIE8KYPgGMzdKg1iZlQhA9-oRaiLAqlRgmVanrW_RFcgxgXlZXsWNGBDmG7q0nGCJXiwfwsMZs_zWwaEYNSLy2l5spqgDGW8DXY Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 66eb3492213c4a789f2bf3a4ea1dc75f Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1676134534 Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/66eb3492213c4a789f2bf3a4ea1dc75f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66eb3492213c4a789f2bf3a4ea1dc75f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66eb3492213c4a789f2bf3a4ea1dc75f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_66eb3492213c4a789f2bf3a4ea1dc75f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1676134534 Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 66eb3492213c4a789f2bf3a4ea1dc75f Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1676134534 Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-TestSecurityGroupsBasicOps-1676134534-project Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 3ea0e2f13a8d4f9c82c39cd60833c7e0 Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1676134534-project Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 02e4dc94-7932-4b0b-a20a-e092f35f3ed0 could not be found. Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '02e4dc94-7932-4b0b-a20a-e092f35f3ed0'} Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02e4dc94-7932-4b0b-a20a-e092f35f3ed0 could not be found. Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02e4dc94-7932-4b0b-a20a-e092f35f3ed0 could not be found. Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:00:05.808597 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:00:05.812596 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:00:05.812596 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:00:05.812596 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:00:05.812596 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:00:05.812596 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:00:05.812596 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02e4dc94-7932-4b0b-a20a-e092f35f3ed0 could not be found. Jul 28 11:00:05.812596 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:00:05.812596 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-14d82d55-da0f-4324-9db4-c8f9588dd1e8 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Returning 404 to user: Instance 02e4dc94-7932-4b0b-a20a-e092f35f3ed0 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:00:05.812596 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-14d82d55-da0f-4324-9db4-c8f9588dd1e8 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] 10.222.0.46 "GET /compute/v2.1/servers/02e4dc94-7932-4b0b-a20a-e092f35f3ed0" status: 404 len: 111 microversion: 2.1 time: 0.029121 Jul 28 11:00:05.812596 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 707/1389] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:00:05 2022] GET /compute/v2.1/servers/02e4dc94-7932-4b0b-a20a-e092f35f3ed0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:00:08.907395 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-bafef490-6962-4378-a366-0122d6595fc1 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] Calling method '.version_select at 0x7fa94b7bbe50>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:08.927826 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-bafef490-6962-4378-a366-0122d6595fc1 tempest-TestSecurityGroupsBasicOps-1676134534 tempest-TestSecurityGroupsBasicOps-1676134534-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-917075118" status: 202 len: 0 microversion: 2.1 time: 0.024825 Jul 28 11:00:08.928399 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 683/1390] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Jul 28 11:00:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-917075118 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:00:19.785384 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:19.786280 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=8 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:19.786954 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:19.787561 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=12 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:19.903684 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-608795335", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452"}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:00:19.954574 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] validate_networks() for None {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:00:20.228153 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:00:20.228575 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:00:20.229052 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:00:20.229461 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:00:20.229952 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:00:20.238671 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:20.239119 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:20.239921 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:20.240366 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:20.257955 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Getting quotas for project 19934e6b4bd84ea0a7fbc3c07dd5ecc1. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:00:20.263144 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Getting quotas for user 0f2c7f4d8fdc4870a7f40f01a629656d and project 19934e6b4bd84ea0a7fbc3c07dd5ecc1. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:00:20.275445 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:00:20.277522 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] [instance: ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:00:20.327613 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ede5c8e2-df78-4b6f-99de-1dc3b3ecd463 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546912 Jul 28 11:00:20.328245 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 708/1391] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 11:00:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:00:20.337842 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=6 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:20.338733 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=30,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:20.339351 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:20.343400 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7cf783f6-6ccc-48de-a460-edc8641df829 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:20.344016 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-7cf783f6-6ccc-48de-a460-edc8641df829 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] [instance: ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:20.404246 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-7cf783f6-6ccc-48de-a460-edc8641df829 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2c7f4d8fdc4870a7f40f01a629656d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19934e6b4bd84ea0a7fbc3c07dd5ecc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:00:20.414996 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-7cf783f6-6ccc-48de-a460-edc8641df829 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] 10.222.0.46 "GET /compute/v2.1/servers/ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f" status: 200 len: 1221 microversion: 2.1 time: 0.074872 Jul 28 11:00:20.418801 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 684/1392] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:00:20 2022] GET /compute/v2.1/servers/ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f => generated 1221 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:00:21.432246 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-03b117f4-8967-4b14-b915-161f9a592937 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:21.432859 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-03b117f4-8967-4b14-b915-161f9a592937 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] [instance: ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:21.439036 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-03b117f4-8967-4b14-b915-161f9a592937 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:21.439490 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-03b117f4-8967-4b14-b915-161f9a592937 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:21.440258 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-03b117f4-8967-4b14-b915-161f9a592937 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:21.440699 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-03b117f4-8967-4b14-b915-161f9a592937 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:21.471457 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-03b117f4-8967-4b14-b915-161f9a592937 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:21.471910 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-03b117f4-8967-4b14-b915-161f9a592937 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:21.472366 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-03b117f4-8967-4b14-b915-161f9a592937 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lazy-loading 'fault' on Instance uuid ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:00:21.516657 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-03b117f4-8967-4b14-b915-161f9a592937 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2c7f4d8fdc4870a7f40f01a629656d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19934e6b4bd84ea0a7fbc3c07dd5ecc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:00:21.524115 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-03b117f4-8967-4b14-b915-161f9a592937 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] 10.222.0.46 "GET /compute/v2.1/servers/ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f" status: 200 len: 1294 microversion: 2.1 time: 0.096335 Jul 28 11:00:21.524674 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 709/1393] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:00:21 2022] GET /compute/v2.1/servers/ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f => generated 1294 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:00:21.545087 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-70e61548-f3bf-4b35-9e95-d7e8eeb00f5a tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:21.545563 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-70e61548-f3bf-4b35-9e95-d7e8eeb00f5a tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] [instance: ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:21.552079 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-70e61548-f3bf-4b35-9e95-d7e8eeb00f5a tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:21.552536 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-70e61548-f3bf-4b35-9e95-d7e8eeb00f5a tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:21.553308 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-70e61548-f3bf-4b35-9e95-d7e8eeb00f5a tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:21.553752 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-70e61548-f3bf-4b35-9e95-d7e8eeb00f5a tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:21.579689 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-70e61548-f3bf-4b35-9e95-d7e8eeb00f5a tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] [instance: ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:00:21.629170 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-70e61548-f3bf-4b35-9e95-d7e8eeb00f5a tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] [instance: ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 11:00:21.629998 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-70e61548-f3bf-4b35-9e95-d7e8eeb00f5a tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:21.630435 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-70e61548-f3bf-4b35-9e95-d7e8eeb00f5a tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:21.630863 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-70e61548-f3bf-4b35-9e95-d7e8eeb00f5a tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] [instance: ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f] instance's host None is down, deleting from database Jul 28 11:00:21.635344 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-70e61548-f3bf-4b35-9e95-d7e8eeb00f5a tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] [instance: ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 11:00:21.673548 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-70e61548-f3bf-4b35-9e95-d7e8eeb00f5a tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] [instance: ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 11:00:21.680136 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-70e61548-f3bf-4b35-9e95-d7e8eeb00f5a tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] [instance: ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:00:21.830073 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-70e61548-f3bf-4b35-9e95-d7e8eeb00f5a tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f" status: 204 len: 0 microversion: 2.1 time: 0.288782 Jul 28 11:00:21.830663 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 685/1394] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 11:00:21 2022] DELETE /compute/v2.1/servers/ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:00:21.839209 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d791de0a-2203-4521-9d6c-74ec4856c277 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:21.839828 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-d791de0a-2203-4521-9d6c-74ec4856c277 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] [instance: ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:21.845991 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d791de0a-2203-4521-9d6c-74ec4856c277 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:21.846449 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d791de0a-2203-4521-9d6c-74ec4856c277 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:21.847219 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d791de0a-2203-4521-9d6c-74ec4856c277 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:21.847659 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-d791de0a-2203-4521-9d6c-74ec4856c277 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:21.860542 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-d791de0a-2203-4521-9d6c-74ec4856c277 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] HTTP exception thrown: Instance ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f could not be found. Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d791de0a-2203-4521-9d6c-74ec4856c277 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Request method failure captured: Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f HTTP/1.1 Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mxDoru7rDWfop_TTtmS3MkGo62nZFkK1Wkh1RIs8SIC4VQbkKrqKmDddg62E-pHBkjQ818R_jG6JKZkzRsJmf_7qd-Y0KDcbVhz1SiUUXHYN6GRqCFbqO7rAAft_Lbem0AGQixK_AKiiIoIB62-VHODqrdUvDj03jUX48MdzNS9K38 Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 19934e6b4bd84ea0a7fbc3c07dd5ecc1 Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2077748899 Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/19934e6b4bd84ea0a7fbc3c07dd5ecc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/19934e6b4bd84ea0a7fbc3c07dd5ecc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/19934e6b4bd84ea0a7fbc3c07dd5ecc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_19934e6b4bd84ea0a7fbc3c07dd5ecc1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2077748899 Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 19934e6b4bd84ea0a7fbc3c07dd5ecc1 Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2077748899 Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ServersAdminNegativeTestJSON-2077748899-project Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 0f2c7f4d8fdc4870a7f40f01a629656d Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2077748899-project Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f could not be found. Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f'} Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f could not be found. Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f could not be found. Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:00:21.862089 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:00:21.870694 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:00:21.870694 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:00:21.870694 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:00:21.870694 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:00:21.870694 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:00:21.870694 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:00:21.870694 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f could not be found. Jul 28 11:00:21.870694 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:00:21.870694 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d791de0a-2203-4521-9d6c-74ec4856c277 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] Returning 404 to user: Instance ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:00:21.870694 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-d791de0a-2203-4521-9d6c-74ec4856c277 tempest-ServersAdminNegativeTestJSON-2077748899 tempest-ServersAdminNegativeTestJSON-2077748899-project] 10.222.0.46 "GET /compute/v2.1/servers/ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f" status: 404 len: 111 microversion: 2.1 time: 0.028702 Jul 28 11:00:21.870694 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 710/1395] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:00:21 2022] GET /compute/v2.1/servers/ba0e81e7-7153-4d5c-b333-2e4cb1a1ca1f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:00:28.227630 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1097372498", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "62fb2094-cd90-4df7-a700-d0ce33f5d7c7"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:00:28.281298 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] validate_networks() for [('62fb2094-cd90-4df7-a700-d0ce33f5d7c7', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:00:28.727386 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:00:28.727801 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:00:28.728273 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:00:28.728675 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:00:28.729080 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:00:28.737652 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:28.738126 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:28.738919 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:28.739351 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:28.755887 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Getting quotas for project 107572b0ee5d48109c0d2dab34655cc5. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:00:28.761796 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Getting quotas for user 92e3627e2d9d4cab8a85340ef2f0d5b9 and project 107572b0ee5d48109c0d2dab34655cc5. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:00:28.775444 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:00:28.777599 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] [instance: a67a88e0-1ab7-41f5-b446-28afcc7e4541] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:00:28.828731 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f0ac6952-6efa-4eab-bcdf-a0f4b56de5ae tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.737478 Jul 28 11:00:28.832958 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 686/1396] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 11:00:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:00:28.840946 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0ffb6164-6893-4293-b49b-e7870bd3cda4 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:28.841568 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0ffb6164-6893-4293-b49b-e7870bd3cda4 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] [instance: a67a88e0-1ab7-41f5-b446-28afcc7e4541] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:28.899675 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-0ffb6164-6893-4293-b49b-e7870bd3cda4 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e3627e2d9d4cab8a85340ef2f0d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107572b0ee5d48109c0d2dab34655cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:00:28.906888 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0ffb6164-6893-4293-b49b-e7870bd3cda4 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] 10.222.0.46 "GET /compute/v2.1/servers/a67a88e0-1ab7-41f5-b446-28afcc7e4541" status: 200 len: 1215 microversion: 2.1 time: 0.070100 Jul 28 11:00:28.908404 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 711/1397] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:00:28 2022] GET /compute/v2.1/servers/a67a88e0-1ab7-41f5-b446-28afcc7e4541 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:00:29.929255 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f5233855-74e1-45ca-a6eb-be8ee5ac4e80 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:29.930136 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f5233855-74e1-45ca-a6eb-be8ee5ac4e80 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] [instance: a67a88e0-1ab7-41f5-b446-28afcc7e4541] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:29.936392 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f5233855-74e1-45ca-a6eb-be8ee5ac4e80 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:29.936832 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f5233855-74e1-45ca-a6eb-be8ee5ac4e80 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:29.937793 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f5233855-74e1-45ca-a6eb-be8ee5ac4e80 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:29.938259 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f5233855-74e1-45ca-a6eb-be8ee5ac4e80 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:29.973425 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f5233855-74e1-45ca-a6eb-be8ee5ac4e80 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:29.973884 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f5233855-74e1-45ca-a6eb-be8ee5ac4e80 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:29.974360 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-f5233855-74e1-45ca-a6eb-be8ee5ac4e80 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lazy-loading 'fault' on Instance uuid a67a88e0-1ab7-41f5-b446-28afcc7e4541 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:00:30.040186 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-f5233855-74e1-45ca-a6eb-be8ee5ac4e80 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e3627e2d9d4cab8a85340ef2f0d5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107572b0ee5d48109c0d2dab34655cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:00:30.048804 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f5233855-74e1-45ca-a6eb-be8ee5ac4e80 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] 10.222.0.46 "GET /compute/v2.1/servers/a67a88e0-1ab7-41f5-b446-28afcc7e4541" status: 200 len: 1288 microversion: 2.1 time: 0.123874 Jul 28 11:00:30.049786 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 687/1398] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:00:29 2022] GET /compute/v2.1/servers/a67a88e0-1ab7-41f5-b446-28afcc7e4541 => generated 1288 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:00:30.081213 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b50304b2-c0ea-4f16-aec5-0ea995531ce8 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:30.081754 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b50304b2-c0ea-4f16-aec5-0ea995531ce8 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] [instance: a67a88e0-1ab7-41f5-b446-28afcc7e4541] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:30.090528 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b50304b2-c0ea-4f16-aec5-0ea995531ce8 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:30.090988 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b50304b2-c0ea-4f16-aec5-0ea995531ce8 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:30.091778 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b50304b2-c0ea-4f16-aec5-0ea995531ce8 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:30.092222 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b50304b2-c0ea-4f16-aec5-0ea995531ce8 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:30.123095 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b50304b2-c0ea-4f16-aec5-0ea995531ce8 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] [instance: a67a88e0-1ab7-41f5-b446-28afcc7e4541] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:00:30.193161 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b50304b2-c0ea-4f16-aec5-0ea995531ce8 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] [instance: a67a88e0-1ab7-41f5-b446-28afcc7e4541] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 11:00:30.194497 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b50304b2-c0ea-4f16-aec5-0ea995531ce8 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:30.195823 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b50304b2-c0ea-4f16-aec5-0ea995531ce8 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:30.196793 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-b50304b2-c0ea-4f16-aec5-0ea995531ce8 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] [instance: a67a88e0-1ab7-41f5-b446-28afcc7e4541] instance's host None is down, deleting from database Jul 28 11:00:30.202830 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-b50304b2-c0ea-4f16-aec5-0ea995531ce8 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] [instance: a67a88e0-1ab7-41f5-b446-28afcc7e4541] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 11:00:30.246007 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-b50304b2-c0ea-4f16-aec5-0ea995531ce8 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] [instance: a67a88e0-1ab7-41f5-b446-28afcc7e4541] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 11:00:30.249574 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:30.254572 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-b50304b2-c0ea-4f16-aec5-0ea995531ce8 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] [instance: a67a88e0-1ab7-41f5-b446-28afcc7e4541] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:00:30.625009 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b50304b2-c0ea-4f16-aec5-0ea995531ce8 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a67a88e0-1ab7-41f5-b446-28afcc7e4541" status: 204 len: 0 microversion: 2.1 time: 0.559602 Jul 28 11:00:30.626998 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 712/1399] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 11:00:30 2022] DELETE /compute/v2.1/servers/a67a88e0-1ab7-41f5-b446-28afcc7e4541 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:00:30.635184 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d71ddfac-663c-40c5-b588-9543d0fe7887 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:30.635795 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-d71ddfac-663c-40c5-b588-9543d0fe7887 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] [instance: a67a88e0-1ab7-41f5-b446-28afcc7e4541] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:30.642711 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d71ddfac-663c-40c5-b588-9543d0fe7887 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:30.643420 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d71ddfac-663c-40c5-b588-9543d0fe7887 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:30.644363 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d71ddfac-663c-40c5-b588-9543d0fe7887 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:30.644946 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-d71ddfac-663c-40c5-b588-9543d0fe7887 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:30.665477 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-d71ddfac-663c-40c5-b588-9543d0fe7887 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] HTTP exception thrown: Instance a67a88e0-1ab7-41f5-b446-28afcc7e4541 could not be found. Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d71ddfac-663c-40c5-b588-9543d0fe7887 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Request method failure captured: Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/a67a88e0-1ab7-41f5-b446-28afcc7e4541 HTTP/1.1 Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mxL4TaSWq038N5vOfX9wyWN01z8uq-H2NHcupDBmJJr-vCyrvafuTO6RjUakTwFiAbUYzrNhZ4sZxkQUKn76JfE64RUdVATPUAH34YO6E5-lThRBff4VkSkLpe0RH-ouDoFAt3InvrSPwYxkn1RAzUKb5xL5hCaIB7_r8D4JEVJUVk Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 107572b0ee5d48109c0d2dab34655cc5 Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-DeleteServersTestJSON-1160596369 Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/107572b0ee5d48109c0d2dab34655cc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/107572b0ee5d48109c0d2dab34655cc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/107572b0ee5d48109c0d2dab34655cc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_107572b0ee5d48109c0d2dab34655cc5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-DeleteServersTestJSON-1160596369 Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 107572b0ee5d48109c0d2dab34655cc5 Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-DeleteServersTestJSON-1160596369 Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-DeleteServersTestJSON-1160596369-project Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 92e3627e2d9d4cab8a85340ef2f0d5b9 Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-DeleteServersTestJSON-1160596369-project Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance a67a88e0-1ab7-41f5-b446-28afcc7e4541 could not be found. Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'a67a88e0-1ab7-41f5-b446-28afcc7e4541'} Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a67a88e0-1ab7-41f5-b446-28afcc7e4541 could not be found. Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a67a88e0-1ab7-41f5-b446-28afcc7e4541 could not be found. Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:00:30.667198 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:00:30.672008 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:00:30.672008 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:00:30.672008 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:00:30.672008 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:00:30.672008 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:00:30.672008 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a67a88e0-1ab7-41f5-b446-28afcc7e4541 could not be found. Jul 28 11:00:30.672008 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:00:30.672008 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d71ddfac-663c-40c5-b588-9543d0fe7887 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] Returning 404 to user: Instance a67a88e0-1ab7-41f5-b446-28afcc7e4541 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:00:30.672008 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d71ddfac-663c-40c5-b588-9543d0fe7887 tempest-DeleteServersTestJSON-1160596369 tempest-DeleteServersTestJSON-1160596369-project] 10.222.0.46 "GET /compute/v2.1/servers/a67a88e0-1ab7-41f5-b446-28afcc7e4541" status: 404 len: 111 microversion: 2.1 time: 0.038173 Jul 28 11:00:30.672008 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 688/1400] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:00:30 2022] GET /compute/v2.1/servers/a67a88e0-1ab7-41f5-b446-28afcc7e4541 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:00:39.521755 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=8 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:39.658880 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-655846284", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "78d42a4d-b45a-45ec-b262-2b711f90f254"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:00:39.733046 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] validate_networks() for [('78d42a4d-b45a-45ec-b262-2b711f90f254', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:00:40.125489 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:00:40.126171 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:00:40.126823 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:00:40.127764 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:00:40.128468 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:00:40.140050 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:40.141302 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:40.141302 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:40.142953 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:40.164674 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Getting quotas for project 5f36552f494e4757a3bf42ffeaebd0b4. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:00:40.170237 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Getting quotas for user 9be167a79b9643fc88e9aee96caa74ed and project 5f36552f494e4757a3bf42ffeaebd0b4. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:00:40.182934 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:00:40.185048 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: d78e6ac2-eca7-47df-9dd1-edb24b1ba48c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:00:40.232974 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1fe59e62-1765-46bb-9969-324903ddaaa4 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711908 Jul 28 11:00:40.234422 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 713/1401] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 11:00:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:00:40.248447 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4e5768c4-8c43-4ca1-8ae6-6757c1647b89 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:40.261391 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-4e5768c4-8c43-4ca1-8ae6-6757c1647b89 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: d78e6ac2-eca7-47df-9dd1-edb24b1ba48c] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:40.263980 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:40.264808 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=8 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:40.333015 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-4e5768c4-8c43-4ca1-8ae6-6757c1647b89 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be167a79b9643fc88e9aee96caa74ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f36552f494e4757a3bf42ffeaebd0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:00:40.342101 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-4e5768c4-8c43-4ca1-8ae6-6757c1647b89 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] 10.222.0.46 "GET /compute/v2.1/servers/d78e6ac2-eca7-47df-9dd1-edb24b1ba48c" status: 200 len: 1217 microversion: 2.1 time: 0.101282 Jul 28 11:00:40.343150 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 689/1402] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:00:40 2022] GET /compute/v2.1/servers/d78e6ac2-eca7-47df-9dd1-edb24b1ba48c => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:00:41.364532 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9907bc2f-72f7-4cd4-9523-472950196719 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:41.365069 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-9907bc2f-72f7-4cd4-9523-472950196719 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: d78e6ac2-eca7-47df-9dd1-edb24b1ba48c] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:41.371395 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9907bc2f-72f7-4cd4-9523-472950196719 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:41.371876 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9907bc2f-72f7-4cd4-9523-472950196719 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:41.372643 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9907bc2f-72f7-4cd4-9523-472950196719 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:41.373077 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9907bc2f-72f7-4cd4-9523-472950196719 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:41.404833 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9907bc2f-72f7-4cd4-9523-472950196719 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:41.405184 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9907bc2f-72f7-4cd4-9523-472950196719 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:41.405850 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-9907bc2f-72f7-4cd4-9523-472950196719 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lazy-loading 'fault' on Instance uuid d78e6ac2-eca7-47df-9dd1-edb24b1ba48c {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:00:41.448059 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-9907bc2f-72f7-4cd4-9523-472950196719 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be167a79b9643fc88e9aee96caa74ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f36552f494e4757a3bf42ffeaebd0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:00:41.455540 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9907bc2f-72f7-4cd4-9523-472950196719 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] 10.222.0.46 "GET /compute/v2.1/servers/d78e6ac2-eca7-47df-9dd1-edb24b1ba48c" status: 200 len: 1290 microversion: 2.1 time: 0.094978 Jul 28 11:00:41.456106 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 714/1403] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:00:41 2022] GET /compute/v2.1/servers/d78e6ac2-eca7-47df-9dd1-edb24b1ba48c => generated 1290 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:00:41.476277 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-90edc0cf-0480-4a0d-803e-0c7ee04831b2 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:41.476813 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-90edc0cf-0480-4a0d-803e-0c7ee04831b2 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: d78e6ac2-eca7-47df-9dd1-edb24b1ba48c] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:41.478630 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=36,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:41.485878 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-90edc0cf-0480-4a0d-803e-0c7ee04831b2 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:41.486327 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-90edc0cf-0480-4a0d-803e-0c7ee04831b2 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:41.487104 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-90edc0cf-0480-4a0d-803e-0c7ee04831b2 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:41.487548 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-90edc0cf-0480-4a0d-803e-0c7ee04831b2 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:41.513547 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-90edc0cf-0480-4a0d-803e-0c7ee04831b2 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: d78e6ac2-eca7-47df-9dd1-edb24b1ba48c] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:00:41.571406 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-90edc0cf-0480-4a0d-803e-0c7ee04831b2 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: d78e6ac2-eca7-47df-9dd1-edb24b1ba48c] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 11:00:41.572258 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-90edc0cf-0480-4a0d-803e-0c7ee04831b2 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:41.572711 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-90edc0cf-0480-4a0d-803e-0c7ee04831b2 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:41.573153 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-90edc0cf-0480-4a0d-803e-0c7ee04831b2 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: d78e6ac2-eca7-47df-9dd1-edb24b1ba48c] instance's host None is down, deleting from database Jul 28 11:00:41.582923 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-90edc0cf-0480-4a0d-803e-0c7ee04831b2 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: d78e6ac2-eca7-47df-9dd1-edb24b1ba48c] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 11:00:41.626858 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-90edc0cf-0480-4a0d-803e-0c7ee04831b2 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: d78e6ac2-eca7-47df-9dd1-edb24b1ba48c] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 11:00:41.634401 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-90edc0cf-0480-4a0d-803e-0c7ee04831b2 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: d78e6ac2-eca7-47df-9dd1-edb24b1ba48c] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:00:41.805223 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-90edc0cf-0480-4a0d-803e-0c7ee04831b2 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d78e6ac2-eca7-47df-9dd1-edb24b1ba48c" status: 204 len: 0 microversion: 2.1 time: 0.333021 Jul 28 11:00:41.806302 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 690/1404] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 11:00:41 2022] DELETE /compute/v2.1/servers/d78e6ac2-eca7-47df-9dd1-edb24b1ba48c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:00:41.820434 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-df21b3f4-2bba-4e69-8ab4-9901daddfd4e tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:41.821126 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-df21b3f4-2bba-4e69-8ab4-9901daddfd4e tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: d78e6ac2-eca7-47df-9dd1-edb24b1ba48c] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:41.827518 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-df21b3f4-2bba-4e69-8ab4-9901daddfd4e tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:41.828258 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-df21b3f4-2bba-4e69-8ab4-9901daddfd4e tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:41.829130 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-df21b3f4-2bba-4e69-8ab4-9901daddfd4e tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:41.829659 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-df21b3f4-2bba-4e69-8ab4-9901daddfd4e tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:41.845317 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-df21b3f4-2bba-4e69-8ab4-9901daddfd4e tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] HTTP exception thrown: Instance d78e6ac2-eca7-47df-9dd1-edb24b1ba48c could not be found. Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-df21b3f4-2bba-4e69-8ab4-9901daddfd4e tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Request method failure captured: Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/d78e6ac2-eca7-47df-9dd1-edb24b1ba48c HTTP/1.1 Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mxXSfN5aGhhgygFWJV2C_CUBrOQ_kP0MKfnRVO-a1cMr-k1-xGrFcqBdW2R9nE09IIqdBGJRQtO-hM0ZMLInQsg5UqxBocrGOkoXwrgr4mP5vJ1BzCFIcLjRuHgMqDbSlIMT4kG5nWyGUxqPqJVg2RXbslHkIQKcUxUkIyw35EBIns Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 5f36552f494e4757a3bf42ffeaebd0b4 Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1506053042 Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5f36552f494e4757a3bf42ffeaebd0b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5f36552f494e4757a3bf42ffeaebd0b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5f36552f494e4757a3bf42ffeaebd0b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5f36552f494e4757a3bf42ffeaebd0b4", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-ServerDiskConfigTestJSON-1506053042 Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 5f36552f494e4757a3bf42ffeaebd0b4 Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1506053042 Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-ServerDiskConfigTestJSON-1506053042-project Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 9be167a79b9643fc88e9aee96caa74ed Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-ServerDiskConfigTestJSON-1506053042-project Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance d78e6ac2-eca7-47df-9dd1-edb24b1ba48c could not be found. Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'd78e6ac2-eca7-47df-9dd1-edb24b1ba48c'} Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d78e6ac2-eca7-47df-9dd1-edb24b1ba48c could not be found. Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d78e6ac2-eca7-47df-9dd1-edb24b1ba48c could not be found. Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:00:41.846994 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:00:41.852486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:00:41.852486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:00:41.852486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:00:41.852486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:00:41.852486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:00:41.852486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d78e6ac2-eca7-47df-9dd1-edb24b1ba48c could not be found. Jul 28 11:00:41.852486 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:00:41.852486 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-df21b3f4-2bba-4e69-8ab4-9901daddfd4e tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Returning 404 to user: Instance d78e6ac2-eca7-47df-9dd1-edb24b1ba48c could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:00:41.852486 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-df21b3f4-2bba-4e69-8ab4-9901daddfd4e tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] 10.222.0.46 "GET /compute/v2.1/servers/d78e6ac2-eca7-47df-9dd1-edb24b1ba48c" status: 404 len: 111 microversion: 2.1 time: 0.034275 Jul 28 11:00:41.853134 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 715/1405] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:00:41 2022] GET /compute/v2.1/servers/d78e6ac2-eca7-47df-9dd1-edb24b1ba48c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:00:41.909740 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1700447998", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "78d42a4d-b45a-45ec-b262-2b711f90f254"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:00:41.968733 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] validate_networks() for [('78d42a4d-b45a-45ec-b262-2b711f90f254', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:00:42.372811 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:00:42.373149 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:00:42.373624 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:00:42.374056 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:00:42.374466 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:00:42.384765 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:42.385218 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:42.386042 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:42.386725 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:42.408796 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Getting quotas for project 5f36552f494e4757a3bf42ffeaebd0b4. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:00:42.416938 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Getting quotas for user 9be167a79b9643fc88e9aee96caa74ed and project 5f36552f494e4757a3bf42ffeaebd0b4. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:00:42.435667 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:00:42.438026 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: 399b579a-0f43-4611-8a9f-9075890edc1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:00:42.499011 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3b5a739c-a5f8-46a9-9ced-0ea8dadb96f1 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593398 Jul 28 11:00:42.500346 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 691/1406] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 11:00:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 11:00:42.513509 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-d48f3560-cc6b-4ef4-a43c-fa0311cbd87f tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:42.514741 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-d48f3560-cc6b-4ef4-a43c-fa0311cbd87f tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: 399b579a-0f43-4611-8a9f-9075890edc1e] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:42.592782 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-d48f3560-cc6b-4ef4-a43c-fa0311cbd87f tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be167a79b9643fc88e9aee96caa74ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f36552f494e4757a3bf42ffeaebd0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:00:42.603529 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-d48f3560-cc6b-4ef4-a43c-fa0311cbd87f tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] 10.222.0.46 "GET /compute/v2.1/servers/399b579a-0f43-4611-8a9f-9075890edc1e" status: 200 len: 1218 microversion: 2.1 time: 0.091194 Jul 28 11:00:42.603529 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 716/1407] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:00:42 2022] GET /compute/v2.1/servers/399b579a-0f43-4611-8a9f-9075890edc1e => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:00:43.622165 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-768ca921-71d8-4124-bea8-85a83b969ca0 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:43.622776 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-768ca921-71d8-4124-bea8-85a83b969ca0 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: 399b579a-0f43-4611-8a9f-9075890edc1e] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:43.629448 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-768ca921-71d8-4124-bea8-85a83b969ca0 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:43.629923 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-768ca921-71d8-4124-bea8-85a83b969ca0 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:43.630722 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-768ca921-71d8-4124-bea8-85a83b969ca0 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:43.631163 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-768ca921-71d8-4124-bea8-85a83b969ca0 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:43.664838 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-768ca921-71d8-4124-bea8-85a83b969ca0 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:43.665294 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-768ca921-71d8-4124-bea8-85a83b969ca0 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:43.665745 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-768ca921-71d8-4124-bea8-85a83b969ca0 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lazy-loading 'fault' on Instance uuid 399b579a-0f43-4611-8a9f-9075890edc1e {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:00:43.707438 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-768ca921-71d8-4124-bea8-85a83b969ca0 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be167a79b9643fc88e9aee96caa74ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f36552f494e4757a3bf42ffeaebd0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:00:43.715623 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-768ca921-71d8-4124-bea8-85a83b969ca0 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] 10.222.0.46 "GET /compute/v2.1/servers/399b579a-0f43-4611-8a9f-9075890edc1e" status: 200 len: 1291 microversion: 2.1 time: 0.097308 Jul 28 11:00:43.716285 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 692/1408] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:00:43 2022] GET /compute/v2.1/servers/399b579a-0f43-4611-8a9f-9075890edc1e => generated 1291 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:00:43.735371 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-40d2930d-c660-45e7-b023-3132568dcb53 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:43.735892 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-40d2930d-c660-45e7-b023-3132568dcb53 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: 399b579a-0f43-4611-8a9f-9075890edc1e] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:43.743646 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-40d2930d-c660-45e7-b023-3132568dcb53 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:43.744095 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-40d2930d-c660-45e7-b023-3132568dcb53 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:43.744866 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-40d2930d-c660-45e7-b023-3132568dcb53 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:43.745296 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-40d2930d-c660-45e7-b023-3132568dcb53 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:43.770564 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-40d2930d-c660-45e7-b023-3132568dcb53 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: 399b579a-0f43-4611-8a9f-9075890edc1e] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:00:43.818700 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-40d2930d-c660-45e7-b023-3132568dcb53 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: 399b579a-0f43-4611-8a9f-9075890edc1e] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 11:00:43.820150 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-40d2930d-c660-45e7-b023-3132568dcb53 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:43.820597 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-40d2930d-c660-45e7-b023-3132568dcb53 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:43.821056 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-40d2930d-c660-45e7-b023-3132568dcb53 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: 399b579a-0f43-4611-8a9f-9075890edc1e] instance's host None is down, deleting from database Jul 28 11:00:43.824517 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-40d2930d-c660-45e7-b023-3132568dcb53 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: 399b579a-0f43-4611-8a9f-9075890edc1e] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 11:00:43.862366 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-40d2930d-c660-45e7-b023-3132568dcb53 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: 399b579a-0f43-4611-8a9f-9075890edc1e] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 11:00:43.868990 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-40d2930d-c660-45e7-b023-3132568dcb53 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: 399b579a-0f43-4611-8a9f-9075890edc1e] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:00:43.985696 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=72,nova_cell0:UPDATE=22,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:44.019440 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-40d2930d-c660-45e7-b023-3132568dcb53 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/399b579a-0f43-4611-8a9f-9075890edc1e" status: 204 len: 0 microversion: 2.1 time: 0.287899 Jul 28 11:00:44.020015 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 717/1409] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 11:00:43 2022] DELETE /compute/v2.1/servers/399b579a-0f43-4611-8a9f-9075890edc1e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:00:44.028707 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-827405c2-ebfe-4465-b83a-c0dcf5157ff5 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:44.029247 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-827405c2-ebfe-4465-b83a-c0dcf5157ff5 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] [instance: 399b579a-0f43-4611-8a9f-9075890edc1e] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:44.035743 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-827405c2-ebfe-4465-b83a-c0dcf5157ff5 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:44.036185 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-827405c2-ebfe-4465-b83a-c0dcf5157ff5 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:44.036931 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-827405c2-ebfe-4465-b83a-c0dcf5157ff5 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:44.037359 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-827405c2-ebfe-4465-b83a-c0dcf5157ff5 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:44.050718 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-827405c2-ebfe-4465-b83a-c0dcf5157ff5 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] HTTP exception thrown: Instance 399b579a-0f43-4611-8a9f-9075890edc1e could not be found. Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-827405c2-ebfe-4465-b83a-c0dcf5157ff5 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Request method failure captured: Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/399b579a-0f43-4611-8a9f-9075890edc1e HTTP/1.1 Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mxXSfN5aGhhgygFWJV2C_CUBrOQ_kP0MKfnRVO-a1cMr-k1-xGrFcqBdW2R9nE09IIqdBGJRQtO-hM0ZMLInQsg5UqxBocrGOkoXwrgr4mP5vJ1BzCFIcLjRuHgMqDbSlIMT4kG5nWyGUxqPqJVg2RXbslHkIQKcUxUkIyw35EBIns Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 5f36552f494e4757a3bf42ffeaebd0b4 Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1506053042 Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5f36552f494e4757a3bf42ffeaebd0b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5f36552f494e4757a3bf42ffeaebd0b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5f36552f494e4757a3bf42ffeaebd0b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5f36552f494e4757a3bf42ffeaebd0b4", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServerDiskConfigTestJSON-1506053042 Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 5f36552f494e4757a3bf42ffeaebd0b4 Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1506053042 Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServerDiskConfigTestJSON-1506053042-project Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 9be167a79b9643fc88e9aee96caa74ed Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServerDiskConfigTestJSON-1506053042-project Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 399b579a-0f43-4611-8a9f-9075890edc1e could not be found. Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '399b579a-0f43-4611-8a9f-9075890edc1e'} Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 399b579a-0f43-4611-8a9f-9075890edc1e could not be found. Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 399b579a-0f43-4611-8a9f-9075890edc1e could not be found. Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:00:44.052204 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:00:44.062274 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:00:44.062274 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:00:44.062274 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:00:44.062274 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:00:44.062274 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:00:44.062274 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 399b579a-0f43-4611-8a9f-9075890edc1e could not be found. Jul 28 11:00:44.062274 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:00:44.062274 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-827405c2-ebfe-4465-b83a-c0dcf5157ff5 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] Returning 404 to user: Instance 399b579a-0f43-4611-8a9f-9075890edc1e could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:00:44.062274 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-827405c2-ebfe-4465-b83a-c0dcf5157ff5 tempest-ServerDiskConfigTestJSON-1506053042 tempest-ServerDiskConfigTestJSON-1506053042-project] 10.222.0.46 "GET /compute/v2.1/servers/399b579a-0f43-4611-8a9f-9075890edc1e" status: 404 len: 111 microversion: 2.1 time: 0.028836 Jul 28 11:00:44.062274 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 693/1410] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:00:44 2022] GET /compute/v2.1/servers/399b579a-0f43-4611-8a9f-9075890edc1e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:00:52.477447 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:52.600274 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=8 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:52.607961 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a2c24790-eec0-41db-be2e-330f1eca4ab5 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Action: 'create', calling method: .version_select at 0x7fa94b603e50>, body: {"keypair": {"name": "tempest-keypair-1662973398", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4zNzMqFuVrzV4htNEhmE9G93q1IfP6Sg1XN++4NadT0QR+Bh/sgG873qtCbYLz620eoIxEqjWs5JFadRu2sfoqDvJdGerOKoJKEgxV/wEMdWbE/Xfq8VUjkL3vZH8cyQ=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:00:52.613699 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:52.627671 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-a2c24790-eec0-41db-be2e-330f1eca4ab5 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Getting quotas for project d137120b983f4a1da6ed985a11c085e0. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:00:52.634314 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-a2c24790-eec0-41db-be2e-330f1eca4ab5 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Getting quotas for user f2b2236a9f3346598f80d7811ce177f7 and project d137120b983f4a1da6ed985a11c085e0. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:00:52.659629 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a2c24790-eec0-41db-be2e-330f1eca4ab5 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.182817 Jul 28 11:00:52.660211 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 718/1411] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 11:00:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:00:54.003977 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1120684606", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cdc3aec4-d34c-4af1-ad92-fc04230a9651"}], "security_groups": [{"name": "tempest-securitygroup--254201204"}], "key_name": "tempest-keypair-1662973398", "user_data": "}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:00:54.014051 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:54.014859 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=8 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:54.015780 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:54.042646 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=36,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:54.121585 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] validate_networks() for [('cdc3aec4-d34c-4af1-ad92-fc04230a9651', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:00:54.820462 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:00:54.820896 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:00:54.821366 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:00:54.822125 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:00:54.822535 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:00:54.832295 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:54.833007 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:54.833806 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:54.834941 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:54.852701 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Getting quotas for project d137120b983f4a1da6ed985a11c085e0. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:00:54.858641 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Getting quotas for user f2b2236a9f3346598f80d7811ce177f7 and project d137120b983f4a1da6ed985a11c085e0. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:00:54.872976 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:00:54.875361 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] [instance: bb975bf1-f5a2-4c9c-80ac-953868238ad9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:00:54.949360 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6e96099f-7a1b-483f-8721-a46e983bdd85 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.952474 Jul 28 11:00:54.955502 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 694/1412] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 11:00:53 2022] POST /compute/v2.1/servers => generated 408 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:00:54.957825 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:UPDATE=8,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:00:54.962983 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2514b5e7-ca89-4cea-b162-1aa9edc22bbb tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:54.963741 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-2514b5e7-ca89-4cea-b162-1aa9edc22bbb tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] [instance: bb975bf1-f5a2-4c9c-80ac-953868238ad9] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:55.039561 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-2514b5e7-ca89-4cea-b162-1aa9edc22bbb tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b2236a9f3346598f80d7811ce177f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd137120b983f4a1da6ed985a11c085e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:00:55.048099 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-2514b5e7-ca89-4cea-b162-1aa9edc22bbb tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] 10.222.0.46 "GET /compute/v2.1/servers/bb975bf1-f5a2-4c9c-80ac-953868238ad9" status: 200 len: 1239 microversion: 2.1 time: 0.091215 Jul 28 11:00:55.048791 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 719/1413] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:00:54 2022] GET /compute/v2.1/servers/bb975bf1-f5a2-4c9c-80ac-953868238ad9 => generated 1239 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:00:56.070560 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-2105c259-156c-493b-886a-2dc6a2c4002b tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:56.071180 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-2105c259-156c-493b-886a-2dc6a2c4002b tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] [instance: bb975bf1-f5a2-4c9c-80ac-953868238ad9] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:56.077767 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2105c259-156c-493b-886a-2dc6a2c4002b tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:56.078282 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2105c259-156c-493b-886a-2dc6a2c4002b tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:56.079068 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2105c259-156c-493b-886a-2dc6a2c4002b tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:56.079503 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2105c259-156c-493b-886a-2dc6a2c4002b tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:56.114277 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2105c259-156c-493b-886a-2dc6a2c4002b tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:56.114737 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-2105c259-156c-493b-886a-2dc6a2c4002b tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:56.115261 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-2105c259-156c-493b-886a-2dc6a2c4002b tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lazy-loading 'fault' on Instance uuid bb975bf1-f5a2-4c9c-80ac-953868238ad9 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:00:56.166622 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-2105c259-156c-493b-886a-2dc6a2c4002b tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b2236a9f3346598f80d7811ce177f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd137120b983f4a1da6ed985a11c085e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:00:56.174339 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-2105c259-156c-493b-886a-2dc6a2c4002b tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] 10.222.0.46 "GET /compute/v2.1/servers/bb975bf1-f5a2-4c9c-80ac-953868238ad9" status: 200 len: 1312 microversion: 2.1 time: 0.108397 Jul 28 11:00:56.174915 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 695/1414] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:00:56 2022] GET /compute/v2.1/servers/bb975bf1-f5a2-4c9c-80ac-953868238ad9 => generated 1312 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:00:56.195525 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b6f61ae8-8161-4a8f-960d-1b0f205e524e tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:56.196020 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b6f61ae8-8161-4a8f-960d-1b0f205e524e tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] [instance: bb975bf1-f5a2-4c9c-80ac-953868238ad9] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:56.202396 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b6f61ae8-8161-4a8f-960d-1b0f205e524e tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:56.202854 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b6f61ae8-8161-4a8f-960d-1b0f205e524e tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:56.203635 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b6f61ae8-8161-4a8f-960d-1b0f205e524e tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:56.204082 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b6f61ae8-8161-4a8f-960d-1b0f205e524e tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:56.229470 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b6f61ae8-8161-4a8f-960d-1b0f205e524e tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] [instance: bb975bf1-f5a2-4c9c-80ac-953868238ad9] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:00:56.277545 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b6f61ae8-8161-4a8f-960d-1b0f205e524e tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] [instance: bb975bf1-f5a2-4c9c-80ac-953868238ad9] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 11:00:56.278539 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b6f61ae8-8161-4a8f-960d-1b0f205e524e tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:56.279049 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b6f61ae8-8161-4a8f-960d-1b0f205e524e tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:56.279434 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-b6f61ae8-8161-4a8f-960d-1b0f205e524e tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] [instance: bb975bf1-f5a2-4c9c-80ac-953868238ad9] instance's host None is down, deleting from database Jul 28 11:00:56.283451 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-b6f61ae8-8161-4a8f-960d-1b0f205e524e tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] [instance: bb975bf1-f5a2-4c9c-80ac-953868238ad9] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 11:00:56.317232 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-b6f61ae8-8161-4a8f-960d-1b0f205e524e tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] [instance: bb975bf1-f5a2-4c9c-80ac-953868238ad9] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 11:00:56.323209 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-b6f61ae8-8161-4a8f-960d-1b0f205e524e tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] [instance: bb975bf1-f5a2-4c9c-80ac-953868238ad9] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:00:56.466160 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b6f61ae8-8161-4a8f-960d-1b0f205e524e tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bb975bf1-f5a2-4c9c-80ac-953868238ad9" status: 204 len: 0 microversion: 2.1 time: 0.274421 Jul 28 11:00:56.466668 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 720/1415] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 11:00:56 2022] DELETE /compute/v2.1/servers/bb975bf1-f5a2-4c9c-80ac-953868238ad9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:00:56.475063 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ae6ec32f-9bb8-4d79-83f4-4be25d297271 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:56.475775 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-ae6ec32f-9bb8-4d79-83f4-4be25d297271 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] [instance: bb975bf1-f5a2-4c9c-80ac-953868238ad9] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:00:56.482059 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ae6ec32f-9bb8-4d79-83f4-4be25d297271 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:56.482521 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ae6ec32f-9bb8-4d79-83f4-4be25d297271 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:56.483298 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ae6ec32f-9bb8-4d79-83f4-4be25d297271 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:00:56.483766 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-ae6ec32f-9bb8-4d79-83f4-4be25d297271 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:00:56.497742 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-ae6ec32f-9bb8-4d79-83f4-4be25d297271 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] HTTP exception thrown: Instance bb975bf1-f5a2-4c9c-80ac-953868238ad9 could not be found. Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ae6ec32f-9bb8-4d79-83f4-4be25d297271 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Request method failure captured: Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/bb975bf1-f5a2-4c9c-80ac-953868238ad9 HTTP/1.1 Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mxkEJSupdy5YHosUpIQYGQIpV9_Frs6hB1EHXaxCWwMQ70oB5UrT5lQXI4mgeAgrpTdGA7CuhTr7UJPvMy2qzBrHI7o9g_teP4vZicCPv79LAT0MWGOChhq_e7mNePxUVgMMMOMgmYon-lOFH1_Ok-T8ZtK9nn8xVPEHajBOk3wHz4 Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: d137120b983f4a1da6ed985a11c085e0 Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServerActionsTestJSON-499471605 Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d137120b983f4a1da6ed985a11c085e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d137120b983f4a1da6ed985a11c085e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d137120b983f4a1da6ed985a11c085e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d137120b983f4a1da6ed985a11c085e0", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServerActionsTestJSON-499471605 Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: d137120b983f4a1da6ed985a11c085e0 Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServerActionsTestJSON-499471605 Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServerActionsTestJSON-499471605-project Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: f2b2236a9f3346598f80d7811ce177f7 Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServerActionsTestJSON-499471605-project Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance bb975bf1-f5a2-4c9c-80ac-953868238ad9 could not be found. Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'bb975bf1-f5a2-4c9c-80ac-953868238ad9'} Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb975bf1-f5a2-4c9c-80ac-953868238ad9 could not be found. Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb975bf1-f5a2-4c9c-80ac-953868238ad9 could not be found. Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:00:56.499273 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:00:56.503983 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:00:56.503983 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:00:56.503983 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:00:56.503983 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:00:56.503983 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:00:56.503983 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb975bf1-f5a2-4c9c-80ac-953868238ad9 could not be found. Jul 28 11:00:56.503983 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:00:56.503983 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-ae6ec32f-9bb8-4d79-83f4-4be25d297271 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Returning 404 to user: Instance bb975bf1-f5a2-4c9c-80ac-953868238ad9 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:00:56.503983 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-ae6ec32f-9bb8-4d79-83f4-4be25d297271 tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] 10.222.0.46 "GET /compute/v2.1/servers/bb975bf1-f5a2-4c9c-80ac-953868238ad9" status: 404 len: 111 microversion: 2.1 time: 0.029654 Jul 28 11:00:56.503983 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 696/1416] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:00:56 2022] GET /compute/v2.1/servers/bb975bf1-f5a2-4c9c-80ac-953868238ad9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:00:56.510250 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-03dc9c90-113a-433a-8d9b-91b134e5b48b tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] Calling method '.version_select at 0x7fa94b6a2310>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:00:56.529949 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-03dc9c90-113a-433a-8d9b-91b134e5b48b tempest-ServerActionsTestJSON-499471605 tempest-ServerActionsTestJSON-499471605-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1662973398" status: 202 len: 0 microversion: 2.1 time: 0.024179 Jul 28 11:00:56.530552 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 721/1417] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Jul 28 11:00:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1662973398 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:01:05.556101 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:05.556927 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=6 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:05.713957 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2013222516", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "ff86bc10-f79c-4272-ba69-99eeeb04cd40"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:01:05.774798 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] validate_networks() for [('ff86bc10-f79c-4272-ba69-99eeeb04cd40', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:01:06.189490 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:01:06.190160 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:01:06.190639 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:01:06.191271 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:01:06.191691 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:01:06.202191 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:06.202638 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:06.203456 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:06.203886 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:06.221321 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Getting quotas for project 881d6c3260b84f59a35667d253331e88. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:01:06.226899 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Getting quotas for user 95b5d060c1da44f08fc30fc963e27c6f and project 881d6c3260b84f59a35667d253331e88. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:01:06.240420 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:01:06.242809 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] [instance: 1e7bde23-1b48-4100-9b15-04a61d9722e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:01:06.290716 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-9b977cea-eccd-4088-af9d-3097bb870168 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.739739 Jul 28 11:01:06.293142 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 697/1418] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 11:01:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:01:06.303281 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b92b4c63-9bd7-409a-8a06-cbfeeb14e439 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:01:06.304102 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b92b4c63-9bd7-409a-8a06-cbfeeb14e439 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] [instance: 1e7bde23-1b48-4100-9b15-04a61d9722e7] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:01:06.308197 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=6 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:06.366085 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-b92b4c63-9bd7-409a-8a06-cbfeeb14e439 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b5d060c1da44f08fc30fc963e27c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881d6c3260b84f59a35667d253331e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:01:06.375129 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b92b4c63-9bd7-409a-8a06-cbfeeb14e439 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] 10.222.0.46 "GET /compute/v2.1/servers/1e7bde23-1b48-4100-9b15-04a61d9722e7" status: 200 len: 1217 microversion: 2.1 time: 0.075277 Jul 28 11:01:06.387957 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 722/1419] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:01:06 2022] GET /compute/v2.1/servers/1e7bde23-1b48-4100-9b15-04a61d9722e7 => generated 1217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:01:07.395954 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f9426f51-d224-4e8c-831f-12a6ec285770 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:01:07.396738 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f9426f51-d224-4e8c-831f-12a6ec285770 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] [instance: 1e7bde23-1b48-4100-9b15-04a61d9722e7] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:01:07.402882 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f9426f51-d224-4e8c-831f-12a6ec285770 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:07.403322 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f9426f51-d224-4e8c-831f-12a6ec285770 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:07.404683 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f9426f51-d224-4e8c-831f-12a6ec285770 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:07.404683 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f9426f51-d224-4e8c-831f-12a6ec285770 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:07.438215 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f9426f51-d224-4e8c-831f-12a6ec285770 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:07.438673 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f9426f51-d224-4e8c-831f-12a6ec285770 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:07.439125 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-f9426f51-d224-4e8c-831f-12a6ec285770 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lazy-loading 'fault' on Instance uuid 1e7bde23-1b48-4100-9b15-04a61d9722e7 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:01:07.480767 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-f9426f51-d224-4e8c-831f-12a6ec285770 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b5d060c1da44f08fc30fc963e27c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881d6c3260b84f59a35667d253331e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:01:07.488210 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f9426f51-d224-4e8c-831f-12a6ec285770 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] 10.222.0.46 "GET /compute/v2.1/servers/1e7bde23-1b48-4100-9b15-04a61d9722e7" status: 200 len: 1290 microversion: 2.1 time: 0.096658 Jul 28 11:01:07.488773 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 698/1420] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:01:07 2022] GET /compute/v2.1/servers/1e7bde23-1b48-4100-9b15-04a61d9722e7 => generated 1290 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:01:07.508443 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4c8a46cb-d133-4eb7-b674-7e9108ab45e6 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:01:07.508987 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-4c8a46cb-d133-4eb7-b674-7e9108ab45e6 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] [instance: 1e7bde23-1b48-4100-9b15-04a61d9722e7] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:01:07.510842 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:07.516492 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4c8a46cb-d133-4eb7-b674-7e9108ab45e6 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:07.517145 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4c8a46cb-d133-4eb7-b674-7e9108ab45e6 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:07.517958 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4c8a46cb-d133-4eb7-b674-7e9108ab45e6 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:07.518404 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4c8a46cb-d133-4eb7-b674-7e9108ab45e6 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:07.547092 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-4c8a46cb-d133-4eb7-b674-7e9108ab45e6 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] [instance: 1e7bde23-1b48-4100-9b15-04a61d9722e7] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:01:07.604065 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-4c8a46cb-d133-4eb7-b674-7e9108ab45e6 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] [instance: 1e7bde23-1b48-4100-9b15-04a61d9722e7] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 11:01:07.604960 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4c8a46cb-d133-4eb7-b674-7e9108ab45e6 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:07.605468 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-4c8a46cb-d133-4eb7-b674-7e9108ab45e6 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:07.606026 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-4c8a46cb-d133-4eb7-b674-7e9108ab45e6 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] [instance: 1e7bde23-1b48-4100-9b15-04a61d9722e7] instance's host None is down, deleting from database Jul 28 11:01:07.614253 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-4c8a46cb-d133-4eb7-b674-7e9108ab45e6 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] [instance: 1e7bde23-1b48-4100-9b15-04a61d9722e7] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 11:01:07.651974 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-4c8a46cb-d133-4eb7-b674-7e9108ab45e6 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] [instance: 1e7bde23-1b48-4100-9b15-04a61d9722e7] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 11:01:07.658978 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-4c8a46cb-d133-4eb7-b674-7e9108ab45e6 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] [instance: 1e7bde23-1b48-4100-9b15-04a61d9722e7] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:01:07.840520 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-4c8a46cb-d133-4eb7-b674-7e9108ab45e6 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1e7bde23-1b48-4100-9b15-04a61d9722e7" status: 204 len: 0 microversion: 2.1 time: 0.336106 Jul 28 11:01:07.841261 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 723/1421] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 11:01:07 2022] DELETE /compute/v2.1/servers/1e7bde23-1b48-4100-9b15-04a61d9722e7 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:01:07.850299 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3d6b6e34-2e96-4a59-b562-7b2a96f35008 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:01:07.850962 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-3d6b6e34-2e96-4a59-b562-7b2a96f35008 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] [instance: 1e7bde23-1b48-4100-9b15-04a61d9722e7] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:01:07.857102 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3d6b6e34-2e96-4a59-b562-7b2a96f35008 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:07.857822 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3d6b6e34-2e96-4a59-b562-7b2a96f35008 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:07.864159 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3d6b6e34-2e96-4a59-b562-7b2a96f35008 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:07.865372 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-3d6b6e34-2e96-4a59-b562-7b2a96f35008 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:07.879429 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-3d6b6e34-2e96-4a59-b562-7b2a96f35008 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] HTTP exception thrown: Instance 1e7bde23-1b48-4100-9b15-04a61d9722e7 could not be found. Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3d6b6e34-2e96-4a59-b562-7b2a96f35008 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Request method failure captured: Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/1e7bde23-1b48-4100-9b15-04a61d9722e7 HTTP/1.1 Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mxxT4k-8FE7uUePSDL-RW3N6bPBDzO_PTmtZCJwt_xYFQf7GSuXfBWv8t8NYBdV6V6StiwN8UcNrpg24KDT1syPfDAbjH3FAbKwlB_NXDJfazcU8qKYrUlEeAYS_YPLDew-qktWuoBp1sRwqKuHQ-DE9-YoaEKFiEle30CQl8zWXV4 Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 881d6c3260b84f59a35667d253331e88 Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-ServersNegativeTestJSON-1984302183 Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/881d6c3260b84f59a35667d253331e88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/881d6c3260b84f59a35667d253331e88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/881d6c3260b84f59a35667d253331e88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_881d6c3260b84f59a35667d253331e88", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-ServersNegativeTestJSON-1984302183 Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 881d6c3260b84f59a35667d253331e88 Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1984302183 Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-ServersNegativeTestJSON-1984302183-project Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 95b5d060c1da44f08fc30fc963e27c6f Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-ServersNegativeTestJSON-1984302183-project Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 1e7bde23-1b48-4100-9b15-04a61d9722e7 could not be found. Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '1e7bde23-1b48-4100-9b15-04a61d9722e7'} Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e7bde23-1b48-4100-9b15-04a61d9722e7 could not be found. Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e7bde23-1b48-4100-9b15-04a61d9722e7 could not be found. Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:01:07.881735 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:01:07.886579 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:01:07.886579 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:01:07.886579 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:01:07.886579 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:01:07.886579 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:01:07.886579 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e7bde23-1b48-4100-9b15-04a61d9722e7 could not be found. Jul 28 11:01:07.886579 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:01:07.886579 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3d6b6e34-2e96-4a59-b562-7b2a96f35008 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] Returning 404 to user: Instance 1e7bde23-1b48-4100-9b15-04a61d9722e7 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:01:07.886579 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3d6b6e34-2e96-4a59-b562-7b2a96f35008 tempest-ServersNegativeTestJSON-1984302183 tempest-ServersNegativeTestJSON-1984302183-project] 10.222.0.46 "GET /compute/v2.1/servers/1e7bde23-1b48-4100-9b15-04a61d9722e7" status: 404 len: 111 microversion: 2.1 time: 0.037256 Jul 28 11:01:07.886579 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 699/1422] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:01:07 2022] GET /compute/v2.1/servers/1e7bde23-1b48-4100-9b15-04a61d9722e7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:01:39.430186 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:39.431636 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:39.432459 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:39.666843 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-8e83633e-2e97-4635-8b40-432c7ea38e51 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Action: 'create', calling method: .version_select at 0x7fa94b5a7af0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-22317161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+ZhpoEXP+M4WCSEWCWdnrYBuzB9IJdPCEE+j3iwpXrVYuPJMfjiWzt90GJRwAyIhJtIu+hx8LxCc3Lr8An5nsb456lyjnq3DXwkWnnkegupQGQ2MdSV1BqeHCHBpmO6w=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:01:39.686496 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-8e83633e-2e97-4635-8b40-432c7ea38e51 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Getting quotas for project c2450726bf484f0c9c5252c88c2bfacb. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:01:39.693740 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-8e83633e-2e97-4635-8b40-432c7ea38e51 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Getting quotas for user 078314d7d6534a1fb9abb7d1a293ea74 and project c2450726bf484f0c9c5252c88c2bfacb. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:01:39.721357 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-8e83633e-2e97-4635-8b40-432c7ea38e51 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.297148 Jul 28 11:01:39.722190 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 724/1423] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 11:01:39 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:01:39.840333 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2065416189", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-22317161", "networks": [{"uuid": "fea75674-1b4e-47a9-9711-ed354e7765af"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:01:39.849035 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:39.849706 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=6 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:39.850581 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=6 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:39.851225 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=24 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:01:40.065146 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] validate_networks() for [('fea75674-1b4e-47a9-9711-ed354e7765af', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:01:40.476035 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:01:40.476487 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:01:40.476963 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:01:40.477378 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:01:40.477818 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:01:40.486569 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:40.487018 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:40.487823 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:40.488989 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:40.506023 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Getting quotas for project c2450726bf484f0c9c5252c88c2bfacb. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:01:40.511016 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Getting quotas for user 078314d7d6534a1fb9abb7d1a293ea74 and project c2450726bf484f0c9c5252c88c2bfacb. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:01:40.523702 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:01:40.525848 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: de3f7fba-172a-4ec2-be81-c40c20fe7997] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:01:40.573452 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-da14ae0a-23ff-45bb-b360-092dc8440637 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.737083 Jul 28 11:01:40.574332 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 700/1424] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 11:01:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:01:40.586196 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-4540a845-15f1-4d7d-bd26-6537e3744184 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:01:40.586810 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-4540a845-15f1-4d7d-bd26-6537e3744184 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: de3f7fba-172a-4ec2-be81-c40c20fe7997] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:01:40.785789 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-4540a845-15f1-4d7d-bd26-6537e3744184 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078314d7d6534a1fb9abb7d1a293ea74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2450726bf484f0c9c5252c88c2bfacb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:01:40.793342 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-4540a845-15f1-4d7d-bd26-6537e3744184 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] 10.222.0.46 "GET /compute/v2.1/servers/de3f7fba-172a-4ec2-be81-c40c20fe7997" status: 200 len: 1261 microversion: 2.1 time: 0.212439 Jul 28 11:01:40.794352 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 725/1425] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:01:40 2022] GET /compute/v2.1/servers/de3f7fba-172a-4ec2-be81-c40c20fe7997 => generated 1261 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:01:41.815540 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7c602328-6145-4b15-91f7-dd57a38962b6 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:01:41.816290 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-7c602328-6145-4b15-91f7-dd57a38962b6 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: de3f7fba-172a-4ec2-be81-c40c20fe7997] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:01:41.822862 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7c602328-6145-4b15-91f7-dd57a38962b6 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:41.823315 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7c602328-6145-4b15-91f7-dd57a38962b6 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:41.824095 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7c602328-6145-4b15-91f7-dd57a38962b6 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:41.824532 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7c602328-6145-4b15-91f7-dd57a38962b6 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:41.858034 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7c602328-6145-4b15-91f7-dd57a38962b6 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:41.858489 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7c602328-6145-4b15-91f7-dd57a38962b6 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:41.858952 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-7c602328-6145-4b15-91f7-dd57a38962b6 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lazy-loading 'fault' on Instance uuid de3f7fba-172a-4ec2-be81-c40c20fe7997 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:01:41.902258 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-7c602328-6145-4b15-91f7-dd57a38962b6 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078314d7d6534a1fb9abb7d1a293ea74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2450726bf484f0c9c5252c88c2bfacb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:01:41.911167 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-7c602328-6145-4b15-91f7-dd57a38962b6 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] 10.222.0.46 "GET /compute/v2.1/servers/de3f7fba-172a-4ec2-be81-c40c20fe7997" status: 200 len: 1334 microversion: 2.1 time: 0.099281 Jul 28 11:01:41.911754 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 701/1426] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:01:41 2022] GET /compute/v2.1/servers/de3f7fba-172a-4ec2-be81-c40c20fe7997 => generated 1334 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:01:41.932053 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5fd0a00d-1edd-48ac-b280-a5971c389b4d tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:01:41.932604 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5fd0a00d-1edd-48ac-b280-a5971c389b4d tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: de3f7fba-172a-4ec2-be81-c40c20fe7997] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:01:41.939008 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5fd0a00d-1edd-48ac-b280-a5971c389b4d tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:41.939538 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5fd0a00d-1edd-48ac-b280-a5971c389b4d tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:41.940378 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5fd0a00d-1edd-48ac-b280-a5971c389b4d tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:41.940830 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5fd0a00d-1edd-48ac-b280-a5971c389b4d tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:41.965703 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5fd0a00d-1edd-48ac-b280-a5971c389b4d tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: de3f7fba-172a-4ec2-be81-c40c20fe7997] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:01:42.014624 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-5fd0a00d-1edd-48ac-b280-a5971c389b4d tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: de3f7fba-172a-4ec2-be81-c40c20fe7997] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 11:01:42.015415 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5fd0a00d-1edd-48ac-b280-a5971c389b4d tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:42.015857 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-5fd0a00d-1edd-48ac-b280-a5971c389b4d tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:42.016288 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-5fd0a00d-1edd-48ac-b280-a5971c389b4d tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: de3f7fba-172a-4ec2-be81-c40c20fe7997] instance's host None is down, deleting from database Jul 28 11:01:42.019994 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-5fd0a00d-1edd-48ac-b280-a5971c389b4d tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: de3f7fba-172a-4ec2-be81-c40c20fe7997] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 11:01:42.055144 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-5fd0a00d-1edd-48ac-b280-a5971c389b4d tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: de3f7fba-172a-4ec2-be81-c40c20fe7997] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 11:01:42.061463 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-5fd0a00d-1edd-48ac-b280-a5971c389b4d tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: de3f7fba-172a-4ec2-be81-c40c20fe7997] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:01:42.212160 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-5fd0a00d-1edd-48ac-b280-a5971c389b4d tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] 10.222.0.46 "DELETE /compute/v2.1/servers/de3f7fba-172a-4ec2-be81-c40c20fe7997" status: 204 len: 0 microversion: 2.1 time: 0.283954 Jul 28 11:01:42.212754 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 726/1427] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 11:01:41 2022] DELETE /compute/v2.1/servers/de3f7fba-172a-4ec2-be81-c40c20fe7997 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 11:01:42.220944 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7fa2016c-c189-4922-ac55-4f6a05a384b8 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:01:42.221548 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-7fa2016c-c189-4922-ac55-4f6a05a384b8 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: de3f7fba-172a-4ec2-be81-c40c20fe7997] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:01:42.227793 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7fa2016c-c189-4922-ac55-4f6a05a384b8 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:42.228235 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7fa2016c-c189-4922-ac55-4f6a05a384b8 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:42.229175 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7fa2016c-c189-4922-ac55-4f6a05a384b8 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:42.229607 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-7fa2016c-c189-4922-ac55-4f6a05a384b8 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:42.244118 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-7fa2016c-c189-4922-ac55-4f6a05a384b8 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] HTTP exception thrown: Instance de3f7fba-172a-4ec2-be81-c40c20fe7997 could not be found. Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7fa2016c-c189-4922-ac55-4f6a05a384b8 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Request method failure captured: Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/de3f7fba-172a-4ec2-be81-c40c20fe7997 HTTP/1.1 Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4myObF6SGQPnh63t7uasLFfCEOnvl4DB62ENpSgrB4bu4d2W7YB3DciNDlMsMGK4j_4b9mWuTpLA392duOAJpP4VdOCL4buosmVGfleBflXTsNFYq7-1VThtwOrArt-HbaFY_IKhmCQTuBAU9BF-bpYkkx8tvyKWBixTzxdlty0D2BE Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: c2450726bf484f0c9c5252c88c2bfacb Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-TestEncryptedCinderVolumes-933380625 Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c2450726bf484f0c9c5252c88c2bfacb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c2450726bf484f0c9c5252c88c2bfacb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c2450726bf484f0c9c5252c88c2bfacb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c2450726bf484f0c9c5252c88c2bfacb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-TestEncryptedCinderVolumes-933380625 Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: c2450726bf484f0c9c5252c88c2bfacb Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-933380625 Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-TestEncryptedCinderVolumes-933380625-project Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 078314d7d6534a1fb9abb7d1a293ea74 Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-TestEncryptedCinderVolumes-933380625-project Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance de3f7fba-172a-4ec2-be81-c40c20fe7997 could not be found. Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'de3f7fba-172a-4ec2-be81-c40c20fe7997'} Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de3f7fba-172a-4ec2-be81-c40c20fe7997 could not be found. Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de3f7fba-172a-4ec2-be81-c40c20fe7997 could not be found. Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:01:42.245636 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:01:42.250674 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:01:42.250674 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:01:42.250674 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:01:42.250674 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:01:42.250674 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:01:42.250674 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de3f7fba-172a-4ec2-be81-c40c20fe7997 could not be found. Jul 28 11:01:42.250674 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:01:42.250674 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7fa2016c-c189-4922-ac55-4f6a05a384b8 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Returning 404 to user: Instance de3f7fba-172a-4ec2-be81-c40c20fe7997 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:01:42.250674 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-7fa2016c-c189-4922-ac55-4f6a05a384b8 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] 10.222.0.46 "GET /compute/v2.1/servers/de3f7fba-172a-4ec2-be81-c40c20fe7997" status: 404 len: 111 microversion: 2.1 time: 0.030076 Jul 28 11:01:42.250674 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 702/1428] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:01:42 2022] GET /compute/v2.1/servers/de3f7fba-172a-4ec2-be81-c40c20fe7997 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:01:42.261965 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-51249c32-931c-4d1b-8311-3b139910437a tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Calling method '.version_select at 0x7fa94b5a7700>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:01:42.282641 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-51249c32-931c-4d1b-8311-3b139910437a tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-22317161" status: 202 len: 0 microversion: 2.1 time: 0.024175 Jul 28 11:01:42.283150 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 727/1429] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 11:01:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-22317161 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:01:42.296857 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-7238652b-19f0-4018-9480-88a19cb4d3ed tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Action: 'create', calling method: .version_select at 0x7fa94b709f70>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-725623487", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICGS9lISg1WLAuXtdCSFb2SgqBxQZ/qOhVISwJjLOwrKNplCPkJg0sKvGUuYyI0nVD91Q1DcX7uEF6ClCUnjaEOldSzYU3O8L6QBzrVKCW45A6BAf1pu+lZ7zPPBMqTPw=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:01:42.313801 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-7238652b-19f0-4018-9480-88a19cb4d3ed tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Getting quotas for project c2450726bf484f0c9c5252c88c2bfacb. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:01:42.319690 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-7238652b-19f0-4018-9480-88a19cb4d3ed tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Getting quotas for user 078314d7d6534a1fb9abb7d1a293ea74 and project c2450726bf484f0c9c5252c88c2bfacb. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:01:42.351574 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-7238652b-19f0-4018-9480-88a19cb4d3ed tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.058716 Jul 28 11:01:42.352428 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 703/1430] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 11:01:42 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:01:42.404324 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1028256948", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-725623487", "networks": [{"uuid": "fea75674-1b4e-47a9-9711-ed354e7765af"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:01:42.462172 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] validate_networks() for [('fea75674-1b4e-47a9-9711-ed354e7765af', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:01:42.874200 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:01:42.874736 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:01:42.875275 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:01:42.875772 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:01:42.876248 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:01:42.885902 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:42.886353 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:42.887247 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:42.887680 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:42.906304 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Getting quotas for project c2450726bf484f0c9c5252c88c2bfacb. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:01:42.911940 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Getting quotas for user 078314d7d6534a1fb9abb7d1a293ea74 and project c2450726bf484f0c9c5252c88c2bfacb. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:01:42.924023 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:01:42.926871 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:01:42.975135 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b71e8dd3-d0bb-4d20-be36-46eded11b659 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574669 Jul 28 11:01:42.976381 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 728/1431] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 11:01:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:01:42.987110 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-94e55b33-f864-4d50-8ba8-37f5d9262588 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:01:42.987801 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-94e55b33-f864-4d50-8ba8-37f5d9262588 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:01:43.059739 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-94e55b33-f864-4d50-8ba8-37f5d9262588 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078314d7d6534a1fb9abb7d1a293ea74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2450726bf484f0c9c5252c88c2bfacb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:01:43.072903 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-94e55b33-f864-4d50-8ba8-37f5d9262588 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] 10.222.0.46 "GET /compute/v2.1/servers/fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e" status: 200 len: 1262 microversion: 2.1 time: 0.086917 Jul 28 11:01:43.086767 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 704/1432] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:01:42 2022] GET /compute/v2.1/servers/fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e => generated 1262 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:01:44.094058 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-97562d11-17a3-42c0-9715-42e401051634 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:01:44.094729 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-97562d11-17a3-42c0-9715-42e401051634 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:01:44.101512 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-97562d11-17a3-42c0-9715-42e401051634 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:44.101995 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-97562d11-17a3-42c0-9715-42e401051634 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:44.102765 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-97562d11-17a3-42c0-9715-42e401051634 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:44.103208 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-97562d11-17a3-42c0-9715-42e401051634 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:44.134621 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-97562d11-17a3-42c0-9715-42e401051634 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:44.134997 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-97562d11-17a3-42c0-9715-42e401051634 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:44.135445 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-97562d11-17a3-42c0-9715-42e401051634 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lazy-loading 'fault' on Instance uuid fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:01:44.181026 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-97562d11-17a3-42c0-9715-42e401051634 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078314d7d6534a1fb9abb7d1a293ea74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2450726bf484f0c9c5252c88c2bfacb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:01:44.188481 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-97562d11-17a3-42c0-9715-42e401051634 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] 10.222.0.46 "GET /compute/v2.1/servers/fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e" status: 200 len: 1335 microversion: 2.1 time: 0.098478 Jul 28 11:01:44.189051 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 729/1433] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:01:44 2022] GET /compute/v2.1/servers/fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e => generated 1335 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:01:44.208030 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-bfebd9e1-3967-42e2-a660-c012c5df5275 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:01:44.208529 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-bfebd9e1-3967-42e2-a660-c012c5df5275 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:01:44.215754 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bfebd9e1-3967-42e2-a660-c012c5df5275 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:44.216197 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bfebd9e1-3967-42e2-a660-c012c5df5275 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:44.216991 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bfebd9e1-3967-42e2-a660-c012c5df5275 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:44.217421 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bfebd9e1-3967-42e2-a660-c012c5df5275 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:44.243619 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-bfebd9e1-3967-42e2-a660-c012c5df5275 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:01:44.290519 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-bfebd9e1-3967-42e2-a660-c012c5df5275 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 11:01:44.291316 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bfebd9e1-3967-42e2-a660-c012c5df5275 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:44.291752 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bfebd9e1-3967-42e2-a660-c012c5df5275 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:44.292183 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-bfebd9e1-3967-42e2-a660-c012c5df5275 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e] instance's host None is down, deleting from database Jul 28 11:01:44.295594 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-bfebd9e1-3967-42e2-a660-c012c5df5275 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 11:01:44.329427 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-bfebd9e1-3967-42e2-a660-c012c5df5275 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 11:01:44.336608 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-bfebd9e1-3967-42e2-a660-c012c5df5275 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:01:44.487932 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-bfebd9e1-3967-42e2-a660-c012c5df5275 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e" status: 204 len: 0 microversion: 2.1 time: 0.283574 Jul 28 11:01:44.488499 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 705/1434] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 11:01:44 2022] DELETE /compute/v2.1/servers/fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:01:44.497478 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a1b12287-d5bd-4584-873e-691cdd920f15 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:01:44.498126 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a1b12287-d5bd-4584-873e-691cdd920f15 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:01:44.504246 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a1b12287-d5bd-4584-873e-691cdd920f15 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:44.504695 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a1b12287-d5bd-4584-873e-691cdd920f15 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:44.505467 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a1b12287-d5bd-4584-873e-691cdd920f15 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:44.505982 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a1b12287-d5bd-4584-873e-691cdd920f15 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:44.520484 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-a1b12287-d5bd-4584-873e-691cdd920f15 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] HTTP exception thrown: Instance fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e could not be found. Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a1b12287-d5bd-4584-873e-691cdd920f15 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Request method failure captured: Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e HTTP/1.1 Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4myObF6SGQPnh63t7uasLFfCEOnvl4DB62ENpSgrB4bu4d2W7YB3DciNDlMsMGK4j_4b9mWuTpLA392duOAJpP4VdOCL4buosmVGfleBflXTsNFYq7-1VThtwOrArt-HbaFY_IKhmCQTuBAU9BF-bpYkkx8tvyKWBixTzxdlty0D2BE Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: c2450726bf484f0c9c5252c88c2bfacb Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-TestEncryptedCinderVolumes-933380625 Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c2450726bf484f0c9c5252c88c2bfacb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c2450726bf484f0c9c5252c88c2bfacb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c2450726bf484f0c9c5252c88c2bfacb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c2450726bf484f0c9c5252c88c2bfacb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-TestEncryptedCinderVolumes-933380625 Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: c2450726bf484f0c9c5252c88c2bfacb Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-933380625 Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-TestEncryptedCinderVolumes-933380625-project Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 078314d7d6534a1fb9abb7d1a293ea74 Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-TestEncryptedCinderVolumes-933380625-project Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e could not be found. Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e'} Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e could not be found. Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e could not be found. Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:01:44.522180 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:01:44.527229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:01:44.527229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:01:44.527229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:01:44.527229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:01:44.527229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:01:44.527229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e could not be found. Jul 28 11:01:44.527229 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:01:44.527229 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a1b12287-d5bd-4584-873e-691cdd920f15 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Returning 404 to user: Instance fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:01:44.527229 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a1b12287-d5bd-4584-873e-691cdd920f15 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] 10.222.0.46 "GET /compute/v2.1/servers/fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e" status: 404 len: 111 microversion: 2.1 time: 0.030605 Jul 28 11:01:44.527229 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 730/1435] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:01:44 2022] GET /compute/v2.1/servers/fe8d28c6-0be6-4984-bcc5-bd2f4faeeb6e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:01:44.533746 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e676074e-dee8-4278-8f0a-c20cbe6a9e1f tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Calling method '.version_select at 0x7fa94b835310>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:01:44.555710 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e676074e-dee8-4278-8f0a-c20cbe6a9e1f tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-725623487" status: 202 len: 0 microversion: 2.1 time: 0.025939 Jul 28 11:01:44.556361 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 706/1436] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Jul 28 11:01:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-725623487 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:01:44.569245 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-332a1c79-e6c3-471d-a6d2-3202f4c91cf5 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Action: 'create', calling method: .version_select at 0x7fa94b603280>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-482907310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdJ14lIwVVMPTN6nzQBcO1OYTAXS3HOR/AC8ui/SJoO1OhfEJN1RzI3QETqGvLbT3Xn4GndOiJiQkuJObwdmV8Fv+YE+vhyvurKRIn+KmfpM1236hCPJKarH3l9Pw5v+A=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:01:44.587039 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-332a1c79-e6c3-471d-a6d2-3202f4c91cf5 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Getting quotas for project c2450726bf484f0c9c5252c88c2bfacb. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:01:44.592994 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-332a1c79-e6c3-471d-a6d2-3202f4c91cf5 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Getting quotas for user 078314d7d6534a1fb9abb7d1a293ea74 and project c2450726bf484f0c9c5252c88c2bfacb. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:01:44.619622 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-332a1c79-e6c3-471d-a6d2-3202f4c91cf5 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.054416 Jul 28 11:01:44.620239 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 731/1437] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 11:01:44 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:01:44.675539 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1955248860", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-482907310", "networks": [{"uuid": "fea75674-1b4e-47a9-9711-ed354e7765af"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:01:44.733085 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] validate_networks() for [('fea75674-1b4e-47a9-9711-ed354e7765af', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:01:45.132135 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:01:45.132558 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:01:45.133034 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:01:45.133444 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:01:45.133878 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:01:45.143877 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:45.144325 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:45.145773 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:45.146571 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:45.164406 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Getting quotas for project c2450726bf484f0c9c5252c88c2bfacb. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:01:45.169409 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Getting quotas for user 078314d7d6534a1fb9abb7d1a293ea74 and project c2450726bf484f0c9c5252c88c2bfacb. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:01:45.182259 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:01:45.184384 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: 5d81ae67-aa50-42d6-aae8-c6a348fa2fa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:01:45.230002 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f055acc5-a4c2-4f59-89da-ebb3d1bd3b14 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558344 Jul 28 11:01:45.230701 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 707/1438] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 11:01:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:01:45.242311 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-b43b2b3c-1d36-4aa3-b5dd-682464129e08 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:01:45.242919 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-b43b2b3c-1d36-4aa3-b5dd-682464129e08 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: 5d81ae67-aa50-42d6-aae8-c6a348fa2fa1] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:01:45.295486 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-b43b2b3c-1d36-4aa3-b5dd-682464129e08 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078314d7d6534a1fb9abb7d1a293ea74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2450726bf484f0c9c5252c88c2bfacb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:01:45.304434 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-b43b2b3c-1d36-4aa3-b5dd-682464129e08 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] 10.222.0.46 "GET /compute/v2.1/servers/5d81ae67-aa50-42d6-aae8-c6a348fa2fa1" status: 200 len: 1262 microversion: 2.1 time: 0.066660 Jul 28 11:01:45.304887 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 732/1439] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:01:45 2022] GET /compute/v2.1/servers/5d81ae67-aa50-42d6-aae8-c6a348fa2fa1 => generated 1262 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:01:46.326093 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-33312c6e-75c5-4238-8c4f-af1ca867df58 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:01:46.326709 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-33312c6e-75c5-4238-8c4f-af1ca867df58 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: 5d81ae67-aa50-42d6-aae8-c6a348fa2fa1] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:01:46.333145 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-33312c6e-75c5-4238-8c4f-af1ca867df58 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:46.333593 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-33312c6e-75c5-4238-8c4f-af1ca867df58 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:46.334390 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-33312c6e-75c5-4238-8c4f-af1ca867df58 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:46.334829 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-33312c6e-75c5-4238-8c4f-af1ca867df58 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:46.368129 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-33312c6e-75c5-4238-8c4f-af1ca867df58 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:46.368579 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-33312c6e-75c5-4238-8c4f-af1ca867df58 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:46.369033 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-33312c6e-75c5-4238-8c4f-af1ca867df58 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lazy-loading 'fault' on Instance uuid 5d81ae67-aa50-42d6-aae8-c6a348fa2fa1 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:01:46.411512 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-33312c6e-75c5-4238-8c4f-af1ca867df58 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078314d7d6534a1fb9abb7d1a293ea74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2450726bf484f0c9c5252c88c2bfacb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:01:46.418857 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-33312c6e-75c5-4238-8c4f-af1ca867df58 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] 10.222.0.46 "GET /compute/v2.1/servers/5d81ae67-aa50-42d6-aae8-c6a348fa2fa1" status: 200 len: 1335 microversion: 2.1 time: 0.097178 Jul 28 11:01:46.419418 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 708/1440] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:01:46 2022] GET /compute/v2.1/servers/5d81ae67-aa50-42d6-aae8-c6a348fa2fa1 => generated 1335 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:01:46.440389 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-15a7117a-6489-4d1e-96ca-507dbf6417bd tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:01:46.440872 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-15a7117a-6489-4d1e-96ca-507dbf6417bd tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: 5d81ae67-aa50-42d6-aae8-c6a348fa2fa1] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:01:46.447285 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-15a7117a-6489-4d1e-96ca-507dbf6417bd tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:46.447741 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-15a7117a-6489-4d1e-96ca-507dbf6417bd tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:46.448508 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-15a7117a-6489-4d1e-96ca-507dbf6417bd tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:46.448956 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-15a7117a-6489-4d1e-96ca-507dbf6417bd tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:46.474141 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-15a7117a-6489-4d1e-96ca-507dbf6417bd tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: 5d81ae67-aa50-42d6-aae8-c6a348fa2fa1] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:01:46.522743 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-15a7117a-6489-4d1e-96ca-507dbf6417bd tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: 5d81ae67-aa50-42d6-aae8-c6a348fa2fa1] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 11:01:46.523547 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-15a7117a-6489-4d1e-96ca-507dbf6417bd tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:46.523997 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-15a7117a-6489-4d1e-96ca-507dbf6417bd tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:46.524441 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-15a7117a-6489-4d1e-96ca-507dbf6417bd tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: 5d81ae67-aa50-42d6-aae8-c6a348fa2fa1] instance's host None is down, deleting from database Jul 28 11:01:46.528091 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-15a7117a-6489-4d1e-96ca-507dbf6417bd tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: 5d81ae67-aa50-42d6-aae8-c6a348fa2fa1] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 11:01:46.562252 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-15a7117a-6489-4d1e-96ca-507dbf6417bd tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: 5d81ae67-aa50-42d6-aae8-c6a348fa2fa1] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 11:01:46.568767 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-15a7117a-6489-4d1e-96ca-507dbf6417bd tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: 5d81ae67-aa50-42d6-aae8-c6a348fa2fa1] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:01:46.711621 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-15a7117a-6489-4d1e-96ca-507dbf6417bd tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5d81ae67-aa50-42d6-aae8-c6a348fa2fa1" status: 204 len: 0 microversion: 2.1 time: 0.275209 Jul 28 11:01:46.712131 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 733/1441] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 11:01:46 2022] DELETE /compute/v2.1/servers/5d81ae67-aa50-42d6-aae8-c6a348fa2fa1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:01:46.720236 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1fd0d9a3-5106-4dca-9631-7183d8d3bdd8 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:01:46.720852 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1fd0d9a3-5106-4dca-9631-7183d8d3bdd8 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] [instance: 5d81ae67-aa50-42d6-aae8-c6a348fa2fa1] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:01:46.727410 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1fd0d9a3-5106-4dca-9631-7183d8d3bdd8 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:46.727862 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1fd0d9a3-5106-4dca-9631-7183d8d3bdd8 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:46.728633 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1fd0d9a3-5106-4dca-9631-7183d8d3bdd8 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:01:46.729072 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1fd0d9a3-5106-4dca-9631-7183d8d3bdd8 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:01:46.742018 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-1fd0d9a3-5106-4dca-9631-7183d8d3bdd8 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] HTTP exception thrown: Instance 5d81ae67-aa50-42d6-aae8-c6a348fa2fa1 could not be found. Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1fd0d9a3-5106-4dca-9631-7183d8d3bdd8 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Request method failure captured: Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/5d81ae67-aa50-42d6-aae8-c6a348fa2fa1 HTTP/1.1 Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4myObF6SGQPnh63t7uasLFfCEOnvl4DB62ENpSgrB4bu4d2W7YB3DciNDlMsMGK4j_4b9mWuTpLA392duOAJpP4VdOCL4buosmVGfleBflXTsNFYq7-1VThtwOrArt-HbaFY_IKhmCQTuBAU9BF-bpYkkx8tvyKWBixTzxdlty0D2BE Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: c2450726bf484f0c9c5252c88c2bfacb Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-TestEncryptedCinderVolumes-933380625 Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c2450726bf484f0c9c5252c88c2bfacb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c2450726bf484f0c9c5252c88c2bfacb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c2450726bf484f0c9c5252c88c2bfacb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c2450726bf484f0c9c5252c88c2bfacb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-TestEncryptedCinderVolumes-933380625 Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: c2450726bf484f0c9c5252c88c2bfacb Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-933380625 Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-TestEncryptedCinderVolumes-933380625-project Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 078314d7d6534a1fb9abb7d1a293ea74 Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-TestEncryptedCinderVolumes-933380625-project Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 5d81ae67-aa50-42d6-aae8-c6a348fa2fa1 could not be found. Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '5d81ae67-aa50-42d6-aae8-c6a348fa2fa1'} Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d81ae67-aa50-42d6-aae8-c6a348fa2fa1 could not be found. Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d81ae67-aa50-42d6-aae8-c6a348fa2fa1 could not be found. Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:01:46.743536 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:01:46.748300 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:01:46.748300 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:01:46.748300 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:01:46.748300 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:01:46.748300 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:01:46.748300 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d81ae67-aa50-42d6-aae8-c6a348fa2fa1 could not be found. Jul 28 11:01:46.748300 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:01:46.748300 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1fd0d9a3-5106-4dca-9631-7183d8d3bdd8 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Returning 404 to user: Instance 5d81ae67-aa50-42d6-aae8-c6a348fa2fa1 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:01:46.748300 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-1fd0d9a3-5106-4dca-9631-7183d8d3bdd8 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] 10.222.0.46 "GET /compute/v2.1/servers/5d81ae67-aa50-42d6-aae8-c6a348fa2fa1" status: 404 len: 111 microversion: 2.1 time: 0.028509 Jul 28 11:01:46.748300 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 709/1442] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:01:46 2022] GET /compute/v2.1/servers/5d81ae67-aa50-42d6-aae8-c6a348fa2fa1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:01:46.754540 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-7e7d9836-c942-45eb-8ad7-5953c732cbc6 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] Calling method '.version_select at 0x7fa94b588550>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:01:46.773566 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-7e7d9836-c942-45eb-8ad7-5953c732cbc6 tempest-TestEncryptedCinderVolumes-933380625 tempest-TestEncryptedCinderVolumes-933380625-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-482907310" status: 202 len: 0 microversion: 2.1 time: 0.023083 Jul 28 11:01:46.774181 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 734/1443] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Jul 28 11:01:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-482907310 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:02:06.369494 n-d-850468-6 devstack@n-api.service[119463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 11:02:06.370098 n-d-850468-6 devstack@n-api.service[119463]: Thu Jul 28 11:02:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 11:02:13.552276 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8606a510-6bd6-42a6-b387-40e9990379b2 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Action: 'create', calling method: .version_select at 0x7fa94b82c8b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-837154815", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiyBq789bZyTv2ofCDbn+9kbQcvQzKh9ws3LB67RDLZslODGjV1RNT8j7M07ejlOBNP14bc+EiYjNlcfyMj0gQ7SLPR8p7crpQTAvXFfkFEGg7SRtwwITp1Grg5fkSD2A=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:02:13.559100 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:13.559750 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=18 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:13.560402 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:13.561018 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=48,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:13.575831 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-8606a510-6bd6-42a6-b387-40e9990379b2 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Getting quotas for project 3ed5dc9d02e245a99855f7ecfb4531b4. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:02:13.582726 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-8606a510-6bd6-42a6-b387-40e9990379b2 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Getting quotas for user 123b006f97414c13a737254f1d99741d and project 3ed5dc9d02e245a99855f7ecfb4531b4. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:02:13.607880 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-8606a510-6bd6-42a6-b387-40e9990379b2 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.060599 Jul 28 11:02:13.608524 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 710/1444] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 11:02:13 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:02:13.655438 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:13.656267 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=18 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:13.657240 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=60,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:13.658091 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:13.662685 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-367487164", "imageRef": "756091b7-20d8-4946-bc5e-39172f8e0a20", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-837154815", "networks": [{"uuid": "30acdba7-d65b-4f12-9d0e-c5e687339399"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:02:13.718176 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] validate_networks() for [('30acdba7-d65b-4f12-9d0e-c5e687339399', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:02:14.216509 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:02:14.216935 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:02:14.217444 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:02:14.217851 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:02:14.218287 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:02:14.227163 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:14.227611 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:14.228417 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:14.228892 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:14.245320 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Getting quotas for project 3ed5dc9d02e245a99855f7ecfb4531b4. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:02:14.250345 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Getting quotas for user 123b006f97414c13a737254f1d99741d and project 3ed5dc9d02e245a99855f7ecfb4531b4. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:02:14.262732 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:02:14.264745 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 7ea76309-6eb6-42ed-bbdf-169eb8ac17a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='756091b7-20d8-4946-bc5e-39172f8e0a20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:02:14.309154 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1fb88d65-3ea5-4149-ba25-1f330569a762 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654489 Jul 28 11:02:14.309803 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 735/1445] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 11:02:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:02:14.321071 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b4aad821-22a1-4149-be38-dc35275760fb tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:02:14.321684 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b4aad821-22a1-4149-be38-dc35275760fb tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 7ea76309-6eb6-42ed-bbdf-169eb8ac17a8] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:02:14.380996 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-b4aad821-22a1-4149-be38-dc35275760fb tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123b006f97414c13a737254f1d99741d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5dc9d02e245a99855f7ecfb4531b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:02:14.388650 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b4aad821-22a1-4149-be38-dc35275760fb tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] 10.222.0.46 "GET /compute/v2.1/servers/7ea76309-6eb6-42ed-bbdf-169eb8ac17a8" status: 200 len: 1257 microversion: 2.1 time: 0.071388 Jul 28 11:02:14.389213 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 711/1446] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:02:14 2022] GET /compute/v2.1/servers/7ea76309-6eb6-42ed-bbdf-169eb8ac17a8 => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:02:15.409001 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-176181cc-f12d-4e26-a332-07d68fc9e484 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:02:15.409747 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-176181cc-f12d-4e26-a332-07d68fc9e484 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 7ea76309-6eb6-42ed-bbdf-169eb8ac17a8] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:02:15.416041 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-176181cc-f12d-4e26-a332-07d68fc9e484 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:15.416495 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-176181cc-f12d-4e26-a332-07d68fc9e484 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:15.417265 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-176181cc-f12d-4e26-a332-07d68fc9e484 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:15.417708 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-176181cc-f12d-4e26-a332-07d68fc9e484 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:15.448712 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-176181cc-f12d-4e26-a332-07d68fc9e484 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:15.449167 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-176181cc-f12d-4e26-a332-07d68fc9e484 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:15.449619 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-176181cc-f12d-4e26-a332-07d68fc9e484 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lazy-loading 'fault' on Instance uuid 7ea76309-6eb6-42ed-bbdf-169eb8ac17a8 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:02:15.494363 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-176181cc-f12d-4e26-a332-07d68fc9e484 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123b006f97414c13a737254f1d99741d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5dc9d02e245a99855f7ecfb4531b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:02:15.501820 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-176181cc-f12d-4e26-a332-07d68fc9e484 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] 10.222.0.46 "GET /compute/v2.1/servers/7ea76309-6eb6-42ed-bbdf-169eb8ac17a8" status: 200 len: 1330 microversion: 2.1 time: 0.097142 Jul 28 11:02:15.502409 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 736/1447] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:02:15 2022] GET /compute/v2.1/servers/7ea76309-6eb6-42ed-bbdf-169eb8ac17a8 => generated 1330 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:02:15.521213 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-bded00f8-ebda-487d-8d5e-8b7a3b040152 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:02:15.521750 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-bded00f8-ebda-487d-8d5e-8b7a3b040152 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 7ea76309-6eb6-42ed-bbdf-169eb8ac17a8] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:02:15.529348 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bded00f8-ebda-487d-8d5e-8b7a3b040152 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:15.529794 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bded00f8-ebda-487d-8d5e-8b7a3b040152 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:15.530581 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bded00f8-ebda-487d-8d5e-8b7a3b040152 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:15.531014 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bded00f8-ebda-487d-8d5e-8b7a3b040152 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:15.555371 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-bded00f8-ebda-487d-8d5e-8b7a3b040152 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 7ea76309-6eb6-42ed-bbdf-169eb8ac17a8] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:02:15.600764 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-bded00f8-ebda-487d-8d5e-8b7a3b040152 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 7ea76309-6eb6-42ed-bbdf-169eb8ac17a8] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 11:02:15.601571 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bded00f8-ebda-487d-8d5e-8b7a3b040152 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:15.602040 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-bded00f8-ebda-487d-8d5e-8b7a3b040152 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:15.602512 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-bded00f8-ebda-487d-8d5e-8b7a3b040152 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 7ea76309-6eb6-42ed-bbdf-169eb8ac17a8] instance's host None is down, deleting from database Jul 28 11:02:15.606814 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-bded00f8-ebda-487d-8d5e-8b7a3b040152 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 7ea76309-6eb6-42ed-bbdf-169eb8ac17a8] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 11:02:15.641120 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-bded00f8-ebda-487d-8d5e-8b7a3b040152 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 7ea76309-6eb6-42ed-bbdf-169eb8ac17a8] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 11:02:15.647077 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-bded00f8-ebda-487d-8d5e-8b7a3b040152 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 7ea76309-6eb6-42ed-bbdf-169eb8ac17a8] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:02:15.907801 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-bded00f8-ebda-487d-8d5e-8b7a3b040152 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7ea76309-6eb6-42ed-bbdf-169eb8ac17a8" status: 204 len: 0 microversion: 2.1 time: 0.390265 Jul 28 11:02:15.908401 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 712/1448] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 11:02:15 2022] DELETE /compute/v2.1/servers/7ea76309-6eb6-42ed-bbdf-169eb8ac17a8 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:02:15.916668 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-76a8b5f1-2187-4fd1-b298-0bbc6d471864 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:02:15.917335 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-76a8b5f1-2187-4fd1-b298-0bbc6d471864 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 7ea76309-6eb6-42ed-bbdf-169eb8ac17a8] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:02:15.923305 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-76a8b5f1-2187-4fd1-b298-0bbc6d471864 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:15.923755 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-76a8b5f1-2187-4fd1-b298-0bbc6d471864 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:15.925071 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-76a8b5f1-2187-4fd1-b298-0bbc6d471864 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:15.925509 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-76a8b5f1-2187-4fd1-b298-0bbc6d471864 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:15.938935 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-76a8b5f1-2187-4fd1-b298-0bbc6d471864 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] HTTP exception thrown: Instance 7ea76309-6eb6-42ed-bbdf-169eb8ac17a8 could not be found. Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-76a8b5f1-2187-4fd1-b298-0bbc6d471864 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Request method failure captured: Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/7ea76309-6eb6-42ed-bbdf-169eb8ac17a8 HTTP/1.1 Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mymo6dh9zXU-zmH2CcHsSgcUfRsncomV-eWdSvLn8byZ_s5hVyZO4gxQ6SXbpcCkyv8ggmJHGyykKfJvMbA5Y3DY_4FF3LsMnkd-ZGfX4Ig02wKBUvvnjGhD1nZ4IWyvJoccm5mefBCNODH6y7oor5PdfB2emsjgH3B4gVYzu_wPu4 Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 3ed5dc9d02e245a99855f7ecfb4531b4 Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-TestMinimumBasicScenario-998944329 Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3ed5dc9d02e245a99855f7ecfb4531b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3ed5dc9d02e245a99855f7ecfb4531b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3ed5dc9d02e245a99855f7ecfb4531b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3ed5dc9d02e245a99855f7ecfb4531b4", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-TestMinimumBasicScenario-998944329 Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 3ed5dc9d02e245a99855f7ecfb4531b4 Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-TestMinimumBasicScenario-998944329 Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-TestMinimumBasicScenario-998944329-project Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 123b006f97414c13a737254f1d99741d Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-TestMinimumBasicScenario-998944329-project Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 7ea76309-6eb6-42ed-bbdf-169eb8ac17a8 could not be found. Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '7ea76309-6eb6-42ed-bbdf-169eb8ac17a8'} Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ea76309-6eb6-42ed-bbdf-169eb8ac17a8 could not be found. Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ea76309-6eb6-42ed-bbdf-169eb8ac17a8 could not be found. Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:02:15.941109 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:02:15.945187 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:02:15.945187 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:02:15.945187 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:02:15.945187 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:02:15.945187 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:02:15.945187 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ea76309-6eb6-42ed-bbdf-169eb8ac17a8 could not be found. Jul 28 11:02:15.945187 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:02:15.945187 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-76a8b5f1-2187-4fd1-b298-0bbc6d471864 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Returning 404 to user: Instance 7ea76309-6eb6-42ed-bbdf-169eb8ac17a8 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:02:15.945187 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-76a8b5f1-2187-4fd1-b298-0bbc6d471864 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] 10.222.0.46 "GET /compute/v2.1/servers/7ea76309-6eb6-42ed-bbdf-169eb8ac17a8" status: 404 len: 111 microversion: 2.1 time: 0.029777 Jul 28 11:02:15.945187 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 737/1449] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:02:15 2022] GET /compute/v2.1/servers/7ea76309-6eb6-42ed-bbdf-169eb8ac17a8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:02:15.957650 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-d3b3e01e-1bc8-4179-b091-16a4a50c4fb8 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Calling method '.version_select at 0x7fa94b7095e0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:02:15.976758 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-d3b3e01e-1bc8-4179-b091-16a4a50c4fb8 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-837154815" status: 202 len: 0 microversion: 2.1 time: 0.023130 Jul 28 11:02:15.977313 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 713/1450] 10.222.0.46 () {58 vars in 1269 bytes} [Thu Jul 28 11:02:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-837154815 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:02:24.645245 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-c2010ff3-2896-4fcf-a25e-6722eaf8b92f tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Action: 'create', calling method: .version_select at 0x7fa94b5a7d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-578699860", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHArTcMi5iq2SZYEidXO6C3umwGJgte0MnSJFYBwIP75huzfhx/1w5IG+Pa/a1kYb5iHlb9CP9sf/uS5jiwQENL5SVgOvK4My8ihC6jyR0oRiX1vP3xWS6lRg6tbjPKBg=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:02:24.650516 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:24.651170 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=6 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:24.664278 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-c2010ff3-2896-4fcf-a25e-6722eaf8b92f tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Getting quotas for project 3ed5dc9d02e245a99855f7ecfb4531b4. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:02:24.669366 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-c2010ff3-2896-4fcf-a25e-6722eaf8b92f tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Getting quotas for user 123b006f97414c13a737254f1d99741d and project 3ed5dc9d02e245a99855f7ecfb4531b4. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:02:24.691869 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-c2010ff3-2896-4fcf-a25e-6722eaf8b92f tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.051054 Jul 28 11:02:24.692485 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 738/1451] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 11:02:24 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:02:24.741173 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=6 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:24.745509 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1826467665", "imageRef": "20502aec-8430-4ae9-b63f-31d38e0d4baa", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-578699860", "networks": [{"uuid": "30acdba7-d65b-4f12-9d0e-c5e687339399"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:02:24.795356 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] validate_networks() for [('30acdba7-d65b-4f12-9d0e-c5e687339399', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:02:25.164996 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:02:25.165412 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:02:25.166026 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:02:25.166427 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:02:25.166838 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:02:25.176397 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:25.176838 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:25.177632 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:25.178163 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:25.195087 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Getting quotas for project 3ed5dc9d02e245a99855f7ecfb4531b4. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:02:25.200037 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Getting quotas for user 123b006f97414c13a737254f1d99741d and project 3ed5dc9d02e245a99855f7ecfb4531b4. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:02:25.212661 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:02:25.214742 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 98846a25-edaa-411e-b51c-632597084ad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20502aec-8430-4ae9-b63f-31d38e0d4baa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:02:25.259267 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a910ecca-c43e-481c-93af-3fce3b39b587 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519315 Jul 28 11:02:25.259917 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 714/1452] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 11:02:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:02:25.271346 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-98546a82-7c30-4ebe-9666-dfe3fb967144 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:02:25.271963 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-98546a82-7c30-4ebe-9666-dfe3fb967144 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 98846a25-edaa-411e-b51c-632597084ad7] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:02:25.324537 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-98546a82-7c30-4ebe-9666-dfe3fb967144 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123b006f97414c13a737254f1d99741d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5dc9d02e245a99855f7ecfb4531b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:02:25.332641 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-98546a82-7c30-4ebe-9666-dfe3fb967144 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] 10.222.0.46 "GET /compute/v2.1/servers/98846a25-edaa-411e-b51c-632597084ad7" status: 200 len: 1258 microversion: 2.1 time: 0.065948 Jul 28 11:02:25.335479 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 739/1453] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:02:25 2022] GET /compute/v2.1/servers/98846a25-edaa-411e-b51c-632597084ad7 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:02:26.353596 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f7fff9b4-442f-4e68-b804-a6d35524e968 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:02:26.354260 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-f7fff9b4-442f-4e68-b804-a6d35524e968 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 98846a25-edaa-411e-b51c-632597084ad7] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:02:26.360332 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f7fff9b4-442f-4e68-b804-a6d35524e968 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:26.360773 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f7fff9b4-442f-4e68-b804-a6d35524e968 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:26.362224 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f7fff9b4-442f-4e68-b804-a6d35524e968 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:26.362657 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f7fff9b4-442f-4e68-b804-a6d35524e968 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:26.391900 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f7fff9b4-442f-4e68-b804-a6d35524e968 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:26.392487 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-f7fff9b4-442f-4e68-b804-a6d35524e968 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:26.392849 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-f7fff9b4-442f-4e68-b804-a6d35524e968 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lazy-loading 'fault' on Instance uuid 98846a25-edaa-411e-b51c-632597084ad7 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:02:26.433809 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-f7fff9b4-442f-4e68-b804-a6d35524e968 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '123b006f97414c13a737254f1d99741d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5dc9d02e245a99855f7ecfb4531b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:02:26.441322 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f7fff9b4-442f-4e68-b804-a6d35524e968 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] 10.222.0.46 "GET /compute/v2.1/servers/98846a25-edaa-411e-b51c-632597084ad7" status: 200 len: 1331 microversion: 2.1 time: 0.092239 Jul 28 11:02:26.441905 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 715/1454] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:02:26 2022] GET /compute/v2.1/servers/98846a25-edaa-411e-b51c-632597084ad7 => generated 1331 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:02:26.461439 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a1f8da6a-1ebb-46e9-8daa-0c20a73f9649 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:02:26.461963 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a1f8da6a-1ebb-46e9-8daa-0c20a73f9649 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 98846a25-edaa-411e-b51c-632597084ad7] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:02:26.463808 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=12 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:26.469257 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a1f8da6a-1ebb-46e9-8daa-0c20a73f9649 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:26.469703 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a1f8da6a-1ebb-46e9-8daa-0c20a73f9649 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:26.471022 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a1f8da6a-1ebb-46e9-8daa-0c20a73f9649 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:26.471662 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a1f8da6a-1ebb-46e9-8daa-0c20a73f9649 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:26.495666 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a1f8da6a-1ebb-46e9-8daa-0c20a73f9649 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 98846a25-edaa-411e-b51c-632597084ad7] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:02:26.542063 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a1f8da6a-1ebb-46e9-8daa-0c20a73f9649 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 98846a25-edaa-411e-b51c-632597084ad7] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 11:02:26.542886 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a1f8da6a-1ebb-46e9-8daa-0c20a73f9649 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:26.543369 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a1f8da6a-1ebb-46e9-8daa-0c20a73f9649 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:26.543815 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-a1f8da6a-1ebb-46e9-8daa-0c20a73f9649 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 98846a25-edaa-411e-b51c-632597084ad7] instance's host None is down, deleting from database Jul 28 11:02:26.547159 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-a1f8da6a-1ebb-46e9-8daa-0c20a73f9649 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 98846a25-edaa-411e-b51c-632597084ad7] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 11:02:26.581752 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-a1f8da6a-1ebb-46e9-8daa-0c20a73f9649 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 98846a25-edaa-411e-b51c-632597084ad7] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 11:02:26.587750 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-a1f8da6a-1ebb-46e9-8daa-0c20a73f9649 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 98846a25-edaa-411e-b51c-632597084ad7] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:02:26.732102 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a1f8da6a-1ebb-46e9-8daa-0c20a73f9649 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] 10.222.0.46 "DELETE /compute/v2.1/servers/98846a25-edaa-411e-b51c-632597084ad7" status: 204 len: 0 microversion: 2.1 time: 0.274692 Jul 28 11:02:26.732675 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 740/1455] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 11:02:26 2022] DELETE /compute/v2.1/servers/98846a25-edaa-411e-b51c-632597084ad7 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:02:26.741894 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c013a4f9-2639-4077-873f-65ae5222ef11 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:02:26.742695 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-c013a4f9-2639-4077-873f-65ae5222ef11 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] [instance: 98846a25-edaa-411e-b51c-632597084ad7] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:02:26.749236 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c013a4f9-2639-4077-873f-65ae5222ef11 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:26.749712 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c013a4f9-2639-4077-873f-65ae5222ef11 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:26.750514 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c013a4f9-2639-4077-873f-65ae5222ef11 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:26.750950 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-c013a4f9-2639-4077-873f-65ae5222ef11 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:26.764446 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-c013a4f9-2639-4077-873f-65ae5222ef11 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] HTTP exception thrown: Instance 98846a25-edaa-411e-b51c-632597084ad7 could not be found. Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c013a4f9-2639-4077-873f-65ae5222ef11 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Request method failure captured: Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/98846a25-edaa-411e-b51c-632597084ad7 HTTP/1.1 Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mymo6dh9zXU-zmH2CcHsSgcUfRsncomV-eWdSvLn8byZ_s5hVyZO4gxQ6SXbpcCkyv8ggmJHGyykKfJvMbA5Y3DY_4FF3LsMnkd-ZGfX4Ig02wKBUvvnjGhD1nZ4IWyvJoccm5mefBCNODH6y7oor5PdfB2emsjgH3B4gVYzu_wPu4 Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 3ed5dc9d02e245a99855f7ecfb4531b4 Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-TestMinimumBasicScenario-998944329 Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3ed5dc9d02e245a99855f7ecfb4531b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3ed5dc9d02e245a99855f7ecfb4531b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3ed5dc9d02e245a99855f7ecfb4531b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3ed5dc9d02e245a99855f7ecfb4531b4", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-TestMinimumBasicScenario-998944329 Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 3ed5dc9d02e245a99855f7ecfb4531b4 Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-TestMinimumBasicScenario-998944329 Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-TestMinimumBasicScenario-998944329-project Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 123b006f97414c13a737254f1d99741d Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-TestMinimumBasicScenario-998944329-project Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 98846a25-edaa-411e-b51c-632597084ad7 could not be found. Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '98846a25-edaa-411e-b51c-632597084ad7'} Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98846a25-edaa-411e-b51c-632597084ad7 could not be found. Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98846a25-edaa-411e-b51c-632597084ad7 could not be found. Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:02:26.766014 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:02:26.771266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:02:26.771266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:02:26.771266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:02:26.771266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:02:26.771266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:02:26.771266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98846a25-edaa-411e-b51c-632597084ad7 could not be found. Jul 28 11:02:26.771266 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:02:26.771266 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c013a4f9-2639-4077-873f-65ae5222ef11 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Returning 404 to user: Instance 98846a25-edaa-411e-b51c-632597084ad7 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:02:26.771266 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c013a4f9-2639-4077-873f-65ae5222ef11 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] 10.222.0.46 "GET /compute/v2.1/servers/98846a25-edaa-411e-b51c-632597084ad7" status: 404 len: 111 microversion: 2.1 time: 0.029714 Jul 28 11:02:26.771266 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 716/1456] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:02:26 2022] GET /compute/v2.1/servers/98846a25-edaa-411e-b51c-632597084ad7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:02:26.777025 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-32a8d2fc-2adb-4b8f-a85a-769dda9d9c85 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] Calling method '.version_select at 0x7fa94b588a60>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:02:26.797459 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-32a8d2fc-2adb-4b8f-a85a-769dda9d9c85 tempest-TestMinimumBasicScenario-998944329 tempest-TestMinimumBasicScenario-998944329-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-578699860" status: 202 len: 0 microversion: 2.1 time: 0.024256 Jul 28 11:02:26.798068 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 741/1457] 10.222.0.46 () {58 vars in 1269 bytes} [Thu Jul 28 11:02:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-578699860 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:02:35.847377 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:35.848255 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=6 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:36.011725 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-f0bcc0ba-b7d6-4ab0-8255-d99d634cb4a5 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Action: 'create', calling method: .version_select at 0x7fa94b7ba5e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1076211825", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9CBySQxRLAxsvynq+GrvOy5ldsUN+Ge7mMEPzbr1tMP1At3plQFz1r75SY4suO/Jg/0cxef9oSpEz/G/a0kLfBQ4QSczAdLXTpxv3XM2AM6j3qkgjdSBsf66OEjPcTSA=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:02:36.027437 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-f0bcc0ba-b7d6-4ab0-8255-d99d634cb4a5 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Getting quotas for project 7541db534c7e440e98bf4498391d8c43. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:02:36.033797 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-f0bcc0ba-b7d6-4ab0-8255-d99d634cb4a5 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Getting quotas for user 910c71b0a6fe4662a1ed469a3fd8a22c and project 7541db534c7e440e98bf4498391d8c43. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:02:36.058862 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-f0bcc0ba-b7d6-4ab0-8255-d99d634cb4a5 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.216976 Jul 28 11:02:36.059450 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 717/1458] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 11:02:35 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:02:42.077927 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=6 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:42.078792 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:42.079676 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:42.084417 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1182266887", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "483e27d7-bdc8-4517-bb31-6370f7d1cd9e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1076211825", "security_groups": [{"name": "tempest-secgroup-smoke-1268259494"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:02:42.214582 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] validate_networks() for [('483e27d7-bdc8-4517-bb31-6370f7d1cd9e', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:02:42.626097 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:02:42.627147 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:02:42.627724 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:02:42.628206 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:02:42.628663 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:02:42.637748 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:42.638242 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:42.639038 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:42.639471 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:42.657709 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Getting quotas for project 7541db534c7e440e98bf4498391d8c43. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:02:42.662738 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Getting quotas for user 910c71b0a6fe4662a1ed469a3fd8a22c and project 7541db534c7e440e98bf4498391d8c43. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:02:42.675680 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:02:42.677806 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9e697b48-c3a0-4f5d-88b0-4ae69aac67a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:02:42.724596 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e2668c26-b61e-4a5d-9343-668ccad71b9b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.647222 Jul 28 11:02:42.725266 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 742/1459] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 11:02:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 11:02:42.732888 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=36,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:42.738495 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-844db7ed-fabe-473d-8fec-0459e258910d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:02:42.739116 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-844db7ed-fabe-473d-8fec-0459e258910d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9e697b48-c3a0-4f5d-88b0-4ae69aac67a1] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:02:42.807671 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-844db7ed-fabe-473d-8fec-0459e258910d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910c71b0a6fe4662a1ed469a3fd8a22c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7541db534c7e440e98bf4498391d8c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:02:42.818081 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-844db7ed-fabe-473d-8fec-0459e258910d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "GET /compute/v2.1/servers/9e697b48-c3a0-4f5d-88b0-4ae69aac67a1" status: 200 len: 1267 microversion: 2.1 time: 0.085788 Jul 28 11:02:42.819417 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 718/1460] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:02:42 2022] GET /compute/v2.1/servers/9e697b48-c3a0-4f5d-88b0-4ae69aac67a1 => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:02:43.842495 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9f6898b5-3062-453c-9cbf-295f26cfb4b1 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:02:43.843249 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-9f6898b5-3062-453c-9cbf-295f26cfb4b1 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9e697b48-c3a0-4f5d-88b0-4ae69aac67a1] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:02:43.851295 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9f6898b5-3062-453c-9cbf-295f26cfb4b1 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:43.851848 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9f6898b5-3062-453c-9cbf-295f26cfb4b1 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:43.852715 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9f6898b5-3062-453c-9cbf-295f26cfb4b1 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:43.853224 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9f6898b5-3062-453c-9cbf-295f26cfb4b1 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:43.885487 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9f6898b5-3062-453c-9cbf-295f26cfb4b1 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:43.886009 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9f6898b5-3062-453c-9cbf-295f26cfb4b1 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:43.886450 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-9f6898b5-3062-453c-9cbf-295f26cfb4b1 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lazy-loading 'fault' on Instance uuid 9e697b48-c3a0-4f5d-88b0-4ae69aac67a1 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:02:43.933991 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-9f6898b5-3062-453c-9cbf-295f26cfb4b1 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910c71b0a6fe4662a1ed469a3fd8a22c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7541db534c7e440e98bf4498391d8c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:02:43.943426 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9f6898b5-3062-453c-9cbf-295f26cfb4b1 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "GET /compute/v2.1/servers/9e697b48-c3a0-4f5d-88b0-4ae69aac67a1" status: 200 len: 1340 microversion: 2.1 time: 0.106635 Jul 28 11:02:43.944217 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 743/1461] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:02:43 2022] GET /compute/v2.1/servers/9e697b48-c3a0-4f5d-88b0-4ae69aac67a1 => generated 1340 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:02:43.965547 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-1a4066cb-1ec9-4219-b2ff-406ced71289f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:02:43.966350 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1a4066cb-1ec9-4219-b2ff-406ced71289f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9e697b48-c3a0-4f5d-88b0-4ae69aac67a1] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:02:43.968850 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:44.001644 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1a4066cb-1ec9-4219-b2ff-406ced71289f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:44.002655 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1a4066cb-1ec9-4219-b2ff-406ced71289f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:44.003690 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1a4066cb-1ec9-4219-b2ff-406ced71289f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:44.004304 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1a4066cb-1ec9-4219-b2ff-406ced71289f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:44.051283 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1a4066cb-1ec9-4219-b2ff-406ced71289f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9e697b48-c3a0-4f5d-88b0-4ae69aac67a1] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:02:44.114360 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-1a4066cb-1ec9-4219-b2ff-406ced71289f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9e697b48-c3a0-4f5d-88b0-4ae69aac67a1] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 11:02:44.115190 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1a4066cb-1ec9-4219-b2ff-406ced71289f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:44.115637 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-1a4066cb-1ec9-4219-b2ff-406ced71289f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:44.116280 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-1a4066cb-1ec9-4219-b2ff-406ced71289f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9e697b48-c3a0-4f5d-88b0-4ae69aac67a1] instance's host None is down, deleting from database Jul 28 11:02:44.120038 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-1a4066cb-1ec9-4219-b2ff-406ced71289f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9e697b48-c3a0-4f5d-88b0-4ae69aac67a1] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 11:02:44.166355 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-1a4066cb-1ec9-4219-b2ff-406ced71289f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9e697b48-c3a0-4f5d-88b0-4ae69aac67a1] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 11:02:44.172010 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-1a4066cb-1ec9-4219-b2ff-406ced71289f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9e697b48-c3a0-4f5d-88b0-4ae69aac67a1] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:02:44.332787 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-1a4066cb-1ec9-4219-b2ff-406ced71289f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9e697b48-c3a0-4f5d-88b0-4ae69aac67a1" status: 204 len: 0 microversion: 2.1 time: 0.371761 Jul 28 11:02:44.333587 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 719/1462] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 11:02:43 2022] DELETE /compute/v2.1/servers/9e697b48-c3a0-4f5d-88b0-4ae69aac67a1 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:02:44.341397 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-70050194-8267-4f08-9142-c4103415ab2d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:02:44.342310 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-70050194-8267-4f08-9142-c4103415ab2d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9e697b48-c3a0-4f5d-88b0-4ae69aac67a1] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:02:44.353416 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-70050194-8267-4f08-9142-c4103415ab2d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:44.353879 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-70050194-8267-4f08-9142-c4103415ab2d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:44.354670 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-70050194-8267-4f08-9142-c4103415ab2d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:44.355114 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-70050194-8267-4f08-9142-c4103415ab2d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:44.369809 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-70050194-8267-4f08-9142-c4103415ab2d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] HTTP exception thrown: Instance 9e697b48-c3a0-4f5d-88b0-4ae69aac67a1 could not be found. Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-70050194-8267-4f08-9142-c4103415ab2d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Request method failure captured: Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/9e697b48-c3a0-4f5d-88b0-4ae69aac67a1 HTTP/1.1 Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mzLY5sx_wPQ99cZ-2c2gT5zatpSvBGlb-sVyX90i6QnceSm826uV1N_DY2F-2ZdUVMRip_5_eJFkZn5x75jdAkxZ7GWIh3LQwwRt1e51SkcVxZzF8pRFvyq_nyHHFv2lSg_hmC891dhMH16Dn_RBCQDzJp43dlALftuFYaFKdpeXvs Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 7541db534c7e440e98bf4498391d8c43 Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-782153613 Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7541db534c7e440e98bf4498391d8c43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7541db534c7e440e98bf4498391d8c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7541db534c7e440e98bf4498391d8c43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7541db534c7e440e98bf4498391d8c43", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-TestNetworkAdvancedServerOps-782153613 Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 7541db534c7e440e98bf4498391d8c43 Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-782153613 Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-TestNetworkAdvancedServerOps-782153613-project Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 910c71b0a6fe4662a1ed469a3fd8a22c Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-TestNetworkAdvancedServerOps-782153613-project Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 9e697b48-c3a0-4f5d-88b0-4ae69aac67a1 could not be found. Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '9e697b48-c3a0-4f5d-88b0-4ae69aac67a1'} Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e697b48-c3a0-4f5d-88b0-4ae69aac67a1 could not be found. Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e697b48-c3a0-4f5d-88b0-4ae69aac67a1 could not be found. Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:02:44.371388 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:02:44.376844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:02:44.376844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:02:44.376844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:02:44.376844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:02:44.376844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:02:44.376844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e697b48-c3a0-4f5d-88b0-4ae69aac67a1 could not be found. Jul 28 11:02:44.376844 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:02:44.378353 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-70050194-8267-4f08-9142-c4103415ab2d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Returning 404 to user: Instance 9e697b48-c3a0-4f5d-88b0-4ae69aac67a1 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:02:44.379223 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-70050194-8267-4f08-9142-c4103415ab2d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "GET /compute/v2.1/servers/9e697b48-c3a0-4f5d-88b0-4ae69aac67a1" status: 404 len: 111 microversion: 2.1 time: 0.041678 Jul 28 11:02:44.379801 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 744/1463] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:02:44 2022] GET /compute/v2.1/servers/9e697b48-c3a0-4f5d-88b0-4ae69aac67a1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:02:47.459236 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-3391af3e-b421-4a82-8064-c2a0e1ca94f0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '.version_select at 0x7fa94b7e7af0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:02:47.482151 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-3391af3e-b421-4a82-8064-c2a0e1ca94f0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1076211825" status: 202 len: 0 microversion: 2.1 time: 0.027244 Jul 28 11:02:47.482672 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 720/1464] 10.222.0.46 () {58 vars in 1284 bytes} [Thu Jul 28 11:02:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1076211825 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:02:47.496759 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-2b9c405e-02e0-476a-b882-f6aaae747e88 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Action: 'create', calling method: .version_select at 0x7fa94b603790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-385988462", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCI3w61OPDky2qAygNRLQ+5OxfklJsk4t96NyCVeJCilgqY6Q/HZVgtlatIr4EDE1Ahe6n3qjqULsfHzNMQmZx1j/vKxXt05WNwSV/5Ffv4c5ZFar9JzgrAuq479GaYnxw=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:02:47.512649 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-2b9c405e-02e0-476a-b882-f6aaae747e88 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Getting quotas for project 7541db534c7e440e98bf4498391d8c43. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:02:47.518067 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-2b9c405e-02e0-476a-b882-f6aaae747e88 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Getting quotas for user 910c71b0a6fe4662a1ed469a3fd8a22c and project 7541db534c7e440e98bf4498391d8c43. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:02:47.544442 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-2b9c405e-02e0-476a-b882-f6aaae747e88 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051449 Jul 28 11:02:47.551681 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 745/1465] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 11:02:47 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:02:53.404682 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=6 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:53.409828 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1252869279", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "1b9a77fc-bea5-47d9-adc7-a2a3f2d7c2b8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-385988462", "security_groups": [{"name": "tempest-secgroup-smoke-558937515"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:02:53.517964 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] validate_networks() for [('1b9a77fc-bea5-47d9-adc7-a2a3f2d7c2b8', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:02:54.018573 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:02:54.019008 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:02:54.019495 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:02:54.019995 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:02:54.020398 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:02:54.030451 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:54.031162 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:54.032442 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:54.033173 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:54.052865 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Getting quotas for project 7541db534c7e440e98bf4498391d8c43. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:02:54.058308 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Getting quotas for user 910c71b0a6fe4662a1ed469a3fd8a22c and project 7541db534c7e440e98bf4498391d8c43. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:02:54.071984 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:02:54.074177 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 29a1fa7d-3cae-4cd1-a34a-9addc50b0963] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:02:54.141168 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-57c72002-28b8-465a-b8bc-bcd31fe7bb0b tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.737523 Jul 28 11:02:54.142347 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 721/1466] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 11:02:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:02:54.153261 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:54.158677 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-61564515-be3b-4f35-ac2a-35d2f0c375c7 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:02:54.159279 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-61564515-be3b-4f35-ac2a-35d2f0c375c7 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 29a1fa7d-3cae-4cd1-a34a-9addc50b0963] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:02:54.254489 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-61564515-be3b-4f35-ac2a-35d2f0c375c7 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910c71b0a6fe4662a1ed469a3fd8a22c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7541db534c7e440e98bf4498391d8c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:02:54.267825 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-61564515-be3b-4f35-ac2a-35d2f0c375c7 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "GET /compute/v2.1/servers/29a1fa7d-3cae-4cd1-a34a-9addc50b0963" status: 200 len: 1266 microversion: 2.1 time: 0.118372 Jul 28 11:02:54.268729 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 746/1467] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:02:54 2022] GET /compute/v2.1/servers/29a1fa7d-3cae-4cd1-a34a-9addc50b0963 => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:02:55.291444 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-663eae1e-0484-44df-a37c-dcefe056727c tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:02:55.292051 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-663eae1e-0484-44df-a37c-dcefe056727c tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 29a1fa7d-3cae-4cd1-a34a-9addc50b0963] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:02:55.298932 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-663eae1e-0484-44df-a37c-dcefe056727c tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:55.299316 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-663eae1e-0484-44df-a37c-dcefe056727c tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:55.300074 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-663eae1e-0484-44df-a37c-dcefe056727c tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:55.300678 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-663eae1e-0484-44df-a37c-dcefe056727c tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:55.332290 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-663eae1e-0484-44df-a37c-dcefe056727c tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:55.332740 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-663eae1e-0484-44df-a37c-dcefe056727c tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:55.333194 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-663eae1e-0484-44df-a37c-dcefe056727c tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lazy-loading 'fault' on Instance uuid 29a1fa7d-3cae-4cd1-a34a-9addc50b0963 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:02:55.377047 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-663eae1e-0484-44df-a37c-dcefe056727c tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910c71b0a6fe4662a1ed469a3fd8a22c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7541db534c7e440e98bf4498391d8c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:02:55.384991 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-663eae1e-0484-44df-a37c-dcefe056727c tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "GET /compute/v2.1/servers/29a1fa7d-3cae-4cd1-a34a-9addc50b0963" status: 200 len: 1339 microversion: 2.1 time: 0.097928 Jul 28 11:02:55.385572 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 722/1468] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:02:55 2022] GET /compute/v2.1/servers/29a1fa7d-3cae-4cd1-a34a-9addc50b0963 => generated 1339 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:02:55.405618 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0e209c4a-0dbf-4e93-9965-aaf62d9b949d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:02:55.407244 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0e209c4a-0dbf-4e93-9965-aaf62d9b949d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 29a1fa7d-3cae-4cd1-a34a-9addc50b0963] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:02:55.414227 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=12 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:02:55.416351 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0e209c4a-0dbf-4e93-9965-aaf62d9b949d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:55.417128 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0e209c4a-0dbf-4e93-9965-aaf62d9b949d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:55.418312 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0e209c4a-0dbf-4e93-9965-aaf62d9b949d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:55.418664 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0e209c4a-0dbf-4e93-9965-aaf62d9b949d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:55.446793 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0e209c4a-0dbf-4e93-9965-aaf62d9b949d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 29a1fa7d-3cae-4cd1-a34a-9addc50b0963] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:02:55.514977 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0e209c4a-0dbf-4e93-9965-aaf62d9b949d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 29a1fa7d-3cae-4cd1-a34a-9addc50b0963] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 11:02:55.516588 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0e209c4a-0dbf-4e93-9965-aaf62d9b949d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:55.517203 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0e209c4a-0dbf-4e93-9965-aaf62d9b949d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:55.517813 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-0e209c4a-0dbf-4e93-9965-aaf62d9b949d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 29a1fa7d-3cae-4cd1-a34a-9addc50b0963] instance's host None is down, deleting from database Jul 28 11:02:55.526593 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0e209c4a-0dbf-4e93-9965-aaf62d9b949d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 29a1fa7d-3cae-4cd1-a34a-9addc50b0963] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 11:02:55.562042 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0e209c4a-0dbf-4e93-9965-aaf62d9b949d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 29a1fa7d-3cae-4cd1-a34a-9addc50b0963] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 11:02:55.568524 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0e209c4a-0dbf-4e93-9965-aaf62d9b949d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 29a1fa7d-3cae-4cd1-a34a-9addc50b0963] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:02:55.737566 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0e209c4a-0dbf-4e93-9965-aaf62d9b949d tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "DELETE /compute/v2.1/servers/29a1fa7d-3cae-4cd1-a34a-9addc50b0963" status: 204 len: 0 microversion: 2.1 time: 0.336151 Jul 28 11:02:55.738122 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 747/1469] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 11:02:55 2022] DELETE /compute/v2.1/servers/29a1fa7d-3cae-4cd1-a34a-9addc50b0963 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:02:55.746404 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e293d07a-30d1-45bd-a9cb-869adb267ad9 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:02:55.747460 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-e293d07a-30d1-45bd-a9cb-869adb267ad9 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 29a1fa7d-3cae-4cd1-a34a-9addc50b0963] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:02:55.754552 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e293d07a-30d1-45bd-a9cb-869adb267ad9 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:55.755009 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e293d07a-30d1-45bd-a9cb-869adb267ad9 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:55.755796 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e293d07a-30d1-45bd-a9cb-869adb267ad9 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:02:55.756236 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-e293d07a-30d1-45bd-a9cb-869adb267ad9 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:02:55.771367 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-e293d07a-30d1-45bd-a9cb-869adb267ad9 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] HTTP exception thrown: Instance 29a1fa7d-3cae-4cd1-a34a-9addc50b0963 could not be found. Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e293d07a-30d1-45bd-a9cb-869adb267ad9 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Request method failure captured: Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/29a1fa7d-3cae-4cd1-a34a-9addc50b0963 HTTP/1.1 Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mzLY5sx_wPQ99cZ-2c2gT5zatpSvBGlb-sVyX90i6QnceSm826uV1N_DY2F-2ZdUVMRip_5_eJFkZn5x75jdAkxZ7GWIh3LQwwRt1e51SkcVxZzF8pRFvyq_nyHHFv2lSg_hmC891dhMH16Dn_RBCQDzJp43dlALftuFYaFKdpeXvs Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 7541db534c7e440e98bf4498391d8c43 Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-782153613 Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7541db534c7e440e98bf4498391d8c43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7541db534c7e440e98bf4498391d8c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7541db534c7e440e98bf4498391d8c43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7541db534c7e440e98bf4498391d8c43", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-TestNetworkAdvancedServerOps-782153613 Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 7541db534c7e440e98bf4498391d8c43 Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-782153613 Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-TestNetworkAdvancedServerOps-782153613-project Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 910c71b0a6fe4662a1ed469a3fd8a22c Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-TestNetworkAdvancedServerOps-782153613-project Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 29a1fa7d-3cae-4cd1-a34a-9addc50b0963 could not be found. Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '29a1fa7d-3cae-4cd1-a34a-9addc50b0963'} Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29a1fa7d-3cae-4cd1-a34a-9addc50b0963 could not be found. Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29a1fa7d-3cae-4cd1-a34a-9addc50b0963 could not be found. Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:02:55.772926 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:02:55.777491 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:02:55.777491 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:02:55.777491 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:02:55.777491 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:02:55.777491 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:02:55.777491 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29a1fa7d-3cae-4cd1-a34a-9addc50b0963 could not be found. Jul 28 11:02:55.777491 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:02:55.779084 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-e293d07a-30d1-45bd-a9cb-869adb267ad9 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Returning 404 to user: Instance 29a1fa7d-3cae-4cd1-a34a-9addc50b0963 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:02:55.780021 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-e293d07a-30d1-45bd-a9cb-869adb267ad9 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "GET /compute/v2.1/servers/29a1fa7d-3cae-4cd1-a34a-9addc50b0963" status: 404 len: 111 microversion: 2.1 time: 0.037466 Jul 28 11:02:55.780517 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 723/1470] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:02:55 2022] GET /compute/v2.1/servers/29a1fa7d-3cae-4cd1-a34a-9addc50b0963 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:02:59.118894 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-5d63ffdc-f25e-4f4a-9816-06b6040c82dc tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '.version_select at 0x7fa94b588d30>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:02:59.144528 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-5d63ffdc-f25e-4f4a-9816-06b6040c82dc tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-385988462" status: 202 len: 0 microversion: 2.1 time: 0.029492 Jul 28 11:02:59.145128 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 748/1471] 10.222.0.46 () {58 vars in 1281 bytes} [Thu Jul 28 11:02:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-385988462 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:02:59.160934 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-c8e81307-5b87-4bf4-8cba-42fd6857024a tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Action: 'create', calling method: .version_select at 0x7fa94b7bb940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1646451631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqrTTwO1oNu6lepTlHLnCtBav5LBIRSjzSFY3WnbISvB6ANzlPcic5XBP3fBSdDHuQIHV0O4qkI2G/ilKMZm+EjgdfDyIUg7KZ10OpfEs4/LJUvvGH1o0bxW5Rjnm+V5A=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:02:59.178136 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-c8e81307-5b87-4bf4-8cba-42fd6857024a tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Getting quotas for project 7541db534c7e440e98bf4498391d8c43. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:02:59.184529 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-c8e81307-5b87-4bf4-8cba-42fd6857024a tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Getting quotas for user 910c71b0a6fe4662a1ed469a3fd8a22c and project 7541db534c7e440e98bf4498391d8c43. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:02:59.209883 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-c8e81307-5b87-4bf4-8cba-42fd6857024a tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055042 Jul 28 11:02:59.210553 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 724/1472] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 11:02:59 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:03:04.675386 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=12 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:04.680205 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2044082804", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "f3289f0a-580e-4f97-b8d3-9b59be971b0a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1646451631", "security_groups": [{"name": "tempest-secgroup-smoke-190279213"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:03:04.820446 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] validate_networks() for [('f3289f0a-580e-4f97-b8d3-9b59be971b0a', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:03:05.239441 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:03:05.239866 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:03:05.240336 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:03:05.240776 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:03:05.241187 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:03:05.251293 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:05.251743 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:05.252529 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:05.252960 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:05.271757 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Getting quotas for project 7541db534c7e440e98bf4498391d8c43. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:03:05.276760 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Getting quotas for user 910c71b0a6fe4662a1ed469a3fd8a22c and project 7541db534c7e440e98bf4498391d8c43. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:03:05.289210 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:03:05.291361 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9b29d5a1-419b-41cd-b9a6-dac7fdb36880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:03:05.339479 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-a3bee922-a003-4434-9116-fd601b8049d0 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.664760 Jul 28 11:03:05.346570 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 749/1473] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 11:03:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:03:05.349172 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:05.354532 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-497d41ae-a276-4595-bd13-5b24d5f4f598 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:03:05.355355 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-497d41ae-a276-4595-bd13-5b24d5f4f598 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9b29d5a1-419b-41cd-b9a6-dac7fdb36880] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:03:05.420540 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-497d41ae-a276-4595-bd13-5b24d5f4f598 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910c71b0a6fe4662a1ed469a3fd8a22c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7541db534c7e440e98bf4498391d8c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:03:05.436272 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-497d41ae-a276-4595-bd13-5b24d5f4f598 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "GET /compute/v2.1/servers/9b29d5a1-419b-41cd-b9a6-dac7fdb36880" status: 200 len: 1267 microversion: 2.1 time: 0.084945 Jul 28 11:03:05.446665 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 725/1474] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:03:05 2022] GET /compute/v2.1/servers/9b29d5a1-419b-41cd-b9a6-dac7fdb36880 => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:03:06.454730 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-54a3a1de-5d5c-49f0-adcd-5d96be8e9226 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:03:06.455340 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-54a3a1de-5d5c-49f0-adcd-5d96be8e9226 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9b29d5a1-419b-41cd-b9a6-dac7fdb36880] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:03:06.461689 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-54a3a1de-5d5c-49f0-adcd-5d96be8e9226 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:06.462209 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-54a3a1de-5d5c-49f0-adcd-5d96be8e9226 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:06.462993 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-54a3a1de-5d5c-49f0-adcd-5d96be8e9226 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:06.463433 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-54a3a1de-5d5c-49f0-adcd-5d96be8e9226 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:06.494962 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-54a3a1de-5d5c-49f0-adcd-5d96be8e9226 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:06.495707 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-54a3a1de-5d5c-49f0-adcd-5d96be8e9226 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:06.496067 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-54a3a1de-5d5c-49f0-adcd-5d96be8e9226 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lazy-loading 'fault' on Instance uuid 9b29d5a1-419b-41cd-b9a6-dac7fdb36880 {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:03:06.538276 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-54a3a1de-5d5c-49f0-adcd-5d96be8e9226 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910c71b0a6fe4662a1ed469a3fd8a22c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7541db534c7e440e98bf4498391d8c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:03:06.546240 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-54a3a1de-5d5c-49f0-adcd-5d96be8e9226 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "GET /compute/v2.1/servers/9b29d5a1-419b-41cd-b9a6-dac7fdb36880" status: 200 len: 1340 microversion: 2.1 time: 0.095739 Jul 28 11:03:06.547094 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 750/1475] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:03:06 2022] GET /compute/v2.1/servers/9b29d5a1-419b-41cd-b9a6-dac7fdb36880 => generated 1340 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:03:06.566337 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6911c5cd-7289-499b-a269-99228d8b4634 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:03:06.567126 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-6911c5cd-7289-499b-a269-99228d8b4634 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9b29d5a1-419b-41cd-b9a6-dac7fdb36880] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:03:06.569016 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=36,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:06.575394 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6911c5cd-7289-499b-a269-99228d8b4634 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:06.575838 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6911c5cd-7289-499b-a269-99228d8b4634 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:06.576603 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6911c5cd-7289-499b-a269-99228d8b4634 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:06.577657 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6911c5cd-7289-499b-a269-99228d8b4634 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:06.607910 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-6911c5cd-7289-499b-a269-99228d8b4634 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9b29d5a1-419b-41cd-b9a6-dac7fdb36880] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:03:06.655091 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-6911c5cd-7289-499b-a269-99228d8b4634 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9b29d5a1-419b-41cd-b9a6-dac7fdb36880] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 11:03:06.655809 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6911c5cd-7289-499b-a269-99228d8b4634 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:06.656866 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6911c5cd-7289-499b-a269-99228d8b4634 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:06.657302 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-6911c5cd-7289-499b-a269-99228d8b4634 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9b29d5a1-419b-41cd-b9a6-dac7fdb36880] instance's host None is down, deleting from database Jul 28 11:03:06.661023 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-6911c5cd-7289-499b-a269-99228d8b4634 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9b29d5a1-419b-41cd-b9a6-dac7fdb36880] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 11:03:06.698802 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-6911c5cd-7289-499b-a269-99228d8b4634 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9b29d5a1-419b-41cd-b9a6-dac7fdb36880] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 11:03:06.705399 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-6911c5cd-7289-499b-a269-99228d8b4634 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9b29d5a1-419b-41cd-b9a6-dac7fdb36880] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:03:06.895657 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6911c5cd-7289-499b-a269-99228d8b4634 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9b29d5a1-419b-41cd-b9a6-dac7fdb36880" status: 204 len: 0 microversion: 2.1 time: 0.333187 Jul 28 11:03:06.896474 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 726/1476] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 11:03:06 2022] DELETE /compute/v2.1/servers/9b29d5a1-419b-41cd-b9a6-dac7fdb36880 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:06.904805 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-cb6bf48d-54b7-43bc-8f18-fd6bd5c3c476 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:03:06.905467 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-cb6bf48d-54b7-43bc-8f18-fd6bd5c3c476 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 9b29d5a1-419b-41cd-b9a6-dac7fdb36880] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:03:06.911975 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cb6bf48d-54b7-43bc-8f18-fd6bd5c3c476 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:06.912417 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cb6bf48d-54b7-43bc-8f18-fd6bd5c3c476 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:06.913191 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cb6bf48d-54b7-43bc-8f18-fd6bd5c3c476 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:06.913628 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-cb6bf48d-54b7-43bc-8f18-fd6bd5c3c476 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:06.927589 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-cb6bf48d-54b7-43bc-8f18-fd6bd5c3c476 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] HTTP exception thrown: Instance 9b29d5a1-419b-41cd-b9a6-dac7fdb36880 could not be found. Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-cb6bf48d-54b7-43bc-8f18-fd6bd5c3c476 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Request method failure captured: Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/9b29d5a1-419b-41cd-b9a6-dac7fdb36880 HTTP/1.1 Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mzLY5sx_wPQ99cZ-2c2gT5zatpSvBGlb-sVyX90i6QnceSm826uV1N_DY2F-2ZdUVMRip_5_eJFkZn5x75jdAkxZ7GWIh3LQwwRt1e51SkcVxZzF8pRFvyq_nyHHFv2lSg_hmC891dhMH16Dn_RBCQDzJp43dlALftuFYaFKdpeXvs Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 7541db534c7e440e98bf4498391d8c43 Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-782153613 Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7541db534c7e440e98bf4498391d8c43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7541db534c7e440e98bf4498391d8c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7541db534c7e440e98bf4498391d8c43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7541db534c7e440e98bf4498391d8c43", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-TestNetworkAdvancedServerOps-782153613 Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 7541db534c7e440e98bf4498391d8c43 Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-782153613 Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-TestNetworkAdvancedServerOps-782153613-project Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 910c71b0a6fe4662a1ed469a3fd8a22c Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-TestNetworkAdvancedServerOps-782153613-project Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 9b29d5a1-419b-41cd-b9a6-dac7fdb36880 could not be found. Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '9b29d5a1-419b-41cd-b9a6-dac7fdb36880'} Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b29d5a1-419b-41cd-b9a6-dac7fdb36880 could not be found. Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b29d5a1-419b-41cd-b9a6-dac7fdb36880 could not be found. Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:03:06.929139 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:03:06.934157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:03:06.934157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:03:06.934157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:03:06.934157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:03:06.934157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:03:06.934157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b29d5a1-419b-41cd-b9a6-dac7fdb36880 could not be found. Jul 28 11:03:06.934157 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:03:06.934157 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-cb6bf48d-54b7-43bc-8f18-fd6bd5c3c476 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Returning 404 to user: Instance 9b29d5a1-419b-41cd-b9a6-dac7fdb36880 could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:03:06.934157 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-cb6bf48d-54b7-43bc-8f18-fd6bd5c3c476 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "GET /compute/v2.1/servers/9b29d5a1-419b-41cd-b9a6-dac7fdb36880" status: 404 len: 111 microversion: 2.1 time: 0.029764 Jul 28 11:03:06.934157 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 751/1477] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:03:06 2022] GET /compute/v2.1/servers/9b29d5a1-419b-41cd-b9a6-dac7fdb36880 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:03:10.022113 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6e8fc632-48b5-4e79-bd91-4e4b6e6e3f56 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '.version_select at 0x7fa94b6c71f0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:03:10.042888 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6e8fc632-48b5-4e79-bd91-4e4b6e6e3f56 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1646451631" status: 202 len: 0 microversion: 2.1 time: 0.024632 Jul 28 11:03:10.048799 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 727/1478] 10.222.0.46 () {58 vars in 1284 bytes} [Thu Jul 28 11:03:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1646451631 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:03:10.058393 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1f70c8e1-0d46-4d5d-a0fa-ae99e09de95c tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Action: 'create', calling method: .version_select at 0x7fa94b6a20d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-987799355", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7h3dWOsfsrhl4winXRyuR0QOaMMXerP8ybuCSJFkRkQonBxRChkJapUBML3mDLueGuJm6LUfQYy+JCKfMnOa0nAK7bCWPYUTIT6TN5DO67xLDl/6omuA017EfCxxDh3g=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:03:10.076010 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-1f70c8e1-0d46-4d5d-a0fa-ae99e09de95c tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Getting quotas for project 7541db534c7e440e98bf4498391d8c43. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:03:10.081966 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-1f70c8e1-0d46-4d5d-a0fa-ae99e09de95c tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Getting quotas for user 910c71b0a6fe4662a1ed469a3fd8a22c and project 7541db534c7e440e98bf4498391d8c43. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:03:10.106290 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1f70c8e1-0d46-4d5d-a0fa-ae99e09de95c tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051551 Jul 28 11:03:10.106875 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 752/1479] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 11:03:10 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:03:15.872712 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=12 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:15.880386 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-325911319", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "260b16b8-39ef-42f7-8f16-b52b7deb028f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-987799355", "security_groups": [{"name": "tempest-secgroup-smoke-1360903490"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:03:15.890583 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:15.997670 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] validate_networks() for [('260b16b8-39ef-42f7-8f16-b52b7deb028f', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:03:16.415909 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:03:16.416342 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:03:16.416824 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:03:16.424290 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:03:16.424290 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:03:16.433260 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:16.434014 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:16.435455 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:16.436086 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:16.457674 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Getting quotas for project 7541db534c7e440e98bf4498391d8c43. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:03:16.465234 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Getting quotas for user 910c71b0a6fe4662a1ed469a3fd8a22c and project 7541db534c7e440e98bf4498391d8c43. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:03:16.485541 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:03:16.488695 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: b3d1756e-582a-4a3b-a898-847adc5f84c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:03:16.550659 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-5a1b025d-c0aa-47b1-951f-a14dbc0c6477 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.678572 Jul 28 11:03:16.551977 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 728/1480] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 11:03:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:03:16.563049 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-060cf098-b581-4b81-bc4f-e2ec5b59bad2 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:03:16.564716 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-060cf098-b581-4b81-bc4f-e2ec5b59bad2 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: b3d1756e-582a-4a3b-a898-847adc5f84c8] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:03:16.573394 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:16.574205 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:16.650051 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-060cf098-b581-4b81-bc4f-e2ec5b59bad2 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910c71b0a6fe4662a1ed469a3fd8a22c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7541db534c7e440e98bf4498391d8c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:03:16.666816 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-060cf098-b581-4b81-bc4f-e2ec5b59bad2 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "GET /compute/v2.1/servers/b3d1756e-582a-4a3b-a898-847adc5f84c8" status: 200 len: 1265 microversion: 2.1 time: 0.106968 Jul 28 11:03:16.670233 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 753/1481] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:03:16 2022] GET /compute/v2.1/servers/b3d1756e-582a-4a3b-a898-847adc5f84c8 => generated 1265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:03:17.689831 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-5f1736e1-3b96-44df-bfdf-58d7e60f25b3 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:03:17.690305 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-5f1736e1-3b96-44df-bfdf-58d7e60f25b3 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: b3d1756e-582a-4a3b-a898-847adc5f84c8] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:03:17.700847 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5f1736e1-3b96-44df-bfdf-58d7e60f25b3 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:17.701272 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5f1736e1-3b96-44df-bfdf-58d7e60f25b3 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:17.702103 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5f1736e1-3b96-44df-bfdf-58d7e60f25b3 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:17.702544 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5f1736e1-3b96-44df-bfdf-58d7e60f25b3 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:17.737802 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5f1736e1-3b96-44df-bfdf-58d7e60f25b3 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:17.738287 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-5f1736e1-3b96-44df-bfdf-58d7e60f25b3 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:17.738928 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-5f1736e1-3b96-44df-bfdf-58d7e60f25b3 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lazy-loading 'fault' on Instance uuid b3d1756e-582a-4a3b-a898-847adc5f84c8 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:03:17.800959 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-5f1736e1-3b96-44df-bfdf-58d7e60f25b3 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910c71b0a6fe4662a1ed469a3fd8a22c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7541db534c7e440e98bf4498391d8c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:03:17.815555 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-5f1736e1-3b96-44df-bfdf-58d7e60f25b3 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "GET /compute/v2.1/servers/b3d1756e-582a-4a3b-a898-847adc5f84c8" status: 200 len: 1338 microversion: 2.1 time: 0.130457 Jul 28 11:03:17.818084 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 729/1482] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:03:17 2022] GET /compute/v2.1/servers/b3d1756e-582a-4a3b-a898-847adc5f84c8 => generated 1338 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:03:17.836451 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-727e4fe9-fa2a-43e5-9e08-cc205ef71b5f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:03:17.837497 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-727e4fe9-fa2a-43e5-9e08-cc205ef71b5f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: b3d1756e-582a-4a3b-a898-847adc5f84c8] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:03:17.839409 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=36,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:17.845838 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-727e4fe9-fa2a-43e5-9e08-cc205ef71b5f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:17.846386 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-727e4fe9-fa2a-43e5-9e08-cc205ef71b5f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:17.847178 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-727e4fe9-fa2a-43e5-9e08-cc205ef71b5f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:17.847615 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-727e4fe9-fa2a-43e5-9e08-cc205ef71b5f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:17.874474 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-727e4fe9-fa2a-43e5-9e08-cc205ef71b5f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: b3d1756e-582a-4a3b-a898-847adc5f84c8] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:03:17.938203 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-727e4fe9-fa2a-43e5-9e08-cc205ef71b5f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: b3d1756e-582a-4a3b-a898-847adc5f84c8] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 11:03:17.939419 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-727e4fe9-fa2a-43e5-9e08-cc205ef71b5f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:17.939923 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-727e4fe9-fa2a-43e5-9e08-cc205ef71b5f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:17.940496 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-727e4fe9-fa2a-43e5-9e08-cc205ef71b5f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: b3d1756e-582a-4a3b-a898-847adc5f84c8] instance's host None is down, deleting from database Jul 28 11:03:17.945441 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-727e4fe9-fa2a-43e5-9e08-cc205ef71b5f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: b3d1756e-582a-4a3b-a898-847adc5f84c8] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 11:03:17.987592 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-727e4fe9-fa2a-43e5-9e08-cc205ef71b5f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: b3d1756e-582a-4a3b-a898-847adc5f84c8] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 11:03:17.994614 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-727e4fe9-fa2a-43e5-9e08-cc205ef71b5f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: b3d1756e-582a-4a3b-a898-847adc5f84c8] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:03:18.155087 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-727e4fe9-fa2a-43e5-9e08-cc205ef71b5f tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b3d1756e-582a-4a3b-a898-847adc5f84c8" status: 204 len: 0 microversion: 2.1 time: 0.322806 Jul 28 11:03:18.155683 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 754/1483] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 11:03:17 2022] DELETE /compute/v2.1/servers/b3d1756e-582a-4a3b-a898-847adc5f84c8 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 11:03:18.165055 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-49ec0916-650a-418c-a398-dad8a1bdd99a tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:03:18.165664 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-49ec0916-650a-418c-a398-dad8a1bdd99a tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: b3d1756e-582a-4a3b-a898-847adc5f84c8] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:03:18.171732 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-49ec0916-650a-418c-a398-dad8a1bdd99a tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:18.172239 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-49ec0916-650a-418c-a398-dad8a1bdd99a tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:18.173874 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-49ec0916-650a-418c-a398-dad8a1bdd99a tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:18.174186 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-49ec0916-650a-418c-a398-dad8a1bdd99a tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:18.188500 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-49ec0916-650a-418c-a398-dad8a1bdd99a tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] HTTP exception thrown: Instance b3d1756e-582a-4a3b-a898-847adc5f84c8 could not be found. Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-49ec0916-650a-418c-a398-dad8a1bdd99a tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Request method failure captured: Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/b3d1756e-582a-4a3b-a898-847adc5f84c8 HTTP/1.1 Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4mzLY5sx_wPQ99cZ-2c2gT5zatpSvBGlb-sVyX90i6QnceSm826uV1N_DY2F-2ZdUVMRip_5_eJFkZn5x75jdAkxZ7GWIh3LQwwRt1e51SkcVxZzF8pRFvyq_nyHHFv2lSg_hmC891dhMH16Dn_RBCQDzJp43dlALftuFYaFKdpeXvs Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 7541db534c7e440e98bf4498391d8c43 Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-782153613 Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7541db534c7e440e98bf4498391d8c43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7541db534c7e440e98bf4498391d8c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7541db534c7e440e98bf4498391d8c43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7541db534c7e440e98bf4498391d8c43", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-TestNetworkAdvancedServerOps-782153613 Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 7541db534c7e440e98bf4498391d8c43 Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-782153613 Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-TestNetworkAdvancedServerOps-782153613-project Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 910c71b0a6fe4662a1ed469a3fd8a22c Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-TestNetworkAdvancedServerOps-782153613-project Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance b3d1756e-582a-4a3b-a898-847adc5f84c8 could not be found. Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': 'b3d1756e-582a-4a3b-a898-847adc5f84c8'} Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3d1756e-582a-4a3b-a898-847adc5f84c8 could not be found. Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3d1756e-582a-4a3b-a898-847adc5f84c8 could not be found. Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:03:18.190680 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:03:18.195863 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:03:18.195863 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:03:18.195863 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:03:18.195863 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:03:18.195863 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:03:18.195863 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3d1756e-582a-4a3b-a898-847adc5f84c8 could not be found. Jul 28 11:03:18.195863 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:03:18.195863 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-49ec0916-650a-418c-a398-dad8a1bdd99a tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Returning 404 to user: Instance b3d1756e-582a-4a3b-a898-847adc5f84c8 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:03:18.195863 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-49ec0916-650a-418c-a398-dad8a1bdd99a tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "GET /compute/v2.1/servers/b3d1756e-582a-4a3b-a898-847adc5f84c8" status: 404 len: 111 microversion: 2.1 time: 0.030982 Jul 28 11:03:18.196859 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 730/1484] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:03:18 2022] GET /compute/v2.1/servers/b3d1756e-582a-4a3b-a898-847adc5f84c8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:03:21.526084 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-93f2c4e4-2457-420a-a3d0-d76751d43789 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '.version_select at 0x7fa94b588040>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:03:21.549759 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-93f2c4e4-2457-420a-a3d0-d76751d43789 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-987799355" status: 202 len: 0 microversion: 2.1 time: 0.027486 Jul 28 11:03:21.550719 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 755/1485] 10.222.0.46 () {58 vars in 1281 bytes} [Thu Jul 28 11:03:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-987799355 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:03:21.564422 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-97b94ecc-ad4d-45db-9674-e49f1dcb5cb3 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Action: 'create', calling method: .version_select at 0x7fa94b7e0e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1184781675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/8y/bSnYiG1yHaoFm0PezBEO0ENXSzG0B3CXN53cg8ezHq0Dx+gLoyRIMw9D1KItxDwdj6qI0EWGgbg6nskCSAz7o5K0Vb3M1CbAdPBuaQhWHGWnB58nHuUvMV/T+8Yg=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:03:21.580256 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-97b94ecc-ad4d-45db-9674-e49f1dcb5cb3 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Getting quotas for project 7541db534c7e440e98bf4498391d8c43. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:03:21.586022 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-97b94ecc-ad4d-45db-9674-e49f1dcb5cb3 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Getting quotas for user 910c71b0a6fe4662a1ed469a3fd8a22c and project 7541db534c7e440e98bf4498391d8c43. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:03:21.609047 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-97b94ecc-ad4d-45db-9674-e49f1dcb5cb3 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.048926 Jul 28 11:03:21.610285 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 731/1486] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 11:03:21 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:03:27.115223 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1432756070", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "networks": [{"uuid": "7441311b-d293-4fb4-99ff-ee4e6f56294b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1184781675", "security_groups": [{"name": "tempest-secgroup-smoke-344902360"}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:03:27.130308 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=12 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:27.238780 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] validate_networks() for [('7441311b-d293-4fb4-99ff-ee4e6f56294b', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:03:27.672499 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:03:27.672886 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:03:27.673368 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:03:27.673784 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:03:27.674449 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:03:27.688017 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:27.688488 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:27.693456 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:27.694247 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:27.715824 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Getting quotas for project 7541db534c7e440e98bf4498391d8c43. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:03:27.722366 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Getting quotas for user 910c71b0a6fe4662a1ed469a3fd8a22c and project 7541db534c7e440e98bf4498391d8c43. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:03:27.736752 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:03:27.738933 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:03:27.785719 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-fea2e882-b04d-4507-98f8-8265b6e5c172 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.674767 Jul 28 11:03:27.786407 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 756/1487] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 11:03:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:03:27.798786 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:27.803766 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a5bc59df-0229-4bfd-b476-e48af81abb79 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:03:27.804324 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-a5bc59df-0229-4bfd-b476-e48af81abb79 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:03:27.873603 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-a5bc59df-0229-4bfd-b476-e48af81abb79 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910c71b0a6fe4662a1ed469a3fd8a22c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7541db534c7e440e98bf4498391d8c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:03:27.882753 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a5bc59df-0229-4bfd-b476-e48af81abb79 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "GET /compute/v2.1/servers/3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b" status: 200 len: 1267 microversion: 2.1 time: 0.085925 Jul 28 11:03:27.883536 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 732/1488] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:03:27 2022] GET /compute/v2.1/servers/3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:03:28.903815 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-e9af73d4-fdf7-47f1-95e4-89a4e3a37f48 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:03:28.904499 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-e9af73d4-fdf7-47f1-95e4-89a4e3a37f48 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:03:28.911683 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e9af73d4-fdf7-47f1-95e4-89a4e3a37f48 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:28.912138 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e9af73d4-fdf7-47f1-95e4-89a4e3a37f48 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:28.912922 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e9af73d4-fdf7-47f1-95e4-89a4e3a37f48 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:28.913463 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e9af73d4-fdf7-47f1-95e4-89a4e3a37f48 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:28.945837 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e9af73d4-fdf7-47f1-95e4-89a4e3a37f48 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:28.946328 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-e9af73d4-fdf7-47f1-95e4-89a4e3a37f48 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:28.946785 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-e9af73d4-fdf7-47f1-95e4-89a4e3a37f48 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lazy-loading 'fault' on Instance uuid 3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:03:28.994394 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-e9af73d4-fdf7-47f1-95e4-89a4e3a37f48 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910c71b0a6fe4662a1ed469a3fd8a22c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7541db534c7e440e98bf4498391d8c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:03:29.002946 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-e9af73d4-fdf7-47f1-95e4-89a4e3a37f48 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "GET /compute/v2.1/servers/3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b" status: 200 len: 1340 microversion: 2.1 time: 0.102931 Jul 28 11:03:29.003533 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 757/1489] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:03:28 2022] GET /compute/v2.1/servers/3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b => generated 1340 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:03:29.023000 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-cbccaa62-76cc-4fd5-b4ec-2dbfec564d8e tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:03:29.023568 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-cbccaa62-76cc-4fd5-b4ec-2dbfec564d8e tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:03:29.025461 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=36,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:29.032875 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cbccaa62-76cc-4fd5-b4ec-2dbfec564d8e tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:29.033328 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cbccaa62-76cc-4fd5-b4ec-2dbfec564d8e tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:29.034160 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cbccaa62-76cc-4fd5-b4ec-2dbfec564d8e tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:29.034602 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cbccaa62-76cc-4fd5-b4ec-2dbfec564d8e tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:29.064783 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-cbccaa62-76cc-4fd5-b4ec-2dbfec564d8e tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:03:29.113321 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-cbccaa62-76cc-4fd5-b4ec-2dbfec564d8e tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 11:03:29.114152 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cbccaa62-76cc-4fd5-b4ec-2dbfec564d8e tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:29.114602 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-cbccaa62-76cc-4fd5-b4ec-2dbfec564d8e tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:29.115044 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-cbccaa62-76cc-4fd5-b4ec-2dbfec564d8e tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b] instance's host None is down, deleting from database Jul 28 11:03:29.119110 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-cbccaa62-76cc-4fd5-b4ec-2dbfec564d8e tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 11:03:29.160259 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-cbccaa62-76cc-4fd5-b4ec-2dbfec564d8e tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 11:03:29.166371 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-cbccaa62-76cc-4fd5-b4ec-2dbfec564d8e tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:03:29.345974 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-cbccaa62-76cc-4fd5-b4ec-2dbfec564d8e tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b" status: 204 len: 0 microversion: 2.1 time: 0.325664 Jul 28 11:03:29.350030 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 733/1490] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 11:03:29 2022] DELETE /compute/v2.1/servers/3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 11:03:29.360184 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-49ca1263-3c44-417c-9dcc-4ccb0ed08396 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:03:29.361688 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-49ca1263-3c44-417c-9dcc-4ccb0ed08396 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] [instance: 3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:03:29.370377 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-49ca1263-3c44-417c-9dcc-4ccb0ed08396 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:29.371197 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-49ca1263-3c44-417c-9dcc-4ccb0ed08396 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:29.372418 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-49ca1263-3c44-417c-9dcc-4ccb0ed08396 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:29.373133 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-49ca1263-3c44-417c-9dcc-4ccb0ed08396 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:29.388291 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-49ca1263-3c44-417c-9dcc-4ccb0ed08396 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] HTTP exception thrown: Instance 3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b could not be found. Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-49ca1263-3c44-417c-9dcc-4ccb0ed08396 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Request method failure captured: Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b HTTP/1.1 Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4mzLY5sx_wPQ99cZ-2c2gT5zatpSvBGlb-sVyX90i6QnceSm826uV1N_DY2F-2ZdUVMRip_5_eJFkZn5x75jdAkxZ7GWIh3LQwwRt1e51SkcVxZzF8pRFvyq_nyHHFv2lSg_hmC891dhMH16Dn_RBCQDzJp43dlALftuFYaFKdpeXvs Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: 7541db534c7e440e98bf4498391d8c43 Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-782153613 Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7541db534c7e440e98bf4498391d8c43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7541db534c7e440e98bf4498391d8c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7541db534c7e440e98bf4498391d8c43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7541db534c7e440e98bf4498391d8c43", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-TestNetworkAdvancedServerOps-782153613 Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: 7541db534c7e440e98bf4498391d8c43 Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-782153613 Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-TestNetworkAdvancedServerOps-782153613-project Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 910c71b0a6fe4662a1ed469a3fd8a22c Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-TestNetworkAdvancedServerOps-782153613-project Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance 3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b could not be found. Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': '3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b'} Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b could not be found. Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b could not be found. Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:03:29.390231 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:03:29.395002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:03:29.395002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:03:29.395002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:03:29.395002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:03:29.395002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:03:29.395002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b could not be found. Jul 28 11:03:29.395002 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:03:29.396818 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-49ca1263-3c44-417c-9dcc-4ccb0ed08396 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Returning 404 to user: Instance 3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:03:29.397882 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-49ca1263-3c44-417c-9dcc-4ccb0ed08396 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "GET /compute/v2.1/servers/3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b" status: 404 len: 111 microversion: 2.1 time: 0.043424 Jul 28 11:03:29.398500 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 758/1491] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:03:29 2022] GET /compute/v2.1/servers/3c90429d-4ff4-4cc4-8c8d-3aa415dafd0b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:03:33.029126 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6aae392f-88b2-4ff4-8329-54af06cb5783 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] Calling method '.version_select at 0x7fa94b73ed30>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:03:33.057217 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6aae392f-88b2-4ff4-8329-54af06cb5783 tempest-TestNetworkAdvancedServerOps-782153613 tempest-TestNetworkAdvancedServerOps-782153613-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1184781675" status: 202 len: 0 microversion: 2.1 time: 0.031928 Jul 28 11:03:33.057791 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 734/1492] 10.222.0.46 () {58 vars in 1284 bytes} [Thu Jul 28 11:03:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1184781675 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:03:44.074088 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:44.076176 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=6 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:44.076176 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:44.076860 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=36,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:44.263247 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-910f1a61-8150-4f84-8330-deca76ba4b2c tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Action: 'create', calling method: .version_select at 0x7fa94b5a7160>, body: {"keypair": {"name": "tempest-TestShelveInstance-1144617904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXMXUPa+mTqDYezWa3TxXw8QoVwFp3XBFRtT28L2CIdZRLlyQ1LuUBvrrMq/DHHnTX4WSyvaWlw3ZCL4gGJ8VmIrK8eopPEmyZS1Iaf7/9WqvPtACD5vSa29Cj2tAl2SA=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:03:44.282560 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-910f1a61-8150-4f84-8330-deca76ba4b2c tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Getting quotas for project a5fe886042254d1180b0ed56d3580f86. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:03:44.288706 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-910f1a61-8150-4f84-8330-deca76ba4b2c tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Getting quotas for user 601fac818df64e3ba263b82c09a32d48 and project a5fe886042254d1180b0ed56d3580f86. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:03:44.318330 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-910f1a61-8150-4f84-8330-deca76ba4b2c tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.249382 Jul 28 11:03:44.318938 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 759/1493] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 11:03:44 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:03:45.377401 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=12 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:45.379039 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:45.379755 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:45.388987 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-515864021", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1144617904", "security_groups": [{"name": "tempest-secgroup-smoke-1499517121"}], "networks": [{"uuid": "61d2e0ef-8aad-4967-a5c4-5eac66469e8e"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:03:45.523714 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] validate_networks() for [('61d2e0ef-8aad-4967-a5c4-5eac66469e8e', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:03:45.947255 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:03:45.947876 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:03:45.948351 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:03:45.948758 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:03:45.949168 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:03:45.959899 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:45.960341 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:45.961298 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:45.961894 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:45.984350 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Getting quotas for project a5fe886042254d1180b0ed56d3580f86. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:03:45.989779 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Getting quotas for user 601fac818df64e3ba263b82c09a32d48 and project a5fe886042254d1180b0ed56d3580f86. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:03:46.003213 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:03:46.005448 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: 8abc02c1-c159-4e10-8d8a-13806040f175] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:03:46.053847 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-98ac6703-dc2a-4c50-9a39-e6816f793348 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.677560 Jul 28 11:03:46.054863 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 735/1494] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 11:03:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:03:46.066464 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-ecde6381-c855-49eb-95b0-1c8e68598dae tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:03:46.067147 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-ecde6381-c855-49eb-95b0-1c8e68598dae tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: 8abc02c1-c159-4e10-8d8a-13806040f175] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:03:46.121973 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-ecde6381-c855-49eb-95b0-1c8e68598dae tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601fac818df64e3ba263b82c09a32d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5fe886042254d1180b0ed56d3580f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:03:46.131617 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-ecde6381-c855-49eb-95b0-1c8e68598dae tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] 10.222.0.46 "GET /compute/v2.1/servers/8abc02c1-c159-4e10-8d8a-13806040f175" status: 200 len: 1246 microversion: 2.1 time: 0.069960 Jul 28 11:03:46.132237 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 760/1495] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:03:46 2022] GET /compute/v2.1/servers/8abc02c1-c159-4e10-8d8a-13806040f175 => generated 1246 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:03:47.153569 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-4806eeb5-8558-4793-a88c-5b371738a96b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:03:47.154297 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-4806eeb5-8558-4793-a88c-5b371738a96b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: 8abc02c1-c159-4e10-8d8a-13806040f175] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:03:47.161419 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4806eeb5-8558-4793-a88c-5b371738a96b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:47.161885 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4806eeb5-8558-4793-a88c-5b371738a96b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:47.162701 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4806eeb5-8558-4793-a88c-5b371738a96b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:47.163207 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4806eeb5-8558-4793-a88c-5b371738a96b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:47.194016 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4806eeb5-8558-4793-a88c-5b371738a96b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:47.194503 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-4806eeb5-8558-4793-a88c-5b371738a96b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:47.195001 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-4806eeb5-8558-4793-a88c-5b371738a96b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lazy-loading 'fault' on Instance uuid 8abc02c1-c159-4e10-8d8a-13806040f175 {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:03:47.237438 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-4806eeb5-8558-4793-a88c-5b371738a96b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601fac818df64e3ba263b82c09a32d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5fe886042254d1180b0ed56d3580f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:03:47.245151 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-4806eeb5-8558-4793-a88c-5b371738a96b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] 10.222.0.46 "GET /compute/v2.1/servers/8abc02c1-c159-4e10-8d8a-13806040f175" status: 200 len: 1319 microversion: 2.1 time: 0.096143 Jul 28 11:03:47.245713 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 736/1496] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:03:47 2022] GET /compute/v2.1/servers/8abc02c1-c159-4e10-8d8a-13806040f175 => generated 1319 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:03:47.265822 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-eb594307-209a-4036-86da-8c2d616822e2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:03:47.266380 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-eb594307-209a-4036-86da-8c2d616822e2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: 8abc02c1-c159-4e10-8d8a-13806040f175] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:03:47.272296 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-eb594307-209a-4036-86da-8c2d616822e2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:47.272740 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-eb594307-209a-4036-86da-8c2d616822e2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:47.273497 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-eb594307-209a-4036-86da-8c2d616822e2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:47.273969 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-eb594307-209a-4036-86da-8c2d616822e2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:47.299810 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-eb594307-209a-4036-86da-8c2d616822e2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: 8abc02c1-c159-4e10-8d8a-13806040f175] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:03:47.348154 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-eb594307-209a-4036-86da-8c2d616822e2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: 8abc02c1-c159-4e10-8d8a-13806040f175] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 11:03:47.349060 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-eb594307-209a-4036-86da-8c2d616822e2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:47.349510 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-eb594307-209a-4036-86da-8c2d616822e2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:47.349956 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-eb594307-209a-4036-86da-8c2d616822e2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: 8abc02c1-c159-4e10-8d8a-13806040f175] instance's host None is down, deleting from database Jul 28 11:03:47.354896 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-eb594307-209a-4036-86da-8c2d616822e2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: 8abc02c1-c159-4e10-8d8a-13806040f175] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 11:03:47.389721 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-eb594307-209a-4036-86da-8c2d616822e2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: 8abc02c1-c159-4e10-8d8a-13806040f175] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 11:03:47.395497 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-eb594307-209a-4036-86da-8c2d616822e2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: 8abc02c1-c159-4e10-8d8a-13806040f175] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:03:47.567614 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-eb594307-209a-4036-86da-8c2d616822e2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8abc02c1-c159-4e10-8d8a-13806040f175" status: 204 len: 0 microversion: 2.1 time: 0.305766 Jul 28 11:03:47.568509 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 761/1497] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 11:03:47 2022] DELETE /compute/v2.1/servers/8abc02c1-c159-4e10-8d8a-13806040f175 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:47.581122 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6f705564-1336-4fe6-8732-649e9a36a0a2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:03:47.582040 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-6f705564-1336-4fe6-8732-649e9a36a0a2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: 8abc02c1-c159-4e10-8d8a-13806040f175] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:03:47.588908 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6f705564-1336-4fe6-8732-649e9a36a0a2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:47.589411 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6f705564-1336-4fe6-8732-649e9a36a0a2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:47.590236 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6f705564-1336-4fe6-8732-649e9a36a0a2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:03:47.590674 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-6f705564-1336-4fe6-8732-649e9a36a0a2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:03:47.605636 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-6f705564-1336-4fe6-8732-649e9a36a0a2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] HTTP exception thrown: Instance 8abc02c1-c159-4e10-8d8a-13806040f175 could not be found. Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6f705564-1336-4fe6-8732-649e9a36a0a2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Request method failure captured: Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/8abc02c1-c159-4e10-8d8a-13806040f175 HTTP/1.1 Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4m0KK317vbYgsiSjAOwvkGZZ_rNDlSNXW8cpfEba_wkBiQ6oB9ql_y6hMquYKSYw7-augUkEc0z9jg_ejllbAshHEGPzNul2PBDB0vW_iaNf1FfWKccc7bAt0qlKn_ypH7SgxSqqt8Uc3wEZNx2D1oHh8-PBWVUHboc73FStWuwpqbA Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: a5fe886042254d1180b0ed56d3580f86 Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-TestShelveInstance-1959743433 Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a5fe886042254d1180b0ed56d3580f86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a5fe886042254d1180b0ed56d3580f86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a5fe886042254d1180b0ed56d3580f86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a5fe886042254d1180b0ed56d3580f86", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-TestShelveInstance-1959743433 Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: a5fe886042254d1180b0ed56d3580f86 Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-TestShelveInstance-1959743433 Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-TestShelveInstance-1959743433-project Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: 601fac818df64e3ba263b82c09a32d48 Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-TestShelveInstance-1959743433-project Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 8abc02c1-c159-4e10-8d8a-13806040f175 could not be found. Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '8abc02c1-c159-4e10-8d8a-13806040f175'} Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8abc02c1-c159-4e10-8d8a-13806040f175 could not be found. Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8abc02c1-c159-4e10-8d8a-13806040f175 could not be found. Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:03:47.607373 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:03:47.612323 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:03:47.612323 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:03:47.612323 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:03:47.612323 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:03:47.612323 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:03:47.612323 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8abc02c1-c159-4e10-8d8a-13806040f175 could not be found. Jul 28 11:03:47.612323 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:03:47.612323 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-6f705564-1336-4fe6-8732-649e9a36a0a2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Returning 404 to user: Instance 8abc02c1-c159-4e10-8d8a-13806040f175 could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:03:47.612323 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-6f705564-1336-4fe6-8732-649e9a36a0a2 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] 10.222.0.46 "GET /compute/v2.1/servers/8abc02c1-c159-4e10-8d8a-13806040f175" status: 404 len: 111 microversion: 2.1 time: 0.036075 Jul 28 11:03:47.612323 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 737/1498] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:03:47 2022] GET /compute/v2.1/servers/8abc02c1-c159-4e10-8d8a-13806040f175 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:03:47.845173 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6c65e461-0144-4904-b93c-c7b6decde90f tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Calling method '.version_select at 0x7fa94b6035e0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:03:47.883066 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-6c65e461-0144-4904-b93c-c7b6decde90f tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1144617904" status: 202 len: 0 microversion: 2.1 time: 0.042568 Jul 28 11:03:47.884812 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 762/1499] 10.222.0.46 () {58 vars in 1254 bytes} [Thu Jul 28 11:03:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1144617904 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:03:47.900431 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-8892023a-c152-4a13-a923-0f4d1f347d2d tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Action: 'create', calling method: .version_select at 0x7fa94b6c7e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-3678664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIZXt4LMsbdhDK44iGpRQuy2SI3rXjX+FAQL0Azi5HXbhsNV/J3/CGb+XFqXklavytgDtEZputZgEf+VRmENxPm9W66qpPAwjZDZQpholCH/ZblB07vYTv6U/wkvMf7fQ=="}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:03:47.920096 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-8892023a-c152-4a13-a923-0f4d1f347d2d tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Getting quotas for project a5fe886042254d1180b0ed56d3580f86. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:03:47.927222 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-8892023a-c152-4a13-a923-0f4d1f347d2d tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Getting quotas for user 601fac818df64e3ba263b82c09a32d48 and project a5fe886042254d1180b0ed56d3580f86. Resources: {'key_pairs'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:03:47.960662 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-8892023a-c152-4a13-a923-0f4d1f347d2d tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.065348 Jul 28 11:03:47.961664 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 738/1500] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 11:03:47 2022] POST /compute/v2.1/os-keypairs => generated 394 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:04:04.155838 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=6 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:04.156914 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:04.157670 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:04.162272 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1067086445", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-3678664", "security_groups": [{"name": "tempest-secgroup-smoke-1924112399"}], "networks": [{"uuid": "61d2e0ef-8aad-4967-a5c4-5eac66469e8e"}], "block_device_mapping_v2": [{"uuid": "9c35ca08-5088-4f62-8f79-7d65e6bba165", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:04:04.279020 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] validate_networks() for [('61d2e0ef-8aad-4967-a5c4-5eac66469e8e', None, None, None, None, None)] {{(pid=119464) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:04:04.644978 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Flavor limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:04:04.645403 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Image limits 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:04:04.645900 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Flavor pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:04:04.646312 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Image pref 0:0:0 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:04:04.646726 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.virt.hardware [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:04:04.655326 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:04.655771 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:04.656840 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:04.657281 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:04.674565 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Getting quotas for project a5fe886042254d1180b0ed56d3580f86. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:04:04.679561 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Getting quotas for user 601fac818df64e3ba263b82c09a32d48 and project a5fe886042254d1180b0ed56d3580f86. Resources: {'ram', 'cores', 'instances'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:04:04.738797 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Going to run 1 instances... {{(pid=119464) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:04:04.740860 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9c35ca08-5088-4f62-8f79-7d65e6bba165',volume_size=None,volume_type=None)] {{(pid=119464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:04:04.869880 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-9f4b1a8e-7b00-4c00-8dcb-529d81ef8a1b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.714818 Jul 28 11:04:04.870544 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 763/1501] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 11:04:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:04:04.882406 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-cf695aac-f304-42f7-8345-97d962f61561 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:04:04.883046 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-cf695aac-f304-42f7-8345-97d962f61561 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:04:04.887179 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell1:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:04.887879 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=12 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:04.889520 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=10 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:04.890498 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=4 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:04.951159 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-cf695aac-f304-42f7-8345-97d962f61561 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601fac818df64e3ba263b82c09a32d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5fe886042254d1180b0ed56d3580f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:04:04.958475 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-cf695aac-f304-42f7-8345-97d962f61561 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] 10.222.0.46 "GET /compute/v2.1/servers/b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d" status: 200 len: 1086 microversion: 2.1 time: 0.079798 Jul 28 11:04:04.959218 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 739/1502] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:04:04 2022] GET /compute/v2.1/servers/b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d => generated 1086 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:04:05.979633 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-403b6bcb-ddfa-4f81-99d6-148f4e0822a0 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:04:05.980186 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-403b6bcb-ddfa-4f81-99d6-148f4e0822a0 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:04:05.986926 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-403b6bcb-ddfa-4f81-99d6-148f4e0822a0 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:05.987380 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-403b6bcb-ddfa-4f81-99d6-148f4e0822a0 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:05.988148 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-403b6bcb-ddfa-4f81-99d6-148f4e0822a0 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:05.988596 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-403b6bcb-ddfa-4f81-99d6-148f4e0822a0 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:06.018742 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-403b6bcb-ddfa-4f81-99d6-148f4e0822a0 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:06.019196 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-403b6bcb-ddfa-4f81-99d6-148f4e0822a0 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:06.019645 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.objects.instance [None req-403b6bcb-ddfa-4f81-99d6-148f4e0822a0 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lazy-loading 'fault' on Instance uuid b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d {{(pid=119464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:04:06.059967 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-403b6bcb-ddfa-4f81-99d6-148f4e0822a0 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601fac818df64e3ba263b82c09a32d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5fe886042254d1180b0ed56d3580f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:04:06.067924 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-403b6bcb-ddfa-4f81-99d6-148f4e0822a0 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] 10.222.0.46 "GET /compute/v2.1/servers/b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d" status: 200 len: 1205 microversion: 2.1 time: 0.092259 Jul 28 11:04:06.068495 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 764/1503] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:04:05 2022] GET /compute/v2.1/servers/b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d => generated 1205 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:04:06.087886 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-49bafda3-f72d-40bb-b05c-7271269411fc tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:04:06.088372 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-49bafda3-f72d-40bb-b05c-7271269411fc tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:04:06.095840 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-49bafda3-f72d-40bb-b05c-7271269411fc tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:06.096290 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-49bafda3-f72d-40bb-b05c-7271269411fc tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:06.097050 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-49bafda3-f72d-40bb-b05c-7271269411fc tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:06.097488 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-49bafda3-f72d-40bb-b05c-7271269411fc tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:06.122089 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-49bafda3-f72d-40bb-b05c-7271269411fc tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d] Going to try to terminate instance {{(pid=119463) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:04:06.170739 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-49bafda3-f72d-40bb-b05c-7271269411fc tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119463) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 11:04:06.171646 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-49bafda3-f72d-40bb-b05c-7271269411fc tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:06.172091 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-49bafda3-f72d-40bb-b05c-7271269411fc tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:06.172522 n-d-850468-6 devstack@n-api.service[119463]: WARNING nova.compute.api [None req-49bafda3-f72d-40bb-b05c-7271269411fc tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d] instance's host None is down, deleting from database Jul 28 11:04:06.177179 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-49bafda3-f72d-40bb-b05c-7271269411fc tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d] deallocate_for_instance() {{(pid=119463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 11:04:06.211266 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-49bafda3-f72d-40bb-b05c-7271269411fc tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d] Instance cache missing network info. {{(pid=119463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 11:04:06.218031 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-49bafda3-f72d-40bb-b05c-7271269411fc tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d] Updating instance_info_cache with network_info: [] {{(pid=119463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:04:06.495649 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-49bafda3-f72d-40bb-b05c-7271269411fc tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d" status: 204 len: 0 microversion: 2.1 time: 0.411383 Jul 28 11:04:06.496273 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 740/1504] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 11:04:06 2022] DELETE /compute/v2.1/servers/b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:06.504454 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f392d54d-334d-4b75-8865-df1abc4e2e9b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:04:06.505274 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-f392d54d-334d-4b75-8865-df1abc4e2e9b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] [instance: b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:04:06.511369 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f392d54d-334d-4b75-8865-df1abc4e2e9b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:06.511888 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f392d54d-334d-4b75-8865-df1abc4e2e9b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:06.512784 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f392d54d-334d-4b75-8865-df1abc4e2e9b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:06.513289 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-f392d54d-334d-4b75-8865-df1abc4e2e9b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:06.527447 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.wsgi [None req-f392d54d-334d-4b75-8865-df1abc4e2e9b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] HTTP exception thrown: Instance b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d could not be found. Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f392d54d-334d-4b75-8865-df1abc4e2e9b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Request method failure captured: Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: request: GET /compute/v2.1/servers/b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d HTTP/1.1 Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: Accept: application/json Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: Accept-Encoding: identity Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: Connection: close Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: Content-Length: 0 Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: Content-Type: application/json Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: Host: 10.222.0.46 Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: Openstack-System-Scope: None Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: User-Agent: python-urllib3/1.26.10 Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: X-Auth-Token: gAAAAABi4m0KK317vbYgsiSjAOwvkGZZ_rNDlSNXW8cpfEba_wkBiQ6oB9ql_y6hMquYKSYw7-augUkEc0z9jg_ejllbAshHEGPzNul2PBDB0vW_iaNf1FfWKccc7bAt0qlKn_ypH7SgxSqqt8Uc3wEZNx2D1oHh8-PBWVUHboc73FStWuwpqbA Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Id: None Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: X-Domain-Name: None Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: X-Identity-Status: Confirmed Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: X-Is-Admin-Project: True Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Id: default Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Domain-Name: Default Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Id: a5fe886042254d1180b0ed56d3580f86 Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: X-Project-Name: tempest-TestShelveInstance-1959743433 Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: X-Role: reader,member Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: X-Roles: reader,member Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a5fe886042254d1180b0ed56d3580f86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a5fe886042254d1180b0ed56d3580f86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a5fe886042254d1180b0ed56d3580f86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a5fe886042254d1180b0ed56d3580f86", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant: tempest-TestShelveInstance-1959743433 Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Id: a5fe886042254d1180b0ed56d3580f86 Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: X-Tenant-Name: tempest-TestShelveInstance-1959743433 Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: X-User: tempest-TestShelveInstance-1959743433-project Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Id: default Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: X-User-Domain-Name: Default Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: X-User-Id: 601fac818df64e3ba263b82c09a32d48 Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: X-User-Name: tempest-TestShelveInstance-1959743433-project Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: method: > Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: exception: Instance b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d could not be found. Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: action_args: {'id': 'b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d'} Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d could not be found. Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d could not be found. Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:04:06.529050 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:04:06.534398 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:04:06.534398 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:04:06.534398 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:04:06.534398 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:04:06.534398 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:04:06.534398 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d could not be found. Jul 28 11:04:06.534398 n-d-850468-6 devstack@n-api.service[119464]: ERROR nova.api.openstack.wsgi Jul 28 11:04:06.534398 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-f392d54d-334d-4b75-8865-df1abc4e2e9b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Returning 404 to user: Instance b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d could not be found. {{(pid=119464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:04:06.534398 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-f392d54d-334d-4b75-8865-df1abc4e2e9b tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] 10.222.0.46 "GET /compute/v2.1/servers/b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d" status: 404 len: 111 microversion: 2.1 time: 0.031171 Jul 28 11:04:06.534398 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 765/1505] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:04:06 2022] GET /compute/v2.1/servers/b73f4cc8-43f0-4ccc-8fe7-1fdd67eb431d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:04:06.694888 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-16670526-0d37-47bc-8764-33dddd3f29d3 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] Calling method '.version_select at 0x7fa94b82c8b0>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:04:06.716450 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-16670526-0d37-47bc-8764-33dddd3f29d3 tempest-TestShelveInstance-1959743433 tempest-TestShelveInstance-1959743433-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-3678664" status: 202 len: 0 microversion: 2.1 time: 0.025441 Jul 28 11:04:06.717038 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 741/1506] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 11:04:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-3678664 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:04:23.795394 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell1:SELECT=2 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:23.797108 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=6 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:23.797670 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:23.798436 n-d-850468-6 devstack@n-api.service[119464]: DEBUG dbcounter [-] [119464] Writing DB stats nova_cell0:SELECT=12 {{(pid=119464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:23.978500 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-1e15ab32-c858-46bb-9169-f7f55f1d41d1 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Action: 'create', calling method: .version_select at 0x7fa94b5a71f0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-243299160", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMC4ll5dV032QV+9USe8GXjMIJFWnyOSj8tp7dHUKcf5U6R6kBUNhCqj2S3XBcbQEWfREczBiHtTVIaLZubhwyxc/ebVLEMosaAUQ6YljjHKz7wmV7auYLm8okazkeQMA=="}} {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:04:23.995532 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-1e15ab32-c858-46bb-9169-f7f55f1d41d1 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Getting quotas for project 2e7a5acb13744f77b16a0cceb837c559. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:04:24.002159 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.quota [None req-1e15ab32-c858-46bb-9169-f7f55f1d41d1 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Getting quotas for user c29530c4dfec415397320a8a3f50fcb3 and project 2e7a5acb13744f77b16a0cceb837c559. Resources: {'key_pairs'} {{(pid=119464) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:04:24.030031 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-1e15ab32-c858-46bb-9169-f7f55f1d41d1 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.239112 Jul 28 11:04:24.030639 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 766/1507] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 11:04:23 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:04:25.078215 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:25.079064 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:25.079783 n-d-850468-6 devstack@n-api.service[119463]: DEBUG dbcounter [-] [119463] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:25.084113 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1608259182", "imageRef": "eff4a889-87b7-4a4c-be7a-77433dc25faf", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-243299160", "security_groups": [{"name": "tempest-secgroup-smoke-359611447"}], "networks": [{"uuid": "f84da621-1977-420c-8a0d-ead9aea48c94"}]}} {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:04:25.191325 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.network.neutron [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] validate_networks() for [('f84da621-1977-420c-8a0d-ead9aea48c94', None, None, None, None, None)] {{(pid=119463) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:04:25.599338 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Flavor limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:04:25.599754 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Image limits 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:04:25.600225 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Flavor pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:04:25.600628 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Image pref 0:0:0 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:04:25.601032 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.virt.hardware [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:04:25.610740 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:25.611612 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:25.612455 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:25.612932 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "a9e94609-c9be-4409-8579-80fe73a29a93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:25.630658 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Getting quotas for project 2e7a5acb13744f77b16a0cceb837c559. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:04:25.636442 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.quota [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Getting quotas for user c29530c4dfec415397320a8a3f50fcb3 and project 2e7a5acb13744f77b16a0cceb837c559. Resources: {'ram', 'cores', 'instances'} {{(pid=119463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:04:25.651536 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Going to run 1 instances... {{(pid=119463) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:04:25.653991 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] [instance: 0719ad55-41b8-4f13-87ec-267a50ff1a2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eff4a889-87b7-4a4c-be7a-77433dc25faf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:04:25.716023 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-43d1453d-4178-4f8a-abc9-f7b0943236fa tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.638922 Jul 28 11:04:25.716809 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 742/1508] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 11:04:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:04:25.728380 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-83066c1a-141f-4b05-b7e1-262e8e954f9a tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:04:25.729722 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-83066c1a-141f-4b05-b7e1-262e8e954f9a tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] [instance: 0719ad55-41b8-4f13-87ec-267a50ff1a2c] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:04:25.792232 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.policy [None req-83066c1a-141f-4b05-b7e1-262e8e954f9a tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29530c4dfec415397320a8a3f50fcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7a5acb13744f77b16a0cceb837c559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:04:25.802824 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-83066c1a-141f-4b05-b7e1-262e8e954f9a tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] 10.222.0.46 "GET /compute/v2.1/servers/0719ad55-41b8-4f13-87ec-267a50ff1a2c" status: 200 len: 1248 microversion: 2.1 time: 0.078761 Jul 28 11:04:25.804432 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 767/1509] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:04:25 2022] GET /compute/v2.1/servers/0719ad55-41b8-4f13-87ec-267a50ff1a2c => generated 1248 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:04:26.823929 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-a1c225ec-c37c-4be1-8424-af5c1c2db9e2 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:04:26.824568 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-a1c225ec-c37c-4be1-8424-af5c1c2db9e2 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] [instance: 0719ad55-41b8-4f13-87ec-267a50ff1a2c] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:04:26.831473 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a1c225ec-c37c-4be1-8424-af5c1c2db9e2 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:26.831925 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a1c225ec-c37c-4be1-8424-af5c1c2db9e2 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:26.832701 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a1c225ec-c37c-4be1-8424-af5c1c2db9e2 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:26.833138 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a1c225ec-c37c-4be1-8424-af5c1c2db9e2 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:26.864549 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a1c225ec-c37c-4be1-8424-af5c1c2db9e2 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:26.864998 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-a1c225ec-c37c-4be1-8424-af5c1c2db9e2 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:26.865449 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.objects.instance [None req-a1c225ec-c37c-4be1-8424-af5c1c2db9e2 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lazy-loading 'fault' on Instance uuid 0719ad55-41b8-4f13-87ec-267a50ff1a2c {{(pid=119463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:04:26.907364 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.policy [None req-a1c225ec-c37c-4be1-8424-af5c1c2db9e2 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29530c4dfec415397320a8a3f50fcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7a5acb13744f77b16a0cceb837c559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:04:26.914825 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-a1c225ec-c37c-4be1-8424-af5c1c2db9e2 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] 10.222.0.46 "GET /compute/v2.1/servers/0719ad55-41b8-4f13-87ec-267a50ff1a2c" status: 200 len: 1321 microversion: 2.1 time: 0.094890 Jul 28 11:04:26.915390 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 743/1510] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:04:26 2022] GET /compute/v2.1/servers/0719ad55-41b8-4f13-87ec-267a50ff1a2c => generated 1321 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:04:26.936706 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-0dd3aabe-503b-4bb4-a00b-ad2f44e74903 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Calling method '>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:04:26.937777 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0dd3aabe-503b-4bb4-a00b-ad2f44e74903 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] [instance: 0719ad55-41b8-4f13-87ec-267a50ff1a2c] Fetching instance by UUID {{(pid=119464) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:04:26.943973 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0dd3aabe-503b-4bb4-a00b-ad2f44e74903 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:26.944423 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0dd3aabe-503b-4bb4-a00b-ad2f44e74903 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:26.945188 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0dd3aabe-503b-4bb4-a00b-ad2f44e74903 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:26.945620 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0dd3aabe-503b-4bb4-a00b-ad2f44e74903 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:26.971359 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0dd3aabe-503b-4bb4-a00b-ad2f44e74903 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] [instance: 0719ad55-41b8-4f13-87ec-267a50ff1a2c] Going to try to terminate instance {{(pid=119464) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:04:27.020450 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.compute.api [None req-0dd3aabe-503b-4bb4-a00b-ad2f44e74903 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] [instance: 0719ad55-41b8-4f13-87ec-267a50ff1a2c] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119464) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 11:04:27.021292 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0dd3aabe-503b-4bb4-a00b-ad2f44e74903 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:27.021739 n-d-850468-6 devstack@n-api.service[119464]: DEBUG oslo_concurrency.lockutils [None req-0dd3aabe-503b-4bb4-a00b-ad2f44e74903 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:27.022205 n-d-850468-6 devstack@n-api.service[119464]: WARNING nova.compute.api [None req-0dd3aabe-503b-4bb4-a00b-ad2f44e74903 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] [instance: 0719ad55-41b8-4f13-87ec-267a50ff1a2c] instance's host None is down, deleting from database Jul 28 11:04:27.025561 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0dd3aabe-503b-4bb4-a00b-ad2f44e74903 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] [instance: 0719ad55-41b8-4f13-87ec-267a50ff1a2c] deallocate_for_instance() {{(pid=119464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 11:04:27.061400 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0dd3aabe-503b-4bb4-a00b-ad2f44e74903 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] [instance: 0719ad55-41b8-4f13-87ec-267a50ff1a2c] Instance cache missing network info. {{(pid=119464) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 28 11:04:27.067569 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.network.neutron [None req-0dd3aabe-503b-4bb4-a00b-ad2f44e74903 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] [instance: 0719ad55-41b8-4f13-87ec-267a50ff1a2c] Updating instance_info_cache with network_info: [] {{(pid=119464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:04:27.210976 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-0dd3aabe-503b-4bb4-a00b-ad2f44e74903 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0719ad55-41b8-4f13-87ec-267a50ff1a2c" status: 204 len: 0 microversion: 2.1 time: 0.278748 Jul 28 11:04:27.211562 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 768/1511] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 11:04:26 2022] DELETE /compute/v2.1/servers/0719ad55-41b8-4f13-87ec-267a50ff1a2c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 11:04:27.220897 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b2f20b68-b947-4a35-a6ad-1fb937340c55 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Calling method '>' {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:04:27.221520 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.compute.api [None req-b2f20b68-b947-4a35-a6ad-1fb937340c55 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] [instance: 0719ad55-41b8-4f13-87ec-267a50ff1a2c] Fetching instance by UUID {{(pid=119463) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:04:27.227656 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b2f20b68-b947-4a35-a6ad-1fb937340c55 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:27.228114 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b2f20b68-b947-4a35-a6ad-1fb937340c55 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:27.228887 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b2f20b68-b947-4a35-a6ad-1fb937340c55 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:04:27.229327 n-d-850468-6 devstack@n-api.service[119463]: DEBUG oslo_concurrency.lockutils [None req-b2f20b68-b947-4a35-a6ad-1fb937340c55 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:04:27.243552 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.wsgi [None req-b2f20b68-b947-4a35-a6ad-1fb937340c55 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] HTTP exception thrown: Instance 0719ad55-41b8-4f13-87ec-267a50ff1a2c could not be found. Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b2f20b68-b947-4a35-a6ad-1fb937340c55 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Request method failure captured: Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: request: GET /compute/v2.1/servers/0719ad55-41b8-4f13-87ec-267a50ff1a2c HTTP/1.1 Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: Accept: application/json Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: Accept-Encoding: identity Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: Connection: close Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: Content-Length: 0 Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: Content-Type: application/json Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: Host: 10.222.0.46 Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: Openstack-System-Scope: None Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: User-Agent: python-urllib3/1.26.10 Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: X-Auth-Token: gAAAAABi4m0ysOXgrbj2Zwsb7O_f6N-H5jlbqAgGQSVj8vu2qrMNoIepyTTNNzgP8_HQUR0nG0NGZnJRZe69D44-BiTRDdqX2gG9CIYQt4QPjo_5HRgkR1k4AxbmbChzMWuTpT1M-VDi8a6at9QTIcKv2gtsJDobPZbwwXkF2OnvM7Yq1-3Vujw Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Id: None Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: X-Domain-Name: None Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: X-Identity-Status: Confirmed Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: X-Is-Admin-Project: True Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Id: default Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Domain-Name: Default Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Id: 2e7a5acb13744f77b16a0cceb837c559 Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: X-Project-Name: tempest-TestSnapshotPattern-1898393366 Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: X-Role: reader,member Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: X-Roles: reader,member Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2e7a5acb13744f77b16a0cceb837c559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e7a5acb13744f77b16a0cceb837c559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e7a5acb13744f77b16a0cceb837c559"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2e7a5acb13744f77b16a0cceb837c559", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant: tempest-TestSnapshotPattern-1898393366 Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Id: 2e7a5acb13744f77b16a0cceb837c559 Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: X-Tenant-Name: tempest-TestSnapshotPattern-1898393366 Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: X-User: tempest-TestSnapshotPattern-1898393366-project Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Id: default Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: X-User-Domain-Name: Default Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: X-User-Id: c29530c4dfec415397320a8a3f50fcb3 Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: X-User-Name: tempest-TestSnapshotPattern-1898393366-project Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: method: > Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: exception: Instance 0719ad55-41b8-4f13-87ec-267a50ff1a2c could not be found. Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: action_args: {'id': '0719ad55-41b8-4f13-87ec-267a50ff1a2c'} Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: {{(pid=119463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0719ad55-41b8-4f13-87ec-267a50ff1a2c could not be found. Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0719ad55-41b8-4f13-87ec-267a50ff1a2c could not be found. Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:04:27.245088 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:04:27.250606 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:04:27.250606 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:04:27.250606 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:04:27.250606 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:04:27.250606 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:04:27.250606 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0719ad55-41b8-4f13-87ec-267a50ff1a2c could not be found. Jul 28 11:04:27.250606 n-d-850468-6 devstack@n-api.service[119463]: ERROR nova.api.openstack.wsgi Jul 28 11:04:27.250606 n-d-850468-6 devstack@n-api.service[119463]: DEBUG nova.api.openstack.wsgi [None req-b2f20b68-b947-4a35-a6ad-1fb937340c55 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Returning 404 to user: Instance 0719ad55-41b8-4f13-87ec-267a50ff1a2c could not be found. {{(pid=119463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:04:27.250606 n-d-850468-6 devstack@n-api.service[119463]: INFO nova.api.openstack.requestlog [None req-b2f20b68-b947-4a35-a6ad-1fb937340c55 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] 10.222.0.46 "GET /compute/v2.1/servers/0719ad55-41b8-4f13-87ec-267a50ff1a2c" status: 404 len: 111 microversion: 2.1 time: 0.030406 Jul 28 11:04:27.250606 n-d-850468-6 devstack@n-api.service[119463]: [pid: 119463|app: 0|req: 744/1512] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 11:04:27 2022] GET /compute/v2.1/servers/0719ad55-41b8-4f13-87ec-267a50ff1a2c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:04:27.425946 n-d-850468-6 devstack@n-api.service[119464]: DEBUG nova.api.openstack.wsgi [None req-6351c4ef-adf6-4dba-8e55-99ad79530742 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] Calling method '.version_select at 0x7fa94b5880d0>' {{(pid=119464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:04:27.455621 n-d-850468-6 devstack@n-api.service[119464]: INFO nova.api.openstack.requestlog [None req-6351c4ef-adf6-4dba-8e55-99ad79530742 tempest-TestSnapshotPattern-1898393366 tempest-TestSnapshotPattern-1898393366-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-243299160" status: 202 len: 0 microversion: 2.1 time: 0.035318 Jul 28 11:04:27.456641 n-d-850468-6 devstack@n-api.service[119464]: [pid: 119464|app: 0|req: 769/1513] 10.222.0.46 () {58 vars in 1254 bytes} [Thu Jul 28 11:04:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-243299160 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:05:26.378708 n-d-850468-6 devstack@n-api.service[119463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 11:05:26.379353 n-d-850468-6 devstack@n-api.service[119463]: Thu Jul 28 11:05:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 11:06:46.633795 n-d-850468-6 devstack@n-api.service[119464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 11:06:46.634449 n-d-850468-6 devstack@n-api.service[119464]: Thu Jul 28 11:06:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 11:06:50.004796 n-d-850468-6 devstack@n-api.service[119463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 11:06:50.005359 n-d-850468-6 devstack@n-api.service[119463]: Thu Jul 28 11:06:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 11:06:50.132588 n-d-850468-6 devstack@n-api.service[119463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 11:06:50.132814 n-d-850468-6 devstack@n-api.service[119463]: Thu Jul 28 11:06:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 11:08:46.387154 n-d-850468-6 devstack@n-api.service[119463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 11:08:46.387904 n-d-850468-6 devstack@n-api.service[119463]: Thu Jul 28 11:08:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!